-- Logs begin at Wed 2022-08-31 11:46:55 UTC, end at Wed 2022-08-31 12:49:42 UTC. -- Aug 31 12:14:26.645653 dv-cinder-855288-4-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Aug 31 12:14:26.657011 dv-cinder-855288-4-iscsi devstack@keystone.service[81485]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 31 12:14:26.659100 dv-cinder-855288-4-iscsi devstack@keystone.service[81485]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 31 12:14:26 2022] *** Aug 31 12:14:26.659100 dv-cinder-855288-4-iscsi devstack@keystone.service[81485]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 31 12:14:26.659100 dv-cinder-855288-4-iscsi devstack@keystone.service[81485]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 31 12:14:26.659100 dv-cinder-855288-4-iscsi devstack@keystone.service[81485]: nodename: dv-cinder-855288-4-iscsi Aug 31 12:14:26.659100 dv-cinder-855288-4-iscsi devstack@keystone.service[81485]: machine: x86_64 Aug 31 12:14:26.659100 dv-cinder-855288-4-iscsi devstack@keystone.service[81485]: clock source: unix Aug 31 12:14:26.659100 dv-cinder-855288-4-iscsi devstack@keystone.service[81485]: pcre jit disabled Aug 31 12:14:26.659100 dv-cinder-855288-4-iscsi devstack@keystone.service[81485]: detected number of CPU cores: 4 Aug 31 12:14:26.659100 dv-cinder-855288-4-iscsi devstack@keystone.service[81485]: current working directory: / Aug 31 12:14:26.659100 dv-cinder-855288-4-iscsi devstack@keystone.service[81485]: detected binary path: /usr/bin/uwsgi-core Aug 31 12:14:26.659100 dv-cinder-855288-4-iscsi devstack@keystone.service[81485]: your processes number limit is 47680 Aug 31 12:14:26.659812 dv-cinder-855288-4-iscsi devstack@keystone.service[81485]: your memory page size is 4096 bytes Aug 31 12:14:26.659812 dv-cinder-855288-4-iscsi devstack@keystone.service[81485]: detected max file descriptor number: 2048 Aug 31 12:14:26.659812 dv-cinder-855288-4-iscsi devstack@keystone.service[81485]: lock engine: pthread robust mutexes Aug 31 12:14:26.659812 dv-cinder-855288-4-iscsi devstack@keystone.service[81485]: thunder lock: enabled Aug 31 12:14:26.659812 dv-cinder-855288-4-iscsi devstack@keystone.service[81485]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 31 12:14:26.659812 dv-cinder-855288-4-iscsi devstack@keystone.service[81485]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 31 12:14:26.699875 dv-cinder-855288-4-iscsi devstack@keystone.service[81485]: Python main interpreter initialized at 0x5646e1f2d9c0 Aug 31 12:14:26.699875 dv-cinder-855288-4-iscsi devstack@keystone.service[81485]: python threads support enabled Aug 31 12:14:26.699875 dv-cinder-855288-4-iscsi devstack@keystone.service[81485]: your server socket listen backlog is limited to 100 connections Aug 31 12:14:26.699875 dv-cinder-855288-4-iscsi devstack@keystone.service[81485]: your mercy for graceful operations on workers is 90 seconds Aug 31 12:14:26.700244 dv-cinder-855288-4-iscsi devstack@keystone.service[81485]: mapped 403077 bytes (393 KB) for 2 cores Aug 31 12:14:26.700244 dv-cinder-855288-4-iscsi devstack@keystone.service[81485]: *** Operational MODE: preforking *** Aug 31 12:14:26.700514 dv-cinder-855288-4-iscsi devstack@keystone.service[81485]: *** uWSGI is running in multiple interpreter mode *** Aug 31 12:14:26.700514 dv-cinder-855288-4-iscsi devstack@keystone.service[81485]: spawned uWSGI master process (pid: 81485) Aug 31 12:14:26.700732 dv-cinder-855288-4-iscsi systemd[1]: Started Devstack devstack@keystone.service. Aug 31 12:14:26.701657 dv-cinder-855288-4-iscsi devstack@keystone.service[81485]: spawned uWSGI worker 1 (pid: 81495, cores: 1) Aug 31 12:14:26.701757 dv-cinder-855288-4-iscsi devstack@keystone.service[81485]: spawned uWSGI worker 2 (pid: 81496, cores: 1) Aug 31 12:14:26.702209 dv-cinder-855288-4-iscsi devstack@keystone.service[81485]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 31 12:14:31.089692 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 12:14:31.089692 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: from cryptography.utils import int_from_bytes Aug 31 12:14:31.090515 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 12:14:31.090515 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: from cryptography.utils import int_from_bytes Aug 31 12:14:31.090638 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 12:14:31.090638 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: from cryptography.utils import int_from_bytes Aug 31 12:14:31.091098 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 12:14:31.091098 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: from cryptography.utils import int_from_bytes Aug 31 12:14:31.142324 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 12:14:31.142546 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 12:14:31.142637 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 12:14:31.142723 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 12:14:31.142803 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] command line args: [] {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 12:14:31.142892 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] command line args: [] {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 12:14:31.142978 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 12:14:31.143051 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 12:14:31.143119 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] ================================================================================ {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 12:14:31.143185 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] ================================================================================ {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 12:14:31.143376 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] admin_token = **** {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:14:31.143478 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] admin_token = **** {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:14:31.143622 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] config_dir = [] {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:14:31.143701 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] config_dir = [] {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:14:31.143806 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:14:31.143890 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:14:31.143967 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] config_source = [] {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:14:31.144048 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] config_source = [] {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:14:31.144152 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] debug = True {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:14:31.144232 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] debug = True {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:14:31.144351 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:14:31.144671 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:14:31.144808 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:14:31.144912 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:14:31.145013 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:14:31.145123 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:14:31.145225 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:14:31.145327 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:14:31.145428 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:14:31.145523 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:14:31.145629 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] list_limit = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:14:31.145724 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] list_limit = None {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:14:31.145823 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] log_config_append = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:14:31.145928 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] log_config_append = None {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:14:31.146035 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:14:31.146136 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:14:31.146238 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] log_dir = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:14:31.146333 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] log_dir = None {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:14:31.146433 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] log_file = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:14:31.146538 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] log_file = None {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:14:31.146638 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:14:31.146716 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:14:31.146836 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:14:31.146948 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:14:31.147080 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:14:31.147166 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:14:31.147238 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:14:31.147364 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:14:31.147441 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:14:31.147563 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:14:31.147650 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:14:31.147727 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:14:31.147843 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:14:31.147923 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:14:31.148056 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:14:31.148139 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:14:31.148267 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:14:31.148349 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:14:31.148425 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:14:31.148540 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:14:31.148621 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:14:31.148740 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:14:31.148853 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:14:31.148947 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:14:31.149102 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:14:31.149252 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:14:31.149350 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:14:31.149474 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:14:31.149625 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:14:31.149703 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:14:31.150123 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.79/identity {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:14:31.150211 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.79/identity {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:14:31.150339 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] publish_errors = False {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:14:31.150415 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] publish_errors = False {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:14:31.150530 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:14:31.150610 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:14:31.151287 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:14:31.151423 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:14:31.151506 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:14:31.151614 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:14:31.151692 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:14:31.151846 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:14:31.151974 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:14:31.152090 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:14:31.152165 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] standard_threads = False {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:14:31.152309 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] standard_threads = False {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:14:31.152404 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:14:31.152554 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:14:31.152644 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:14:31.152753 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:14:31.152830 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:14:31.152930 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] use_journal = False {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:14:31.153057 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:14:31.153132 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] use_json = False {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:14:31.153208 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] use_journal = False {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:14:31.153285 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] use_stderr = False {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:14:31.153356 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] use_json = False {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:14:31.153426 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] use_syslog = False {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:14:31.153503 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] use_stderr = False {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:14:31.153603 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] use_syslog = False {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:14:31.153680 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:14:31.153838 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:14:31.153962 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.154097 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.154198 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.154335 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.154418 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.154590 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.154671 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.154833 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.154996 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.155133 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.155263 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.155392 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.155517 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.155641 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.155775 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.155900 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.156024 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.156145 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.156269 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.156393 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.156529 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.156666 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.156789 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.156913 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.156995 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.157155 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.157286 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.157421 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.157536 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.157611 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.157682 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.157758 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.157837 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.157923 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.158005 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.158145 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.158221 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.158337 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.158495 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.158570 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.158640 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.158805 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.158903 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.159086 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.159173 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.159338 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.159415 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.159589 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.159667 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.159824 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.159910 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.160054 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.160131 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.160287 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.160365 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.160515 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.160593 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.160750 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.160871 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.160999 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.161076 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.161231 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.161310 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.161460 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.161538 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.161690 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.161769 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.161938 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.162018 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.162174 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.162251 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.162413 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.162489 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.162644 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.162721 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.162897 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.162981 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.163140 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.163246 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.163371 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.163456 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.163603 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.163690 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.163834 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.163914 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.164068 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.164151 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.164286 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.164368 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.164526 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.164613 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.164754 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.164836 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.164990 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.165071 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.165222 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.165311 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.165454 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.165541 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.165685 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.165771 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.165920 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.165995 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.166157 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.166237 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.166980 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.167115 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.167226 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.167328 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.167448 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.167543 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.167738 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.168011 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.168107 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.168283 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.168362 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.168478 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.168572 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.168650 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.168725 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.168893 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.168983 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.169120 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.169198 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.169325 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.169401 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.169480 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.169568 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.169648 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.169764 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.169840 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.169965 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.170093 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.170214 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.170399 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.170522 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.170598 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.170658 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.170768 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.170923 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.171044 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.171185 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.171261 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.171400 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.171505 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.171640 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.171745 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.171876 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.171983 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.172124 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.172222 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.172363 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.172520 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.172600 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.172699 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.172819 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.172938 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.173043 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.173182 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.173295 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.173426 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.173531 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.173672 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.173808 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.173977 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.174110 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.174222 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.174359 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.174461 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.174558 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.174668 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.174798 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.174930 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.175042 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.175140 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.175241 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.175346 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.175476 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.175579 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.175697 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.175794 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.175895 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.176088 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.176174 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.176253 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.176326 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.176462 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.176551 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.176698 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.176805 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.176929 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.177008 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.177159 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.177242 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.177391 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.177480 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.177625 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.177703 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.177861 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.177939 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.178094 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.178183 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.178338 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.178421 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.178574 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.178658 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.178822 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.178979 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.179085 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.179171 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.179336 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.179413 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.179572 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] auth.external = None {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.179694 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.179804 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.179897 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.180043 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] auth.external = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.180123 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.180278 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.180367 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.180547 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] auth.password = None {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.180634 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.180782 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] auth.token = None {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.180863 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.181018 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] auth.password = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.181098 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.181252 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] auth.token = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.181343 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.181494 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.181574 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.181725 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.181806 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.181999 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.182093 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.182253 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.182425 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.182507 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.182691 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.182771 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] credential.caching = True {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.182970 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.183045 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.183211 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.183301 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.183456 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] credential.caching = True {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.183545 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.183702 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.183782 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.183950 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.184030 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.184190 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.184271 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.184436 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.184518 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.184684 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.184797 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.184911 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.184988 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.185163 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.185243 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.185419 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.185499 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.185658 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.185738 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.185915 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.185997 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.186168 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.186246 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.186428 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.186508 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.186666 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] federation.caching = True {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.186748 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.186923 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.187006 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.187175 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.187254 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.187425 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.187507 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] federation.caching = True {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.187656 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.187735 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.187902 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.187981 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.188139 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.188219 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.188372 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.188454 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.188621 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.188708 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.188876 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.188955 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.189113 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.189192 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.189360 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.189447 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.189596 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] identity.caching = True {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.189676 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.189844 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.189926 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.190089 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.190245 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.190322 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] identity.caching = True {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.190438 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.190561 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.190641 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.190807 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.190954 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.191076 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.191154 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.191295 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.191376 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.191542 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.191629 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.191777 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.191859 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.192016 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.192095 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.192249 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.192335 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.192483 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.192563 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.192730 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.192812 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.192963 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.193052 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.193195 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.193275 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.193448 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.193531 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.193695 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.193787 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.193942 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.194022 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.194193 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.194271 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.194434 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.194522 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.194667 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.194747 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.194927 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.195011 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.195164 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.195256 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.195402 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.195483 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.195639 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.195717 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.195873 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.195961 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.196111 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.196191 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.196342 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.196423 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.196581 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.196671 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.196828 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.196907 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.197060 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.197138 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.197304 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.197391 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.197570 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.197654 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.197811 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.197934 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.198059 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.198181 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.198307 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.198526 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.198605 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.198766 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.198908 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.199023 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.199104 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.199265 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.199344 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.199505 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.199598 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.199747 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.199826 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.199987 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.200069 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.200227 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.200318 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.200466 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.200544 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.200701 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.200785 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.200934 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.201024 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.201166 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.201247 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.201418 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.201497 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.201655 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.201741 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.201893 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.201972 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.202124 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] ldap.user = None {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.202203 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.202359 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.202449 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.202591 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.user = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.202681 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.202832 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.202988 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.203104 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.203193 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.203341 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.203420 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.203587 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.203669 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.203825 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.203917 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.204057 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.204139 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.204291 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.204371 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.204520 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.204607 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.204756 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.204836 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.204987 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.205067 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.205221 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.205308 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.205453 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.205534 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.205700 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.205783 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.205946 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.206032 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.206189 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.206270 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.206421 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.206503 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.206671 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.206762 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.206927 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.207012 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.207168 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.207251 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.207407 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.207499 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.207644 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.207724 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.207879 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.207958 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.208118 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.208206 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.208358 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.208478 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.208605 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.208685 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.208835 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.208922 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.209083 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.209164 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.209314 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.209392 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.209548 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.209635 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.210049 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.210131 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.210288 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.210440 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.210520 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.210688 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.210917 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.211000 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.211165 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.211246 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.211401 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.211499 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] resource.caching = True {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.211644 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.211724 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.211889 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] resource.caching = True {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.211969 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.212127 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.212214 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.212380 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.212460 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.212618 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.212696 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.212860 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.212947 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.213108 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.213692 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.213904 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.214032 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.214219 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.214300 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.214374 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] role.caching = True {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.214561 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.214642 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] role.driver = sql {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.214812 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.214936 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.215078 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] role.caching = True {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.215160 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.215330 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] role.driver = sql {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.215411 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.215567 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.215655 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.215820 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.215900 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.216069 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.216148 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.216316 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.216454 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.216552 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.216634 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.216802 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.216886 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.217036 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.217126 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.217289 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.217417 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.217544 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.217654 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.217776 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.217911 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.218032 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.218149 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.218267 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.218435 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.218623 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.218758 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.218897 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.219013 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.219139 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.219252 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.219372 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.219516 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.219643 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.219773 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.219901 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.220031 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.220168 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.220300 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.220419 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.220538 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.220659 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.220782 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.220921 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.221048 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.221176 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.221296 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.221418 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.221542 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.221677 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.221795 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.221884 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.221958 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.222030 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.222102 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.222183 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.222258 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.222383 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.222465 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.222631 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.222711 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.222887 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.222972 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] token.caching = True {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.223131 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.223211 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.223365 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.223444 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.223602 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] token.caching = True {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.223684 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.223845 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.223925 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.224095 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.224164 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.224332 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.224413 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.224582 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.224676 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.224825 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.224905 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.225065 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.225147 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.225302 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.225381 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.225545 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.225625 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.225784 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.225865 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.226020 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.226119 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.226264 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.226383 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.226515 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.226634 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.226778 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.226952 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.227072 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.227190 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.227281 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.227419 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] database.connection = **** {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.227550 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.227681 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.227799 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.227908 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.228020 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.228142 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] database.connection = **** {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.228231 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.228316 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.228433 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.228515 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.228672 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.228754 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.229488 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.229660 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.229753 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.229880 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.229971 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.230123 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.230198 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.230365 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.230487 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.230605 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.230692 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.230871 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.230956 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.231114 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.231206 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.231362 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.231452 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.231592 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.231680 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.231835 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.231925 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.232070 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.232159 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.232236 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 12:14:31.232309 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.232535 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.232775 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.233011 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:14:31.233180 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 12:14:31.263170 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81495) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:14:31.263409 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81495) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:14:31.263605 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81495) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:14:31.264116 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81496) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:14:31.264352 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81496) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:14:31.264573 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81496) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:14:31.272307 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81495) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:14:31.273173 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81496) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:14:31.302791 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81496) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:14:31.303032 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81496) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:14:31.303327 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81495) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:14:31.303561 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81495) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:14:31.359906 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81496) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:14:31.360636 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81495) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:14:31.410373 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81496) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:14:31.410611 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81496) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:14:31.410763 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81495) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:14:31.411022 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81495) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:14:31.572052 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81495) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:14:31.572355 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81496) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:14:31.573040 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81495) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:14:31.573213 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81496) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:14:31.573350 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81495) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:14:31.573503 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81496) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:14:31.573657 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81495) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:14:31.573802 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81496) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:14:31.573958 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81495) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:14:31.574130 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81496) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:14:31.574260 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81495) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:14:31.574388 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81496) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:14:31.597937 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81496) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:14:31.598262 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81495) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:14:31.598437 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81496) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:14:31.598612 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81495) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:14:31.598774 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81496) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:14:31.598986 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81495) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:14:31.599163 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81496) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:14:31.599341 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81495) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:14:31.599496 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81496) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:14:31.599646 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81495) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:14:31.599811 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81496) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:14:31.600021 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81495) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:14:31.600207 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81496) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:14:31.600372 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81495) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:14:31.610698 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81495) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:14:31.610919 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81496) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:14:31.623706 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81495) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:14:31.623941 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81496) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:14:31.624083 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81495) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:14:31.624213 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81496) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:14:31.624343 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81495) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:14:31.624523 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81496) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:14:31.624669 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81495) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:14:31.624803 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81496) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:14:31.624930 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81495) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:14:31.625056 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81496) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:14:31.625210 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81495) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:14:31.625350 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81496) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:14:31.625480 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81495) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:14:31.625607 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81496) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:14:31.642820 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.643088 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 31 12:14:31.643244 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.643381 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.643511 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 31 12:14:31.643640 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 31 12:14:31.643767 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.643908 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.644046 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 31 12:14:31.644180 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.644308 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.644440 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.644599 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.644740 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.644867 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.644999 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.655169 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.655328 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.655458 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.655627 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.655762 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.655895 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.656025 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.656157 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.663025 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81495) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:14:31.663173 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81496) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:14:31.665939 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81495) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:14:31.666077 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81496) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:14:31.666230 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.666378 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.666538 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.666624 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.666918 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.667149 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.667317 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.667401 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.667476 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.667551 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.667693 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.667778 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.667966 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.668103 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.668235 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.668367 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.668496 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.668636 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.668765 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.668891 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.692153 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.692712 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.693658 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81496) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:14:31.693950 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.694226 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81495) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:14:31.694515 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.699138 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81496) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:14:31.699425 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.699713 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.699867 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81495) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:14:31.700018 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.700287 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.706273 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81496) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:14:31.706561 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.706812 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81495) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:14:31.707126 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.710867 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81496) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:14:31.711159 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.711389 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81495) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:14:31.711531 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.711690 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.711820 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.711979 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.712108 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.712296 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.712554 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.714762 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.715086 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.715380 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.715526 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.715808 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.716102 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.731168 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.731455 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.731826 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.732112 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.735330 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81496) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:14:31.736013 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81495) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:14:31.738434 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.738736 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.739174 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.739472 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.743074 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81496) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:14:31.743858 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81495) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:14:31.746448 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81496) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:14:31.747091 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81495) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:14:31.749549 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.749855 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.750146 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.750276 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.750447 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.750581 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.750737 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.750892 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.751058 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.751206 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.751341 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.751709 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.767862 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81496) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:14:31.768164 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.768311 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81495) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:14:31.768450 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.768626 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.768767 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.768901 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.769035 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.775518 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.776498 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.777789 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.778169 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.779372 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.779655 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.779739 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.780018 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.782328 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81496) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:14:31.782614 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.782699 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81495) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:14:31.782925 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.783013 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.783225 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.783309 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.783524 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.783611 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.783828 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.795633 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81496) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:14:31.795864 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81495) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:14:31.795969 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.796163 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.796247 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.796450 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.796544 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.796735 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.796821 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.797019 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.797110 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.797298 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.797381 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.797590 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.813568 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81496) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:14:31.813903 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81495) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:14:31.816664 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81496) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:14:31.816982 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81495) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:14:31.819611 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.819894 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.821061 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.821332 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.822730 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81496) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:14:31.822835 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81495) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:14:31.823109 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.823218 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.823443 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.823563 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.830024 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.830156 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.831524 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81495) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:14:31.831614 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81496) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:14:31.834433 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.834526 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.834995 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.835090 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.835279 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.835365 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.835558 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.835654 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.843589 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81495) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:14:31.843879 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.844002 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81496) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:14:31.844160 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.844296 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.844584 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.851144 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81495) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:14:31.851427 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.851604 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81496) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:14:31.851709 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.851893 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.851979 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.852181 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.852263 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.852462 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.852558 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.852739 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.852824 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.853014 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.853116 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.853298 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.853385 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.853565 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.853649 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.854388 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.854496 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.854627 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.854876 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.854971 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.855188 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.855300 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.855432 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.855699 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.855983 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:14:31.889972 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5646e1f2d9c0 pid: 81495 (default app) Aug 31 12:14:31.891010 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5646e1f2d9c0 pid: 81496 (default app) Aug 31 12:14:31.893438 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9953fb1-a5d2-418d-b696-b3af941e05a7 None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:14:31.893725 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9953fb1-a5d2-418d-b696-b3af941e05a7 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:14:31.894000 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9953fb1-a5d2-418d-b696-b3af941e05a7 None None] PATH_INFO: `/v3` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:14:31.898166 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1/1] 10.222.0.79 () {50 vars in 791 bytes} [Wed Aug 31 12:14:31 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:14:38.954326 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38bf138-3e4f-4473-b258-19dd35d731ab None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:14:38.954966 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38bf138-3e4f-4473-b258-19dd35d731ab None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:14:38.954966 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38bf138-3e4f-4473-b258-19dd35d731ab None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:14:38.959174 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1/2] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:14:38 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:14:38.965699 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f611685a-63c5-4ead-9c13-6d0211775159 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:14:38.966306 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f611685a-63c5-4ead-9c13-6d0211775159 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:14:38.966306 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f611685a-63c5-4ead-9c13-6d0211775159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:14:39.038390 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: INFO dbcounter [None req-f611685a-63c5-4ead-9c13-6d0211775159 None None] Registered counter for database keystone Aug 31 12:14:39.059149 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG oslo_db.sqlalchemy.engines [None req-f611685a-63c5-4ead-9c13-6d0211775159 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81495) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 12:14:39.065664 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writer thread running {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 12:14:39.259273 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG passlib.handlers.bcrypt [None req-f611685a-63c5-4ead-9c13-6d0211775159 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81495) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 31 12:14:39.259571 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG passlib.handlers.bcrypt [None req-f611685a-63c5-4ead-9c13-6d0211775159 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81495) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 31 12:14:39.323454 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-f611685a-63c5-4ead-9c13-6d0211775159 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:14:39.325216 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-f611685a-63c5-4ead-9c13-6d0211775159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:14:39.481650 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 2/3] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:14:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 517 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 31 12:14:39.783515 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38bf138-3e4f-4473-b258-19dd35d731ab None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:14:39.854382 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: INFO dbcounter [None req-c38bf138-3e4f-4473-b258-19dd35d731ab None None] Registered counter for database keystone Aug 31 12:14:39.876221 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG oslo_db.sqlalchemy.engines [None req-c38bf138-3e4f-4473-b258-19dd35d731ab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81496) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 12:14:39.882985 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writer thread running {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 12:14:40.000950 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38bf138-3e4f-4473-b258-19dd35d731ab None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:14:40.005229 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44709857-c944-4bab-92fa-392a615d73ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:14:40.005852 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44709857-c944-4bab-92fa-392a615d73ba admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:14:40.006129 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44709857-c944-4bab-92fa-392a615d73ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:14:40.006396 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44709857-c944-4bab-92fa-392a615d73ba admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:14:40.015375 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44709857-c944-4bab-92fa-392a615d73ba admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:14:40.067695 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: WARNING keystone.common.rbac_enforcer.enforcer [None req-44709857-c944-4bab-92fa-392a615d73ba admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 31 12:14:40.067948 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44709857-c944-4bab-92fa-392a615d73ba admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:14:40.078692 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 2/4] 10.222.0.79 () {58 vars in 1324 bytes} [Wed Aug 31 12:14:39 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 31 12:14:40.085119 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f611685a-63c5-4ead-9c13-6d0211775159 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:14:40.100363 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f611685a-63c5-4ead-9c13-6d0211775159 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:14:40.105012 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ec5b44-de6d-4b1a-8f18-e89141001c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:14:40.106117 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec5b44-de6d-4b1a-8f18-e89141001c1e admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:14:40.106398 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec5b44-de6d-4b1a-8f18-e89141001c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:14:40.106669 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec5b44-de6d-4b1a-8f18-e89141001c1e admin admin] PATH_INFO: `/v3/projects/088123e0cad144f3a713fb6c4c75d880` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:14:40.108284 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ec5b44-de6d-4b1a-8f18-e89141001c1e admin admin] RBAC: Authorizing `identity:get_project(project_id=088123e0cad144f3a713fb6c4c75d880)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:14:40.162456 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: WARNING keystone.common.rbac_enforcer.enforcer [None req-66ec5b44-de6d-4b1a-8f18-e89141001c1e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 31 12:14:40.162802 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ec5b44-de6d-4b1a-8f18-e89141001c1e admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:14:40.167832 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 3/5] 10.222.0.79 () {56 vars in 1207 bytes} [Wed Aug 31 12:14:40 2022] GET /identity/v3/projects/088123e0cad144f3a713fb6c4c75d880 => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:14:42.087707 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d8a74f-f44b-4390-9243-b9425f8803d1 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:14:42.088996 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d8a74f-f44b-4390-9243-b9425f8803d1 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:14:42.088996 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d8a74f-f44b-4390-9243-b9425f8803d1 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:14:42.093113 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 3/6] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:14:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:14:42.098892 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254621a8-cd2f-44ea-b260-02d479649965 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:14:42.099405 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254621a8-cd2f-44ea-b260-02d479649965 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:14:42.099500 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254621a8-cd2f-44ea-b260-02d479649965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:14:42.120729 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-254621a8-cd2f-44ea-b260-02d479649965 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:14:42.122281 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-254621a8-cd2f-44ea-b260-02d479649965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:14:42.130879 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 4/7] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:14:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 31 12:14:42.410909 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d8a74f-f44b-4390-9243-b9425f8803d1 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:14:42.423356 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d8a74f-f44b-4390-9243-b9425f8803d1 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:14:42.427501 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a1190e-4668-467c-a7ec-a828093215ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:14:42.428098 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a1190e-4668-467c-a7ec-a828093215ff admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:14:42.428377 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a1190e-4668-467c-a7ec-a828093215ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:14:42.428646 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a1190e-4668-467c-a7ec-a828093215ff admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:14:42.437068 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a1190e-4668-467c-a7ec-a828093215ff admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:14:42.438866 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a1190e-4668-467c-a7ec-a828093215ff admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:14:42.448841 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 4/8] 10.222.0.79 () {58 vars in 1324 bytes} [Wed Aug 31 12:14:42 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 12:14:42.454514 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254621a8-cd2f-44ea-b260-02d479649965 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:14:42.464656 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254621a8-cd2f-44ea-b260-02d479649965 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:14:42.469024 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c39721-e435-4ee2-96ba-b9af00af29d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:14:42.469661 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c39721-e435-4ee2-96ba-b9af00af29d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:14:42.469944 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c39721-e435-4ee2-96ba-b9af00af29d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:14:42.470219 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c39721-e435-4ee2-96ba-b9af00af29d4 admin admin] PATH_INFO: `/v3/users/ba867dda5cc7471abb8f3da6ca94b58a` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:14:42.471652 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c39721-e435-4ee2-96ba-b9af00af29d4 admin admin] RBAC: Authorizing `identity:get_user(user_id=ba867dda5cc7471abb8f3da6ca94b58a)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:14:42.473500 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c39721-e435-4ee2-96ba-b9af00af29d4 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:14:42.475079 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 5/9] 10.222.0.79 () {56 vars in 1198 bytes} [Wed Aug 31 12:14:42 2022] GET /identity/v3/users/ba867dda5cc7471abb8f3da6ca94b58a => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:14:44.453202 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f27a4-ea09-4499-af17-246cc78214fd None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:14:44.453669 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f27a4-ea09-4499-af17-246cc78214fd None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:14:44.453755 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f27a4-ea09-4499-af17-246cc78214fd None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:14:44.455162 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 5/10] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:14:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:14:44.460626 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e7fb9-c38c-47c2-b3cc-b086d99e339e None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:14:44.461067 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e7fb9-c38c-47c2-b3cc-b086d99e339e None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:14:44.461166 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e7fb9-c38c-47c2-b3cc-b086d99e339e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:14:44.479796 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-103e7fb9-c38c-47c2-b3cc-b086d99e339e None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:14:44.480973 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-103e7fb9-c38c-47c2-b3cc-b086d99e339e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:14:44.551997 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06590d69-6351-40dc-8cb7-a798ca58f794 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:14:44.552293 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06590d69-6351-40dc-8cb7-a798ca58f794 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:14:44.552576 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06590d69-6351-40dc-8cb7-a798ca58f794 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:14:44.553913 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 6/11] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:14:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:14:44.560472 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3133d81-2972-40f2-8842-3ab861f4337f None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:14:44.560840 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3133d81-2972-40f2-8842-3ab861f4337f None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:14:44.561190 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3133d81-2972-40f2-8842-3ab861f4337f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:14:44.564390 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 6/12] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:14:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:14:44.605102 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG passlib.handlers.bcrypt [None req-a3133d81-2972-40f2-8842-3ab861f4337f None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81496) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 31 12:14:44.605487 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG passlib.handlers.bcrypt [None req-a3133d81-2972-40f2-8842-3ab861f4337f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81496) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 31 12:14:44.656120 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-a3133d81-2972-40f2-8842-3ab861f4337f None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:14:44.657785 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-a3133d81-2972-40f2-8842-3ab861f4337f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:14:44.770988 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 7/13] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:14:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 12:14:44.829787 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103e7fb9-c38c-47c2-b3cc-b086d99e339e None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:14:44.858360 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:14:44.943730 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103e7fb9-c38c-47c2-b3cc-b086d99e339e None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:14:44.983715 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e2da41-669c-4e25-a25b-63f6601db47a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:14:44.984390 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e2da41-669c-4e25-a25b-63f6601db47a None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:14:44.984668 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e2da41-669c-4e25-a25b-63f6601db47a None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:14:44.984940 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e2da41-669c-4e25-a25b-63f6601db47a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:14:44.998924 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e2da41-669c-4e25-a25b-63f6601db47a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:14:45.008232 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-50e2da41-669c-4e25-a25b-63f6601db47a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:14:45.008232 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:14:45.008232 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:14:45.008232 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:14:45.008232 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:14:45.008232 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:14:45.008232 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:14:45.008232 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:14:45.008232 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:14:45.008232 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:14:45.008232 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:14:45.008232 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:14:45.008232 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:14:45.008232 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:14:45.008232 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:14:45.008232 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:14:45.009212 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:14:45.009212 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:14:45.009212 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:14:45.009212 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:14:45.009212 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:14:45.009212 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:14:45.009212 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:14:45.009212 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:14:45.009212 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:14:45.009212 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:14:45.009212 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:14:45.009212 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:14:45.009212 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:14:45.009212 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:14:45.009212 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:14:45.009212 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:14:45.010772 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:14:45.010772 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:14:45.010772 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:14:45.010772 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:14:45.010772 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:14:45.010772 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:14:45.010772 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:14:45.010772 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:14:45.010772 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:14:45.010772 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:14:45.010772 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:14:45.010772 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:14:45.010772 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 7/14] 10.222.0.79 () {56 vars in 1096 bytes} [Wed Aug 31 12:14:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:14:45.016494 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3133d81-2972-40f2-8842-3ab861f4337f None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:14:45.051357 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e2da41-669c-4e25-a25b-63f6601db47a None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:14:45.127759 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3133d81-2972-40f2-8842-3ab861f4337f None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:14:45.130208 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:14:45.142247 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:14:45.162363 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e2da41-669c-4e25-a25b-63f6601db47a None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:14:45.171909 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711aecd1-b75d-4f78-8fc3-de005b9f4a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:14:45.172785 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711aecd1-b75d-4f78-8fc3-de005b9f4a3e None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:14:45.173240 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711aecd1-b75d-4f78-8fc3-de005b9f4a3e None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:14:45.173514 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711aecd1-b75d-4f78-8fc3-de005b9f4a3e None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:14:45.174360 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711aecd1-b75d-4f78-8fc3-de005b9f4a3e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:14:45.174675 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711aecd1-b75d-4f78-8fc3-de005b9f4a3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:14:45.176171 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711aecd1-b75d-4f78-8fc3-de005b9f4a3e None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:14:45.188994 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 8/15] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 12:14:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:14:45.195987 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711aecd1-b75d-4f78-8fc3-de005b9f4a3e None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:14:45.202545 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f57fb3a-0221-49ce-a3d2-50cfb9a5c38f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:14:45.203212 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f57fb3a-0221-49ce-a3d2-50cfb9a5c38f None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:14:45.203496 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f57fb3a-0221-49ce-a3d2-50cfb9a5c38f None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:14:45.203763 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f57fb3a-0221-49ce-a3d2-50cfb9a5c38f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:14:45.280352 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f57fb3a-0221-49ce-a3d2-50cfb9a5c38f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:14:45.282015 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f57fb3a-0221-49ce-a3d2-50cfb9a5c38f None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:14:45.312813 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711aecd1-b75d-4f78-8fc3-de005b9f4a3e None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:14:45.349929 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5a99d6-f377-4bc5-80bf-3cea73efbdae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:14:45.350809 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a99d6-f377-4bc5-80bf-3cea73efbdae None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:14:45.351124 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a99d6-f377-4bc5-80bf-3cea73efbdae None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:14:45.351417 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a99d6-f377-4bc5-80bf-3cea73efbdae None admin] PATH_INFO: `/v3/users/ba867dda5cc7471abb8f3da6ca94b58a` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:14:45.352977 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5a99d6-f377-4bc5-80bf-3cea73efbdae None admin] RBAC: Authorizing `identity:get_user(user_id=ba867dda5cc7471abb8f3da6ca94b58a)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:14:45.354548 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5a99d6-f377-4bc5-80bf-3cea73efbdae None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:14:45.356229 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 9/16] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 12:14:45 2022] GET /identity/v3/users/ba867dda5cc7471abb8f3da6ca94b58a => generated 247 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:14:45.361888 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5a99d6-f377-4bc5-80bf-3cea73efbdae None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:14:45.375598 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:14:45.398025 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 8/17] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 12:14:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 12:14:45.403603 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:14:45.404556 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f57fb3a-0221-49ce-a3d2-50cfb9a5c38f None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:14:45.485238 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5a99d6-f377-4bc5-80bf-3cea73efbdae None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:14:45.523406 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8300f9d-16d4-4ebd-8cbe-b33c5ee651a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:14:45.524054 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8300f9d-16d4-4ebd-8cbe-b33c5ee651a2 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:14:45.524338 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8300f9d-16d4-4ebd-8cbe-b33c5ee651a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:14:45.524614 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8300f9d-16d4-4ebd-8cbe-b33c5ee651a2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:14:45.527692 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8300f9d-16d4-4ebd-8cbe-b33c5ee651a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:14:45.527963 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8300f9d-16d4-4ebd-8cbe-b33c5ee651a2 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:14:45.529514 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f57fb3a-0221-49ce-a3d2-50cfb9a5c38f None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:14:45.529976 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 10/18] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:14:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:14:45.535393 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8300f9d-16d4-4ebd-8cbe-b33c5ee651a2 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:14:45.567546 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29629384-51d7-4792-b226-9a0ae30cf205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:14:45.568109 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29629384-51d7-4792-b226-9a0ae30cf205 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:14:45.568397 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29629384-51d7-4792-b226-9a0ae30cf205 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:14:45.568698 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29629384-51d7-4792-b226-9a0ae30cf205 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:14:45.579368 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29629384-51d7-4792-b226-9a0ae30cf205 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:14:45.580852 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29629384-51d7-4792-b226-9a0ae30cf205 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:14:45.597755 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-29629384-51d7-4792-b226-9a0ae30cf205 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:14:45.597755 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:14:45.597755 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:14:45.597755 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:14:45.597755 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:14:45.597755 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:14:45.597755 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:14:45.597755 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:14:45.597755 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:14:45.597755 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:14:45.597755 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:14:45.597755 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:14:45.597755 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:14:45.597755 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:14:45.597755 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:14:45.597755 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:14:45.598750 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:14:45.598750 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:14:45.598750 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:14:45.598750 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:14:45.598750 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:14:45.598750 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:14:45.598750 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:14:45.598750 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:14:45.598750 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:14:45.598750 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:14:45.598750 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:14:45.598750 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:14:45.598750 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:14:45.598750 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:14:45.598750 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:14:45.598750 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:14:45.598750 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:14:45.599628 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:14:45.599628 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:14:45.599628 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:14:45.599628 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 9/19] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:14:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:14:45.605599 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29629384-51d7-4792-b226-9a0ae30cf205 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:14:45.645140 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:14:45.650227 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8300f9d-16d4-4ebd-8cbe-b33c5ee651a2 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:14:45.653119 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:14:45.688989 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff89ecdf-7040-4417-b38c-20295f513dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:14:45.689900 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff89ecdf-7040-4417-b38c-20295f513dfd None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:14:45.689900 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff89ecdf-7040-4417-b38c-20295f513dfd None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:14:45.690130 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff89ecdf-7040-4417-b38c-20295f513dfd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:14:45.690881 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff89ecdf-7040-4417-b38c-20295f513dfd None admin] RBAC: Adding query filter params (role.id=a332ef951db949b0bad7019fbd28a1b9, scope.domain.id=default, user.id=ba867dda5cc7471abb8f3da6ca94b58a) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:14:45.691199 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff89ecdf-7040-4417-b38c-20295f513dfd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:14:45.692657 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff89ecdf-7040-4417-b38c-20295f513dfd None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:14:45.703737 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 11/20] 10.222.0.79 () {56 vars in 1322 bytes} [Wed Aug 31 12:14:45 2022] GET /identity/v3/role_assignments?user.id=ba867dda5cc7471abb8f3da6ca94b58a&scope.domain.id=default&role.id=a332ef951db949b0bad7019fbd28a1b9 => generated 233 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:14:45.725479 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29629384-51d7-4792-b226-9a0ae30cf205 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:14:45.763815 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d99275-264a-4778-8ba6-5d4d97c53915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:14:45.764460 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d99275-264a-4778-8ba6-5d4d97c53915 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:14:45.764736 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d99275-264a-4778-8ba6-5d4d97c53915 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:14:45.765004 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d99275-264a-4778-8ba6-5d4d97c53915 None admin] PATH_INFO: `/v3/domains` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:14:45.765678 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d99275-264a-4778-8ba6-5d4d97c53915 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:14:45.765976 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d99275-264a-4778-8ba6-5d4d97c53915 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:14:45.767456 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d99275-264a-4778-8ba6-5d4d97c53915 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:14:45.789285 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 10/21] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 12:14:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:14:48.742946 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc34348-d661-460d-931b-ccd73077aa11 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:14:48.745009 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc34348-d661-460d-931b-ccd73077aa11 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:14:48.745782 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc34348-d661-460d-931b-ccd73077aa11 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:14:48.748508 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 12/22] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:14:48 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:14:48.756877 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cb6ad3-9aaa-48ad-96af-d459427f4a8e None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:14:48.758365 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cb6ad3-9aaa-48ad-96af-d459427f4a8e None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:14:48.759191 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cb6ad3-9aaa-48ad-96af-d459427f4a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:14:48.799109 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4901cf-bf4d-4559-8456-fe9a0dee4cae None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:14:48.800062 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4901cf-bf4d-4559-8456-fe9a0dee4cae None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:14:48.801111 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4901cf-bf4d-4559-8456-fe9a0dee4cae None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:14:48.803895 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 13/23] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:14:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:14:48.813498 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b51f3c1-1cb5-45c1-8553-5a49ee91a130 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:14:48.814345 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b51f3c1-1cb5-45c1-8553-5a49ee91a130 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:14:48.815124 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b51f3c1-1cb5-45c1-8553-5a49ee91a130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:14:48.816539 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-71cb6ad3-9aaa-48ad-96af-d459427f4a8e None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:14:48.818521 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-71cb6ad3-9aaa-48ad-96af-d459427f4a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:14:48.885167 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-6b51f3c1-1cb5-45c1-8553-5a49ee91a130 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:14:48.888810 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-6b51f3c1-1cb5-45c1-8553-5a49ee91a130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:14:49.030200 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 11/24] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:14:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:14:49.065940 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaff485-fa65-4b39-8144-d51a1b209d68 None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:14:49.066426 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaff485-fa65-4b39-8144-d51a1b209d68 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:14:49.067037 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaff485-fa65-4b39-8144-d51a1b209d68 None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:14:49.069648 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 12/25] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:14:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:14:49.080224 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 14/26] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:14:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 12:14:49.085651 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c518a93-8f45-4baa-9363-b3684b993bbe None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:14:49.086133 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c518a93-8f45-4baa-9363-b3684b993bbe None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:14:49.086593 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c518a93-8f45-4baa-9363-b3684b993bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:14:49.136243 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-1c518a93-8f45-4baa-9363-b3684b993bbe None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:14:49.137895 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-1c518a93-8f45-4baa-9363-b3684b993bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:14:49.171806 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:14:49.260654 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 13/27] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:14:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:14:49.475594 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b51f3c1-1cb5-45c1-8553-5a49ee91a130 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:14:49.623481 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:14:49.629800 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b51f3c1-1cb5-45c1-8553-5a49ee91a130 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:14:49.676969 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1a0c3b-eed6-4511-a380-31b51381af47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:14:49.677699 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a0c3b-eed6-4511-a380-31b51381af47 None admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:14:49.677975 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a0c3b-eed6-4511-a380-31b51381af47 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:14:49.678241 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a0c3b-eed6-4511-a380-31b51381af47 None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:14:49.678971 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1a0c3b-eed6-4511-a380-31b51381af47 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:14:49.680421 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1a0c3b-eed6-4511-a380-31b51381af47 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:14:49.754742 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c518a93-8f45-4baa-9363-b3684b993bbe None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:14:49.832157 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 15/28] 10.222.0.79 () {60 vars in 1131 bytes} [Wed Aug 31 12:14:49 2022] POST /identity/v3/roles => generated 219 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:14:49.837312 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808d4df4-0bcd-4372-a0c3-b61f4ac39f9f None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:14:49.838314 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808d4df4-0bcd-4372-a0c3-b61f4ac39f9f None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:14:49.839075 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808d4df4-0bcd-4372-a0c3-b61f4ac39f9f None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:14:49.841642 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 16/29] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:14:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:14:49.852254 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201cf63d-f498-4c47-84c8-782b2dd5b68c None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:14:49.854262 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201cf63d-f498-4c47-84c8-782b2dd5b68c None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:14:49.855385 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201cf63d-f498-4c47-84c8-782b2dd5b68c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:14:49.936225 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-201cf63d-f498-4c47-84c8-782b2dd5b68c None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:14:49.937831 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-201cf63d-f498-4c47-84c8-782b2dd5b68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:14:50.099032 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 17/30] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:14:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:14:50.101024 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201cf63d-f498-4c47-84c8-782b2dd5b68c None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:14:50.101867 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c518a93-8f45-4baa-9363-b3684b993bbe None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:14:50.176778 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582ce59a-914e-4d7b-aed4-b418282cfeea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:14:50.178168 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ce59a-914e-4d7b-aed4-b418282cfeea None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:14:50.178900 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ce59a-914e-4d7b-aed4-b418282cfeea None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:14:50.179776 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ce59a-914e-4d7b-aed4-b418282cfeea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:14:50.201373 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582ce59a-914e-4d7b-aed4-b418282cfeea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:14:50.215439 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-582ce59a-914e-4d7b-aed4-b418282cfeea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:14:50.215439 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:14:50.215439 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:14:50.215439 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:14:50.215439 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:14:50.215439 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:14:50.215439 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:14:50.215439 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:14:50.215439 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:14:50.215439 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:14:50.215439 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:14:50.215439 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:14:50.215439 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:14:50.215439 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:14:50.215439 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:14:50.215439 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:14:50.216610 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:14:50.216610 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:14:50.216610 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:14:50.216610 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:14:50.216610 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:14:50.216610 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:14:50.216610 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:14:50.216610 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:14:50.216610 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:14:50.216610 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:14:50.216610 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:14:50.216610 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:14:50.216610 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:14:50.216610 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:14:50.216610 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:14:50.216610 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:14:50.217526 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:14:50.217526 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:14:50.217526 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:14:50.217526 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:14:50.217526 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:14:50.217526 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:14:50.217526 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:14:50.217526 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:14:50.217526 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:14:50.217526 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:14:50.217526 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:14:50.217526 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:14:50.221358 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 14/31] 10.222.0.79 () {56 vars in 1096 bytes} [Wed Aug 31 12:14:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 467 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:14:50.229714 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582ce59a-914e-4d7b-aed4-b418282cfeea None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:14:50.283596 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:14:50.327227 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:14:50.351629 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201cf63d-f498-4c47-84c8-782b2dd5b68c None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:14:50.399929 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e5f4b-413d-4f59-b282-400fe7729728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:14:50.401007 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e5f4b-413d-4f59-b282-400fe7729728 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:14:50.401295 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e5f4b-413d-4f59-b282-400fe7729728 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:14:50.401619 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e5f4b-413d-4f59-b282-400fe7729728 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:14:50.426598 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2e5f4b-413d-4f59-b282-400fe7729728 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:14:50.428317 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2e5f4b-413d-4f59-b282-400fe7729728 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:14:50.453605 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-6f2e5f4b-413d-4f59-b282-400fe7729728 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:14:50.453605 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:14:50.453605 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:14:50.453605 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:14:50.453605 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:14:50.453605 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:14:50.453605 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:14:50.453605 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:14:50.453605 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:14:50.453605 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:14:50.453605 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:14:50.453605 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:14:50.453605 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:14:50.453605 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:14:50.453605 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:14:50.453605 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:14:50.454534 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:14:50.454534 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:14:50.454534 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:14:50.454534 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:14:50.454534 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:14:50.454534 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:14:50.454534 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:14:50.454534 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:14:50.454534 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:14:50.454534 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:14:50.454534 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:14:50.454534 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:14:50.454534 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:14:50.454534 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:14:50.454534 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:14:50.454534 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:14:50.454534 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:14:50.455365 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:14:50.455365 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:14:50.455365 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:14:50.456021 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 18/32] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:14:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:14:50.476942 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e5f4b-413d-4f59-b282-400fe7729728 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:14:50.569086 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582ce59a-914e-4d7b-aed4-b418282cfeea None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:14:50.611216 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e5f4b-413d-4f59-b282-400fe7729728 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:14:50.638925 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6f5b2c-8c58-4f2a-abe5-c7c3ee37d97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:14:50.639570 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6f5b2c-8c58-4f2a-abe5-c7c3ee37d97b None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:14:50.639852 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6f5b2c-8c58-4f2a-abe5-c7c3ee37d97b None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:14:50.640124 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6f5b2c-8c58-4f2a-abe5-c7c3ee37d97b None admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:14:50.640822 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6f5b2c-8c58-4f2a-abe5-c7c3ee37d97b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:14:50.641127 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6f5b2c-8c58-4f2a-abe5-c7c3ee37d97b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:14:50.642553 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6f5b2c-8c58-4f2a-abe5-c7c3ee37d97b None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:14:50.659010 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 15/33] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 12:14:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 431 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:14:50.660312 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a12961b-6bf8-40aa-8587-7478c6c3f2ab None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:14:50.660603 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a12961b-6bf8-40aa-8587-7478c6c3f2ab None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:14:50.660886 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a12961b-6bf8-40aa-8587-7478c6c3f2ab None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:14:50.662349 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 16/34] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:14:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:14:50.662916 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a12961b-6bf8-40aa-8587-7478c6c3f2ab None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:14:50.664797 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d56024-08b4-40f0-bdfd-461802d325ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:14:50.665439 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d56024-08b4-40f0-bdfd-461802d325ce None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:14:50.665724 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d56024-08b4-40f0-bdfd-461802d325ce None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:14:50.667247 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d56024-08b4-40f0-bdfd-461802d325ce None admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:14:50.668041 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d56024-08b4-40f0-bdfd-461802d325ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:14:50.668408 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d56024-08b4-40f0-bdfd-461802d325ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:14:50.670085 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d56024-08b4-40f0-bdfd-461802d325ce None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:14:50.683464 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:14:50.696550 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 19/35] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 12:14:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:14:50.698743 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d56024-08b4-40f0-bdfd-461802d325ce None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:14:50.774796 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:14:50.820319 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a12961b-6bf8-40aa-8587-7478c6c3f2ab None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:14:50.858259 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d56024-08b4-40f0-bdfd-461802d325ce None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:14:50.859140 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42883f84-8606-4d49-8a05-1681c535105a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:14:50.859438 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42883f84-8606-4d49-8a05-1681c535105a None admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:14:50.859718 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42883f84-8606-4d49-8a05-1681c535105a None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:14:50.859992 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42883f84-8606-4d49-8a05-1681c535105a None admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:14:50.860671 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42883f84-8606-4d49-8a05-1681c535105a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:14:50.862228 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42883f84-8606-4d49-8a05-1681c535105a None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:14:50.923349 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8def0b75-690c-4e24-b239-a1415fcaae65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:14:50.924469 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def0b75-690c-4e24-b239-a1415fcaae65 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:14:50.924924 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def0b75-690c-4e24-b239-a1415fcaae65 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:14:50.925423 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def0b75-690c-4e24-b239-a1415fcaae65 None admin] PATH_INFO: `/v3/users/ba867dda5cc7471abb8f3da6ca94b58a` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:14:50.927592 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8def0b75-690c-4e24-b239-a1415fcaae65 None admin] RBAC: Authorizing `identity:get_user(user_id=ba867dda5cc7471abb8f3da6ca94b58a)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:14:50.930464 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8def0b75-690c-4e24-b239-a1415fcaae65 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:14:50.942931 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 20/36] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 12:14:50 2022] GET /identity/v3/users/ba867dda5cc7471abb8f3da6ca94b58a => generated 247 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:14:50.942931 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7632cd-1dad-46ad-b5a6-fd27c9aa0500 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:14:50.942931 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7632cd-1dad-46ad-b5a6-fd27c9aa0500 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:14:50.942931 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7632cd-1dad-46ad-b5a6-fd27c9aa0500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:14:50.972473 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-af7632cd-1dad-46ad-b5a6-fd27c9aa0500 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:14:50.974443 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-af7632cd-1dad-46ad-b5a6-fd27c9aa0500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:14:50.986787 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 17/37] 10.222.0.79 () {60 vars in 1131 bytes} [Wed Aug 31 12:14:50 2022] POST /identity/v3/roles => generated 225 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:14:50.987837 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42883f84-8606-4d49-8a05-1681c535105a None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:14:51.068789 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:14:51.080958 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 21/38] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:14:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:14:51.081869 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7632cd-1dad-46ad-b5a6-fd27c9aa0500 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:14:51.188692 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42883f84-8606-4d49-8a05-1681c535105a None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:14:51.239323 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1b542f-fadd-482f-9e3a-6010b9b3d079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:14:51.239972 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b542f-fadd-482f-9e3a-6010b9b3d079 None admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:14:51.240255 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b542f-fadd-482f-9e3a-6010b9b3d079 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:14:51.240601 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b542f-fadd-482f-9e3a-6010b9b3d079 None admin] PATH_INFO: `/v3/projects` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:14:51.241294 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1b542f-fadd-482f-9e3a-6010b9b3d079 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:14:51.243125 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1b542f-fadd-482f-9e3a-6010b9b3d079 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:14:51.251299 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:14:51.299337 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 18/39] 10.222.0.79 () {60 vars in 1141 bytes} [Wed Aug 31 12:14:50 2022] POST /identity/v3/projects => generated 301 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:14:51.301872 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46744e4-295b-432f-af66-65bec526a184 None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:14:51.302386 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46744e4-295b-432f-af66-65bec526a184 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:14:51.303951 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46744e4-295b-432f-af66-65bec526a184 None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:14:51.305890 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 19/40] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:14:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:14:51.309803 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7632cd-1dad-46ad-b5a6-fd27c9aa0500 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:14:51.316695 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b32515-8938-4e6e-8fa7-219d077a3953 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:14:51.317200 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b32515-8938-4e6e-8fa7-219d077a3953 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:14:51.317721 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b32515-8938-4e6e-8fa7-219d077a3953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:14:51.352648 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-26b32515-8938-4e6e-8fa7-219d077a3953 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:14:51.355653 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-26b32515-8938-4e6e-8fa7-219d077a3953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:14:51.392874 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d30530c-14ac-42d2-adc0-4de5a0669414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:14:51.394396 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30530c-14ac-42d2-adc0-4de5a0669414 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:14:51.395998 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30530c-14ac-42d2-adc0-4de5a0669414 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:14:51.396791 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30530c-14ac-42d2-adc0-4de5a0669414 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:14:51.399819 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d30530c-14ac-42d2-adc0-4de5a0669414 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:14:51.404508 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d30530c-14ac-42d2-adc0-4de5a0669414 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:14:51.407805 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 22/41] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:14:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:14:51.409522 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d30530c-14ac-42d2-adc0-4de5a0669414 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:14:51.533861 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:14:51.592799 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 20/42] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:14:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:14:51.593672 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b32515-8938-4e6e-8fa7-219d077a3953 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:14:51.599491 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d30530c-14ac-42d2-adc0-4de5a0669414 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:14:51.680880 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3a68c5-c1fd-4c48-8222-2aedf58ae221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:14:51.683471 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3a68c5-c1fd-4c48-8222-2aedf58ae221 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:14:51.683922 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3a68c5-c1fd-4c48-8222-2aedf58ae221 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:14:51.684412 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3a68c5-c1fd-4c48-8222-2aedf58ae221 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:14:51.693653 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3a68c5-c1fd-4c48-8222-2aedf58ae221 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:14:51.696366 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3a68c5-c1fd-4c48-8222-2aedf58ae221 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:14:51.699824 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 23/43] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:14:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:14:51.706277 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3a68c5-c1fd-4c48-8222-2aedf58ae221 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:14:51.772665 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b32515-8938-4e6e-8fa7-219d077a3953 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:14:51.798215 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:14:51.824071 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cfa457-8bda-4ee9-b040-aa704c4487d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:14:51.825294 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cfa457-8bda-4ee9-b040-aa704c4487d7 None admin] REQUEST_METHOD: `PUT` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:14:51.825589 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cfa457-8bda-4ee9-b040-aa704c4487d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:14:51.826028 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cfa457-8bda-4ee9-b040-aa704c4487d7 None admin] PATH_INFO: `/v3/domains/default/users/ba867dda5cc7471abb8f3da6ca94b58a/roles/a332ef951db949b0bad7019fbd28a1b9` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:14:51.828923 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cfa457-8bda-4ee9-b040-aa704c4487d7 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=ba867dda5cc7471abb8f3da6ca94b58a, role_id=a332ef951db949b0bad7019fbd28a1b9)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:14:51.830481 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cfa457-8bda-4ee9-b040-aa704c4487d7 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:14:51.851977 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3a68c5-c1fd-4c48-8222-2aedf58ae221 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:14:51.861972 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 21/44] 10.222.0.79 () {58 vars in 1361 bytes} [Wed Aug 31 12:14:51 2022] PUT /identity/v3/domains/default/users/ba867dda5cc7471abb8f3da6ca94b58a/roles/a332ef951db949b0bad7019fbd28a1b9 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:14:51.911974 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:14:51.919021 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522b267e-c3d7-4903-99b5-f78ed475a497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:14:51.919981 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b267e-c3d7-4903-99b5-f78ed475a497 None admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:14:51.920359 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b267e-c3d7-4903-99b5-f78ed475a497 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:14:51.920841 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b267e-c3d7-4903-99b5-f78ed475a497 None admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:14:51.922145 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522b267e-c3d7-4903-99b5-f78ed475a497 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:14:51.924981 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522b267e-c3d7-4903-99b5-f78ed475a497 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:14:51.977763 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 24/45] 10.222.0.79 () {60 vars in 1141 bytes} [Wed Aug 31 12:14:51 2022] POST /identity/v3/projects => generated 312 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:14:52.057731 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cfa457-8bda-4ee9-b040-aa704c4487d7 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:14:52.263366 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cfa457-8bda-4ee9-b040-aa704c4487d7 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:14:52.331310 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13c0707-8ad2-4f4b-939b-c72f8c5c5f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:14:52.332328 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13c0707-8ad2-4f4b-939b-c72f8c5c5f65 None admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:14:52.332769 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13c0707-8ad2-4f4b-939b-c72f8c5c5f65 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:14:52.333231 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13c0707-8ad2-4f4b-939b-c72f8c5c5f65 None admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:14:52.334466 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13c0707-8ad2-4f4b-939b-c72f8c5c5f65 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:14:52.337364 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13c0707-8ad2-4f4b-939b-c72f8c5c5f65 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:14:52.368022 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 22/46] 10.222.0.79 () {60 vars in 1131 bytes} [Wed Aug 31 12:14:52 2022] POST /identity/v3/roles => generated 223 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:14:53.911178 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafcad3a-8706-4cf4-8dcc-0cdd31349006 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:14:53.911968 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafcad3a-8706-4cf4-8dcc-0cdd31349006 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:14:53.911968 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafcad3a-8706-4cf4-8dcc-0cdd31349006 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:14:53.913090 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 25/47] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:14:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:14:53.920429 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1adabb-23ba-4f0f-a826-fc39e5139953 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:14:53.920977 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1adabb-23ba-4f0f-a826-fc39e5139953 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:14:53.921341 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1adabb-23ba-4f0f-a826-fc39e5139953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:14:53.950691 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-fd1adabb-23ba-4f0f-a826-fc39e5139953 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:14:53.952691 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-fd1adabb-23ba-4f0f-a826-fc39e5139953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:14:54.006471 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:14:54.075288 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 23/48] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:14:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:14:54.087257 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5234b12f-1fc9-41cf-bdbb-073f61e2d295 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:14:54.088314 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5234b12f-1fc9-41cf-bdbb-073f61e2d295 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:14:54.088798 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5234b12f-1fc9-41cf-bdbb-073f61e2d295 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:14:54.091437 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 26/49] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:14:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:14:54.100433 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86feb0ec-566a-4749-bab9-9f5a765cad69 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:14:54.100856 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86feb0ec-566a-4749-bab9-9f5a765cad69 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:14:54.101267 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86feb0ec-566a-4749-bab9-9f5a765cad69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:14:54.129190 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-86feb0ec-566a-4749-bab9-9f5a765cad69 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:14:54.131255 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-86feb0ec-566a-4749-bab9-9f5a765cad69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:14:54.217823 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 24/50] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:14:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:14:54.366729 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5234b12f-1fc9-41cf-bdbb-073f61e2d295 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:14:54.488424 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86feb0ec-566a-4749-bab9-9f5a765cad69 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:14:54.518018 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5234b12f-1fc9-41cf-bdbb-073f61e2d295 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:14:54.574801 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f6e169-b55a-4c8c-9d14-a758cd4d5f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:14:54.575839 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6e169-b55a-4c8c-9d14-a758cd4d5f0c None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:14:54.576255 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6e169-b55a-4c8c-9d14-a758cd4d5f0c None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:14:54.576709 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6e169-b55a-4c8c-9d14-a758cd4d5f0c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:14:54.596071 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f6e169-b55a-4c8c-9d14-a758cd4d5f0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:14:54.607598 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-45f6e169-b55a-4c8c-9d14-a758cd4d5f0c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:14:54.607598 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:14:54.607598 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:14:54.607598 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:14:54.607598 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:14:54.607598 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:14:54.607598 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:14:54.607598 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:14:54.607598 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:14:54.607598 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:14:54.607598 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:14:54.607598 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:14:54.607598 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:14:54.607598 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:14:54.607598 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:14:54.607598 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:14:54.608567 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:14:54.608567 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:14:54.608567 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:14:54.608567 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:14:54.608567 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:14:54.608567 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:14:54.608567 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:14:54.608567 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:14:54.608567 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:14:54.608567 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:14:54.608567 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:14:54.608567 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:14:54.608567 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:14:54.608567 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:14:54.608567 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:14:54.608567 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:14:54.609434 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:14:54.609434 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:14:54.609434 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:14:54.609434 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:14:54.609434 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:14:54.609434 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:14:54.609434 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:14:54.609434 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:14:54.609434 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:14:54.609434 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:14:54.609434 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:14:54.609434 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:14:54.610066 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 27/51] 10.222.0.79 () {56 vars in 1096 bytes} [Wed Aug 31 12:14:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:14:54.616231 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f6e169-b55a-4c8c-9d14-a758cd4d5f0c None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:14:54.632579 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:14:54.638961 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86feb0ec-566a-4749-bab9-9f5a765cad69 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:14:54.674885 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:14:54.684915 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6e3e40-3403-4d7a-bc50-1526314e20cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:14:54.685728 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e3e40-3403-4d7a-bc50-1526314e20cf None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:14:54.686080 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e3e40-3403-4d7a-bc50-1526314e20cf None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:14:54.686562 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e3e40-3403-4d7a-bc50-1526314e20cf None admin] PATH_INFO: `/v3/domains/default` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:14:54.687926 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6e3e40-3403-4d7a-bc50-1526314e20cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:14:54.689873 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6e3e40-3403-4d7a-bc50-1526314e20cf None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:14:54.691893 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 25/52] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:14:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:14:54.699469 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6e3e40-3403-4d7a-bc50-1526314e20cf None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:14:54.750116 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f6e169-b55a-4c8c-9d14-a758cd4d5f0c None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:14:54.792952 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337dd788-f13c-4a47-a20f-a49ea94d0de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:14:54.794038 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337dd788-f13c-4a47-a20f-a49ea94d0de8 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:14:54.794393 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337dd788-f13c-4a47-a20f-a49ea94d0de8 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:14:54.794735 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337dd788-f13c-4a47-a20f-a49ea94d0de8 None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:14:54.795560 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337dd788-f13c-4a47-a20f-a49ea94d0de8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:14:54.795926 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337dd788-f13c-4a47-a20f-a49ea94d0de8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:14:54.797531 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337dd788-f13c-4a47-a20f-a49ea94d0de8 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:14:54.808366 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 28/53] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 12:14:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:14:54.817067 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337dd788-f13c-4a47-a20f-a49ea94d0de8 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:14:54.834055 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6e3e40-3403-4d7a-bc50-1526314e20cf None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:14:54.887417 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183e8950-5fae-4ec5-aa0a-7cf05afbe9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:14:54.888462 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e8950-5fae-4ec5-aa0a-7cf05afbe9cc None admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:14:54.888955 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e8950-5fae-4ec5-aa0a-7cf05afbe9cc None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:14:54.889447 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e8950-5fae-4ec5-aa0a-7cf05afbe9cc None admin] PATH_INFO: `/v3/projects` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:14:54.890675 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183e8950-5fae-4ec5-aa0a-7cf05afbe9cc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:14:54.893536 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183e8950-5fae-4ec5-aa0a-7cf05afbe9cc None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:14:54.936314 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 26/54] 10.222.0.79 () {60 vars in 1140 bytes} [Wed Aug 31 12:14:54 2022] POST /identity/v3/projects => generated 298 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:14:54.942840 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337dd788-f13c-4a47-a20f-a49ea94d0de8 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:14:54.957005 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:14:54.995018 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20df255-ccc9-4a3e-b262-9e92554b2836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:14:54.995815 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20df255-ccc9-4a3e-b262-9e92554b2836 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:14:54.996202 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20df255-ccc9-4a3e-b262-9e92554b2836 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:14:54.996537 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20df255-ccc9-4a3e-b262-9e92554b2836 None admin] PATH_INFO: `/v3/users/ba867dda5cc7471abb8f3da6ca94b58a` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:14:54.997972 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20df255-ccc9-4a3e-b262-9e92554b2836 None admin] RBAC: Authorizing `identity:get_user(user_id=ba867dda5cc7471abb8f3da6ca94b58a)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:14:54.999674 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20df255-ccc9-4a3e-b262-9e92554b2836 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:14:55.001917 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 29/55] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 12:14:54 2022] GET /identity/v3/users/ba867dda5cc7471abb8f3da6ca94b58a => generated 247 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:14:55.008065 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183e8950-5fae-4ec5-aa0a-7cf05afbe9cc None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:14:55.035786 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:14:55.146899 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183e8950-5fae-4ec5-aa0a-7cf05afbe9cc None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:14:55.189892 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbdf6bf-3c4e-43d5-a729-739f0e3e04a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:14:55.190668 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbdf6bf-3c4e-43d5-a729-739f0e3e04a3 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:14:55.191103 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbdf6bf-3c4e-43d5-a729-739f0e3e04a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:14:55.191478 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbdf6bf-3c4e-43d5-a729-739f0e3e04a3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:14:55.192774 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbdf6bf-3c4e-43d5-a729-739f0e3e04a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:14:55.194335 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbdf6bf-3c4e-43d5-a729-739f0e3e04a3 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:14:55.196202 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 27/56] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:14:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:14:55.203104 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20df255-ccc9-4a3e-b262-9e92554b2836 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:14:55.435216 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20df255-ccc9-4a3e-b262-9e92554b2836 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:14:55.477578 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1c0e39-8ee4-42f7-a29b-8f5282f76602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:14:55.478591 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1c0e39-8ee4-42f7-a29b-8f5282f76602 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:14:55.479312 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1c0e39-8ee4-42f7-a29b-8f5282f76602 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:14:55.479312 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1c0e39-8ee4-42f7-a29b-8f5282f76602 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:14:55.479881 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1c0e39-8ee4-42f7-a29b-8f5282f76602 None admin] RBAC: Adding query filter params (role.id=a332ef951db949b0bad7019fbd28a1b9, scope.domain.id=default, user.id=ba867dda5cc7471abb8f3da6ca94b58a) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:14:55.480192 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1c0e39-8ee4-42f7-a29b-8f5282f76602 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:14:55.481698 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1c0e39-8ee4-42f7-a29b-8f5282f76602 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:14:55.488721 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 30/57] 10.222.0.79 () {56 vars in 1322 bytes} [Wed Aug 31 12:14:55 2022] GET /identity/v3/role_assignments?user.id=ba867dda5cc7471abb8f3da6ca94b58a&scope.domain.id=default&role.id=a332ef951db949b0bad7019fbd28a1b9 => generated 530 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:14:56.997866 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d35642-b073-43c1-9823-3638a390c6b7 None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:14:56.998396 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d35642-b073-43c1-9823-3638a390c6b7 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:14:56.998483 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d35642-b073-43c1-9823-3638a390c6b7 None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:14:56.999945 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 28/58] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:14:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:14:57.007966 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed00ca1-32bd-4704-87b2-a06e10b05ac5 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:14:57.008488 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed00ca1-32bd-4704-87b2-a06e10b05ac5 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:14:57.008602 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed00ca1-32bd-4704-87b2-a06e10b05ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:14:57.028009 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-aed00ca1-32bd-4704-87b2-a06e10b05ac5 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:14:57.029260 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-aed00ca1-32bd-4704-87b2-a06e10b05ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:14:57.065940 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:14:57.111181 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 31/59] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:14:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:14:57.384264 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d35642-b073-43c1-9823-3638a390c6b7 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:14:57.485678 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:14:57.503754 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d35642-b073-43c1-9823-3638a390c6b7 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:14:57.541803 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d141666-9781-41f7-8468-0a1da7bff086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:14:57.542494 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d141666-9781-41f7-8468-0a1da7bff086 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:14:57.542822 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d141666-9781-41f7-8468-0a1da7bff086 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:14:57.543180 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d141666-9781-41f7-8468-0a1da7bff086 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:14:57.544395 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d141666-9781-41f7-8468-0a1da7bff086 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:14:57.545900 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d141666-9781-41f7-8468-0a1da7bff086 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:14:57.547590 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 29/60] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:14:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:14:57.553454 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed00ca1-32bd-4704-87b2-a06e10b05ac5 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:14:57.694019 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed00ca1-32bd-4704-87b2-a06e10b05ac5 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:14:57.752346 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810108e2-3d0a-40f5-87bd-e32521504b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:14:57.753357 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810108e2-3d0a-40f5-87bd-e32521504b0c None admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:14:57.753822 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810108e2-3d0a-40f5-87bd-e32521504b0c None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:14:57.754261 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810108e2-3d0a-40f5-87bd-e32521504b0c None admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:14:57.755431 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810108e2-3d0a-40f5-87bd-e32521504b0c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:14:57.758093 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810108e2-3d0a-40f5-87bd-e32521504b0c None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:14:57.798519 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 32/61] 10.222.0.79 () {60 vars in 1132 bytes} [Wed Aug 31 12:14:57 2022] POST /identity/v3/users => generated 275 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:15:01.338196 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69f55e-b65b-4814-95e8-b5587d54ff3c None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:01.339059 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69f55e-b65b-4814-95e8-b5587d54ff3c None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:01.339418 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69f55e-b65b-4814-95e8-b5587d54ff3c None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:01.342410 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 30/62] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:15:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:15:01.348843 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b0552-1631-4da9-b1a1-1d3f413f99fb None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:01.350497 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b0552-1631-4da9-b1a1-1d3f413f99fb None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:01.351360 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b0552-1631-4da9-b1a1-1d3f413f99fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:01.384508 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-396b0552-1631-4da9-b1a1-1d3f413f99fb None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:15:01.387164 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-396b0552-1631-4da9-b1a1-1d3f413f99fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:15:01.428354 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:01.549392 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 33/63] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:15:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:15:01.842117 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2660be-d974-4694-afcf-98ab2d8f5973 None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:01.842708 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2660be-d974-4694-afcf-98ab2d8f5973 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:01.843190 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2660be-d974-4694-afcf-98ab2d8f5973 None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:01.844755 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 31/64] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:15:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:15:01.850575 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c7e84-2870-46cd-8cc2-165234b18dd4 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:01.851242 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c7e84-2870-46cd-8cc2-165234b18dd4 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:01.851726 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c7e84-2870-46cd-8cc2-165234b18dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:01.876519 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-1e9c7e84-2870-46cd-8cc2-165234b18dd4 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:15:01.878098 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-1e9c7e84-2870-46cd-8cc2-165234b18dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:15:01.981336 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 34/65] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:15:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:15:02.129273 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2660be-d974-4694-afcf-98ab2d8f5973 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:02.283021 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2660be-d974-4694-afcf-98ab2d8f5973 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:02.306719 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e946260-04a2-41ad-95e9-45715da707af None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:02.307485 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e946260-04a2-41ad-95e9-45715da707af None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:02.307968 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e946260-04a2-41ad-95e9-45715da707af None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:02.309658 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 35/66] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:15:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:15:02.318317 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac9111-e2c8-487e-9485-9954086c15f9 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:02.318706 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac9111-e2c8-487e-9485-9954086c15f9 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:02.318907 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac9111-e2c8-487e-9485-9954086c15f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:02.357274 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8961bc17-8164-4f6b-b168-21aa77c7d62b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:02.358039 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8961bc17-8164-4f6b-b168-21aa77c7d62b None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:02.358207 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8961bc17-8164-4f6b-b168-21aa77c7d62b None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:02.358638 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8961bc17-8164-4f6b-b168-21aa77c7d62b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:02.364820 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-d0ac9111-e2c8-487e-9485-9954086c15f9 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:15:02.367853 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-d0ac9111-e2c8-487e-9485-9954086c15f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:15:02.370455 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8961bc17-8164-4f6b-b168-21aa77c7d62b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:15:02.378660 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-8961bc17-8164-4f6b-b168-21aa77c7d62b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:15:02.378660 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:15:02.378660 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:15:02.378660 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:15:02.378660 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:15:02.378660 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:15:02.378660 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:15:02.378660 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:15:02.378660 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:15:02.378660 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:15:02.378660 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:15:02.378660 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:15:02.378660 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:15:02.378660 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:15:02.378660 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:15:02.378660 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:15:02.380151 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:15:02.380151 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:15:02.380151 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:15:02.380151 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:15:02.380151 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:15:02.380151 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:15:02.380151 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:15:02.380151 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:15:02.380151 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:15:02.380151 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:15:02.380151 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:15:02.380151 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:15:02.380151 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:15:02.380151 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:15:02.380151 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:15:02.380151 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:15:02.381602 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:15:02.381602 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:15:02.381602 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:15:02.381602 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:15:02.381602 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:15:02.381602 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:15:02.381602 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:15:02.381602 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:15:02.381602 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:15:02.381602 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:15:02.381602 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:15:02.381602 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:15:02.381602 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 32/67] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 12:15:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:15:02.386257 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8961bc17-8164-4f6b-b168-21aa77c7d62b None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:02.414218 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:02.492542 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 36/68] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:15:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 12:15:02.494646 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ac9111-e2c8-487e-9485-9954086c15f9 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:02.515926 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:02.565849 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8961bc17-8164-4f6b-b168-21aa77c7d62b None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:02.623249 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78369250-41cb-447b-9a90-13f06f027b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:02.624423 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78369250-41cb-447b-9a90-13f06f027b01 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:02.624711 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78369250-41cb-447b-9a90-13f06f027b01 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:02.624986 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78369250-41cb-447b-9a90-13f06f027b01 None admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:02.625698 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78369250-41cb-447b-9a90-13f06f027b01 None admin] RBAC: Adding query filter params (name=member) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:15:02.626010 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78369250-41cb-447b-9a90-13f06f027b01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:02.627522 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78369250-41cb-447b-9a90-13f06f027b01 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:02.638873 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 33/69] 10.222.0.79 () {56 vars in 1101 bytes} [Wed Aug 31 12:15:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:15:02.640257 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f5e91-cc90-457a-a1c6-c51b030eb592 None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:02.640552 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f5e91-cc90-457a-a1c6-c51b030eb592 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:02.640831 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f5e91-cc90-457a-a1c6-c51b030eb592 None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:02.642429 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 34/70] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:15:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:15:02.643483 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a7e93-074a-4afb-9dbd-3d611a297e7a None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:02.643774 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a7e93-074a-4afb-9dbd-3d611a297e7a None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:02.644106 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a7e93-074a-4afb-9dbd-3d611a297e7a None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:02.645437 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 35/71] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:15:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:15:02.651225 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540a7e93-074a-4afb-9dbd-3d611a297e7a None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:02.659576 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ac9111-e2c8-487e-9485-9954086c15f9 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:02.715678 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65370e51-fe89-4991-b6ad-e40de2cab940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:02.716680 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65370e51-fe89-4991-b6ad-e40de2cab940 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:02.716966 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65370e51-fe89-4991-b6ad-e40de2cab940 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:02.717236 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65370e51-fe89-4991-b6ad-e40de2cab940 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:02.731003 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65370e51-fe89-4991-b6ad-e40de2cab940 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:15:02.736116 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-65370e51-fe89-4991-b6ad-e40de2cab940 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:15:02.736116 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:15:02.736116 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:15:02.736116 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:15:02.736116 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:15:02.736116 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:15:02.736116 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:15:02.736116 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:15:02.736116 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:15:02.736116 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:15:02.736116 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:15:02.736116 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:15:02.736116 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:15:02.736116 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:15:02.736116 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:15:02.736116 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:15:02.737050 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:15:02.737050 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:15:02.737050 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:15:02.737050 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:15:02.737050 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:15:02.737050 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:15:02.737050 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:15:02.737050 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:15:02.737050 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:15:02.737050 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:15:02.737050 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:15:02.737050 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:15:02.737050 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:15:02.737050 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:15:02.737050 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:15:02.737050 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:15:02.738373 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:15:02.738373 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:15:02.738373 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:15:02.738373 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:15:02.738373 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:15:02.738373 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:15:02.738373 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:15:02.738373 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:15:02.738373 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:15:02.738373 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:15:02.738373 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:15:02.738373 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:15:02.738373 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 37/72] 10.222.0.79 () {56 vars in 1096 bytes} [Wed Aug 31 12:15:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:15:02.739695 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16656457-53d7-46c8-9fdc-0f7799a8d2ce None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:02.739818 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16656457-53d7-46c8-9fdc-0f7799a8d2ce None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:02.740599 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16656457-53d7-46c8-9fdc-0f7799a8d2ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:02.761672 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-16656457-53d7-46c8-9fdc-0f7799a8d2ce None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:15:02.762939 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-16656457-53d7-46c8-9fdc-0f7799a8d2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:15:02.763737 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:02.795317 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540a7e93-074a-4afb-9dbd-3d611a297e7a None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:02.834566 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdcb695-d00a-4c2d-8982-991e046d1b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:02.835518 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdcb695-d00a-4c2d-8982-991e046d1b9a None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:02.835799 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdcb695-d00a-4c2d-8982-991e046d1b9a None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:02.836082 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdcb695-d00a-4c2d-8982-991e046d1b9a None admin] PATH_INFO: `/v3/users/76d206fbf63149e689df0067d9be2dfd` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:02.851036 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdcb695-d00a-4c2d-8982-991e046d1b9a None admin] RBAC: Authorizing `identity:get_user(user_id=76d206fbf63149e689df0067d9be2dfd)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:02.852559 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdcb695-d00a-4c2d-8982-991e046d1b9a None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:02.855075 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 36/73] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 12:15:02 2022] GET /identity/v3/users/76d206fbf63149e689df0067d9be2dfd => generated 275 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:02.856474 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe596c-b152-44e4-8a58-1bdd6340169d None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:02.856777 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe596c-b152-44e4-8a58-1bdd6340169d None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:02.857060 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe596c-b152-44e4-8a58-1bdd6340169d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:02.873045 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 38/74] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:15:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:15:02.874301 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16656457-53d7-46c8-9fdc-0f7799a8d2ce None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:02.877616 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-0ffe596c-b152-44e4-8a58-1bdd6340169d None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:15:02.878883 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-0ffe596c-b152-44e4-8a58-1bdd6340169d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:15:02.886088 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:02.975005 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 37/75] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:15:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:15:02.975005 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffe596c-b152-44e4-8a58-1bdd6340169d None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:03.020150 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16656457-53d7-46c8-9fdc-0f7799a8d2ce None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:03.092232 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df16dc35-7e6b-40af-ac03-c672365662f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:03.093195 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df16dc35-7e6b-40af-ac03-c672365662f8 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:03.093632 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df16dc35-7e6b-40af-ac03-c672365662f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:03.094094 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df16dc35-7e6b-40af-ac03-c672365662f8 None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:03.095278 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df16dc35-7e6b-40af-ac03-c672365662f8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:15:03.096046 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df16dc35-7e6b-40af-ac03-c672365662f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:03.097421 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:03.100374 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df16dc35-7e6b-40af-ac03-c672365662f8 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:03.123702 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 39/76] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 12:15:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:03.125506 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df16dc35-7e6b-40af-ac03-c672365662f8 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:03.176241 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffe596c-b152-44e4-8a58-1bdd6340169d None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:03.241004 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04c5f86-8e56-41a5-93b1-e3c22fbb771f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:03.242219 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c5f86-8e56-41a5-93b1-e3c22fbb771f None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:03.243437 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c5f86-8e56-41a5-93b1-e3c22fbb771f None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:03.244494 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c5f86-8e56-41a5-93b1-e3c22fbb771f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:03.265289 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04c5f86-8e56-41a5-93b1-e3c22fbb771f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:15:03.270674 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-e04c5f86-8e56-41a5-93b1-e3c22fbb771f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 12:15:03.270674 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:15:03.270674 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:15:03.270674 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:15:03.270674 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:15:03.270674 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:15:03.270674 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:15:03.270674 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:15:03.270674 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:15:03.270674 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:15:03.270674 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:15:03.270674 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:15:03.270674 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:15:03.270674 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:15:03.270674 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:15:03.270674 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:15:03.271870 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:15:03.271870 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:15:03.271870 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:15:03.271870 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:15:03.271870 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:15:03.271870 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:15:03.271870 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:15:03.271870 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:15:03.271870 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:15:03.271870 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:15:03.271870 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:15:03.271870 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:15:03.271870 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:15:03.271870 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:15:03.271870 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:15:03.271870 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:15:03.272889 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:15:03.272889 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:15:03.272889 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:15:03.272889 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:15:03.272889 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:15:03.272889 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:15:03.272889 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:15:03.272889 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:15:03.272889 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:15:03.272889 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:15:03.272889 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 12:15:03.272889 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:15:03.274783 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 38/77] 10.222.0.79 () {56 vars in 1114 bytes} [Wed Aug 31 12:15:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:15:03.276215 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04c5f86-8e56-41a5-93b1-e3c22fbb771f None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:03.282600 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:03.339817 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df16dc35-7e6b-40af-ac03-c672365662f8 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:03.407737 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca61e6d-b6a5-4f4a-bbc5-8b58e2707a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:03.409198 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca61e6d-b6a5-4f4a-bbc5-8b58e2707a4e None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:03.409679 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca61e6d-b6a5-4f4a-bbc5-8b58e2707a4e None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:03.410199 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca61e6d-b6a5-4f4a-bbc5-8b58e2707a4e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:03.412839 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04c5f86-8e56-41a5-93b1-e3c22fbb771f None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:03.447539 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:03.465531 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81994870-6cab-48aa-aaa0-186f0e3052cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:03.466577 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81994870-6cab-48aa-aaa0-186f0e3052cc None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:03.467159 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81994870-6cab-48aa-aaa0-186f0e3052cc None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:03.467469 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81994870-6cab-48aa-aaa0-186f0e3052cc None admin] PATH_INFO: `/v3/users/ba867dda5cc7471abb8f3da6ca94b58a` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:03.468868 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81994870-6cab-48aa-aaa0-186f0e3052cc None admin] RBAC: Authorizing `identity:get_user(user_id=ba867dda5cc7471abb8f3da6ca94b58a)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:03.470469 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81994870-6cab-48aa-aaa0-186f0e3052cc None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:03.472326 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 39/78] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 12:15:03 2022] GET /identity/v3/users/ba867dda5cc7471abb8f3da6ca94b58a => generated 247 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:03.473696 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81994870-6cab-48aa-aaa0-186f0e3052cc None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:03.517164 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca61e6d-b6a5-4f4a-bbc5-8b58e2707a4e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:03.519235 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca61e6d-b6a5-4f4a-bbc5-8b58e2707a4e None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:03.605829 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:03.606159 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81994870-6cab-48aa-aaa0-186f0e3052cc None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:03.649332 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 40/79] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 12:15:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:15:03.651106 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca61e6d-b6a5-4f4a-bbc5-8b58e2707a4e None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:03.659355 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b8ca7-7ed4-4109-ac2a-f37b12b0f201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:03.660154 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b8ca7-7ed4-4109-ac2a-f37b12b0f201 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:03.660525 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b8ca7-7ed4-4109-ac2a-f37b12b0f201 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:03.660888 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b8ca7-7ed4-4109-ac2a-f37b12b0f201 None admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:03.661685 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628b8ca7-7ed4-4109-ac2a-f37b12b0f201 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:15:03.662091 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628b8ca7-7ed4-4109-ac2a-f37b12b0f201 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:03.663657 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628b8ca7-7ed4-4109-ac2a-f37b12b0f201 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:03.674306 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 40/80] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 12:15:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:03.675494 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b8ca7-7ed4-4109-ac2a-f37b12b0f201 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:03.743487 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:03.795193 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca61e6d-b6a5-4f4a-bbc5-8b58e2707a4e None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:03.820793 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b8ca7-7ed4-4109-ac2a-f37b12b0f201 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:03.836487 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bdf527-483c-4cea-8905-b70a446294d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:03.837334 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bdf527-483c-4cea-8905-b70a446294d7 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:03.837635 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bdf527-483c-4cea-8905-b70a446294d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:03.838038 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bdf527-483c-4cea-8905-b70a446294d7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:03.851522 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bdf527-483c-4cea-8905-b70a446294d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:15:03.858546 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-a0bdf527-483c-4cea-8905-b70a446294d7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:15:03.858546 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:15:03.858546 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:15:03.858546 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:15:03.858546 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:15:03.858546 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:15:03.858546 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:15:03.858546 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:15:03.858546 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:15:03.858546 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:15:03.858546 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:15:03.858546 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:15:03.858546 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:15:03.858546 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:15:03.858546 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:15:03.858546 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:15:03.860429 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:15:03.860429 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:15:03.860429 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:15:03.860429 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:15:03.860429 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:15:03.860429 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:15:03.860429 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:15:03.860429 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:15:03.860429 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:15:03.860429 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:15:03.860429 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:15:03.860429 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:15:03.860429 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:15:03.860429 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:15:03.860429 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:15:03.860429 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:15:03.861923 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:15:03.861923 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:15:03.861923 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:15:03.861923 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:15:03.861923 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:15:03.861923 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:15:03.861923 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:15:03.861923 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:15:03.861923 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:15:03.861923 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:15:03.861923 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:15:03.861923 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:15:03.861923 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 41/81] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 12:15:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:15:03.861923 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bdf527-483c-4cea-8905-b70a446294d7 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:03.869562 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df810c-4b7c-429d-b1f1-ab2221661466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:03.870495 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df810c-4b7c-429d-b1f1-ab2221661466 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:03.870844 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df810c-4b7c-429d-b1f1-ab2221661466 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:03.871230 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df810c-4b7c-429d-b1f1-ab2221661466 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:03.872589 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17df810c-4b7c-429d-b1f1-ab2221661466 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:03.874458 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17df810c-4b7c-429d-b1f1-ab2221661466 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:03.876639 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 41/82] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:15:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:03.880789 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df810c-4b7c-429d-b1f1-ab2221661466 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:03.896083 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:04.019277 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df810c-4b7c-429d-b1f1-ab2221661466 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:04.019516 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bdf527-483c-4cea-8905-b70a446294d7 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:04.047566 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:04.062623 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef12573e-80b6-44f2-b7b3-c02605ed9047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:04.062947 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7758b3fa-a6ea-4d1f-b9a4-7a111c271acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:04.063333 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7758b3fa-a6ea-4d1f-b9a4-7a111c271acd None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:04.063492 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef12573e-80b6-44f2-b7b3-c02605ed9047 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:04.063649 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7758b3fa-a6ea-4d1f-b9a4-7a111c271acd None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:04.063870 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef12573e-80b6-44f2-b7b3-c02605ed9047 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:04.064022 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7758b3fa-a6ea-4d1f-b9a4-7a111c271acd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:04.064267 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef12573e-80b6-44f2-b7b3-c02605ed9047 None admin] PATH_INFO: `/v3/projects/79222f00008144bba451b7a2da2da187` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:04.065605 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef12573e-80b6-44f2-b7b3-c02605ed9047 None admin] RBAC: Authorizing `identity:get_project(project_id=79222f00008144bba451b7a2da2da187)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:04.067212 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef12573e-80b6-44f2-b7b3-c02605ed9047 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:04.069145 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 42/83] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 12:15:03 2022] GET /identity/v3/projects/79222f00008144bba451b7a2da2da187 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:04.070916 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef12573e-80b6-44f2-b7b3-c02605ed9047 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:04.175948 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7758b3fa-a6ea-4d1f-b9a4-7a111c271acd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:04.178042 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7758b3fa-a6ea-4d1f-b9a4-7a111c271acd None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:04.205554 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef12573e-80b6-44f2-b7b3-c02605ed9047 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:04.216022 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:04.256893 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5a770a-4418-4776-8cd5-3c5eeab1a253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:04.257836 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a770a-4418-4776-8cd5-3c5eeab1a253 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:04.258127 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a770a-4418-4776-8cd5-3c5eeab1a253 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:04.258493 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a770a-4418-4776-8cd5-3c5eeab1a253 None admin] PATH_INFO: `/v3/users/76d206fbf63149e689df0067d9be2dfd` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:04.261251 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5a770a-4418-4776-8cd5-3c5eeab1a253 None admin] RBAC: Authorizing `identity:get_user(user_id=76d206fbf63149e689df0067d9be2dfd)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:04.263054 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5a770a-4418-4776-8cd5-3c5eeab1a253 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:04.265074 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 43/84] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 12:15:04 2022] GET /identity/v3/users/76d206fbf63149e689df0067d9be2dfd => generated 275 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:04.266409 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5a770a-4418-4776-8cd5-3c5eeab1a253 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:04.328035 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 42/85] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 12:15:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:15:04.329134 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7758b3fa-a6ea-4d1f-b9a4-7a111c271acd None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:04.357847 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:04.411975 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5a770a-4418-4776-8cd5-3c5eeab1a253 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:04.461970 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd05ba8e-8868-4c6e-9192-82ff89bcf69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:04.464004 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd05ba8e-8868-4c6e-9192-82ff89bcf69c None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:04.464004 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd05ba8e-8868-4c6e-9192-82ff89bcf69c None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:04.464004 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd05ba8e-8868-4c6e-9192-82ff89bcf69c None admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:04.464627 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd05ba8e-8868-4c6e-9192-82ff89bcf69c None admin] RBAC: Adding query filter params (name=member) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:15:04.465048 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd05ba8e-8868-4c6e-9192-82ff89bcf69c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:04.467280 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd05ba8e-8868-4c6e-9192-82ff89bcf69c None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:04.468563 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7758b3fa-a6ea-4d1f-b9a4-7a111c271acd None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:04.478830 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 44/86] 10.222.0.79 () {56 vars in 1101 bytes} [Wed Aug 31 12:15:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:04.479537 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd05ba8e-8868-4c6e-9192-82ff89bcf69c None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:04.500490 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:04.510319 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f23d1a1-30f7-482e-ab17-d008fccba1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:04.510981 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f23d1a1-30f7-482e-ab17-d008fccba1d2 None admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:04.511269 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f23d1a1-30f7-482e-ab17-d008fccba1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:04.511550 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f23d1a1-30f7-482e-ab17-d008fccba1d2 None admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:04.512219 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f23d1a1-30f7-482e-ab17-d008fccba1d2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:04.513717 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f23d1a1-30f7-482e-ab17-d008fccba1d2 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:04.542003 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 43/87] 10.222.0.79 () {60 vars in 1132 bytes} [Wed Aug 31 12:15:04 2022] POST /identity/v3/users => generated 289 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:15:04.543487 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f23d1a1-30f7-482e-ab17-d008fccba1d2 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:04.630347 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd05ba8e-8868-4c6e-9192-82ff89bcf69c None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:04.661879 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:04.682207 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad306e4-54e3-4f1a-bcee-aa2341ee0f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:04.682918 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad306e4-54e3-4f1a-bcee-aa2341ee0f28 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:04.683212 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad306e4-54e3-4f1a-bcee-aa2341ee0f28 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:04.683511 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad306e4-54e3-4f1a-bcee-aa2341ee0f28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:04.684274 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad306e4-54e3-4f1a-bcee-aa2341ee0f28 None admin] RBAC: Adding query filter params (role.id=b5cfd7a855a448359e9017f51d32b6fc, scope.project.id=79222f00008144bba451b7a2da2da187, user.id=76d206fbf63149e689df0067d9be2dfd) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:15:04.684592 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad306e4-54e3-4f1a-bcee-aa2341ee0f28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:04.686159 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad306e4-54e3-4f1a-bcee-aa2341ee0f28 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:04.702292 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 45/88] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 12:15:04 2022] GET /identity/v3/role_assignments?user.id=76d206fbf63149e689df0067d9be2dfd&scope.project.id=79222f00008144bba451b7a2da2da187&role.id=b5cfd7a855a448359e9017f51d32b6fc => generated 259 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:04.702292 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad306e4-54e3-4f1a-bcee-aa2341ee0f28 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:04.762715 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f23d1a1-30f7-482e-ab17-d008fccba1d2 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:04.844849 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155d6d9b-1e72-4d10-8fc7-5d10cea58e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:04.845742 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d6d9b-1e72-4d10-8fc7-5d10cea58e23 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:04.846238 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d6d9b-1e72-4d10-8fc7-5d10cea58e23 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:04.848242 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d6d9b-1e72-4d10-8fc7-5d10cea58e23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:04.901381 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad306e4-54e3-4f1a-bcee-aa2341ee0f28 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:04.944389 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:04.976330 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155d6d9b-1e72-4d10-8fc7-5d10cea58e23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:04.978752 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155d6d9b-1e72-4d10-8fc7-5d10cea58e23 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:04.996184 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe6e9a3-5e94-4077-8d21-6cfaa3f7b7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:04.997627 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6e9a3-5e94-4077-8d21-6cfaa3f7b7b5 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:04.998353 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6e9a3-5e94-4077-8d21-6cfaa3f7b7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:04.999079 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6e9a3-5e94-4077-8d21-6cfaa3f7b7b5 None admin] PATH_INFO: `/v3/projects/79222f00008144bba451b7a2da2da187` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:05.001597 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe6e9a3-5e94-4077-8d21-6cfaa3f7b7b5 None admin] RBAC: Authorizing `identity:get_project(project_id=79222f00008144bba451b7a2da2da187)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:05.004790 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe6e9a3-5e94-4077-8d21-6cfaa3f7b7b5 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:05.008640 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 46/89] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 12:15:04 2022] GET /identity/v3/projects/79222f00008144bba451b7a2da2da187 => generated 298 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:05.010914 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe6e9a3-5e94-4077-8d21-6cfaa3f7b7b5 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:05.113097 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:05.168750 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 44/90] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 12:15:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 626 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:15:05.170342 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155d6d9b-1e72-4d10-8fc7-5d10cea58e23 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:05.253549 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe6e9a3-5e94-4077-8d21-6cfaa3f7b7b5 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:05.339450 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5758616-0e1d-4dd9-b877-2f9245ab2cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:05.340134 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5758616-0e1d-4dd9-b877-2f9245ab2cfd None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:05.340418 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5758616-0e1d-4dd9-b877-2f9245ab2cfd None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:05.340693 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5758616-0e1d-4dd9-b877-2f9245ab2cfd None admin] PATH_INFO: `/v3/users/76d206fbf63149e689df0067d9be2dfd` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:05.344080 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5758616-0e1d-4dd9-b877-2f9245ab2cfd None admin] RBAC: Authorizing `identity:get_user(user_id=76d206fbf63149e689df0067d9be2dfd)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:05.345643 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5758616-0e1d-4dd9-b877-2f9245ab2cfd None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:05.355269 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 47/91] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 12:15:05 2022] GET /identity/v3/users/76d206fbf63149e689df0067d9be2dfd => generated 275 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:05.356171 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5758616-0e1d-4dd9-b877-2f9245ab2cfd None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:05.381220 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:05.427928 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155d6d9b-1e72-4d10-8fc7-5d10cea58e23 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:05.538501 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6d2462-250d-40bd-9e84-08b70616b452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:05.539862 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d2462-250d-40bd-9e84-08b70616b452 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:05.540328 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d2462-250d-40bd-9e84-08b70616b452 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:05.541289 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d2462-250d-40bd-9e84-08b70616b452 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:05.542305 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6d2462-250d-40bd-9e84-08b70616b452 None admin] RBAC: Adding query filter params (role.id=a332ef951db949b0bad7019fbd28a1b9, scope.project.id=79222f00008144bba451b7a2da2da187, user.id=ba867dda5cc7471abb8f3da6ca94b58a) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:15:05.542774 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6d2462-250d-40bd-9e84-08b70616b452 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:05.544428 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6d2462-250d-40bd-9e84-08b70616b452 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:05.557664 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5758616-0e1d-4dd9-b877-2f9245ab2cfd None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:05.565366 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 45/92] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 12:15:05 2022] GET /identity/v3/role_assignments?user.id=ba867dda5cc7471abb8f3da6ca94b58a&scope.project.id=79222f00008144bba451b7a2da2da187&role.id=a332ef951db949b0bad7019fbd28a1b9 => generated 259 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:05.566493 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6d2462-250d-40bd-9e84-08b70616b452 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:05.585925 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:05.629434 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298a3f79-b0f8-4cac-ad2b-c40daf7aa2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:05.630121 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a3f79-b0f8-4cac-ad2b-c40daf7aa2e8 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:05.630414 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a3f79-b0f8-4cac-ad2b-c40daf7aa2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:05.630699 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a3f79-b0f8-4cac-ad2b-c40daf7aa2e8 None admin] PATH_INFO: `/v3/projects/79222f00008144bba451b7a2da2da187` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:05.632561 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298a3f79-b0f8-4cac-ad2b-c40daf7aa2e8 None admin] RBAC: Authorizing `identity:get_project(project_id=79222f00008144bba451b7a2da2da187)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:05.634812 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298a3f79-b0f8-4cac-ad2b-c40daf7aa2e8 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:05.642884 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 48/93] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 12:15:05 2022] GET /identity/v3/projects/79222f00008144bba451b7a2da2da187 => generated 298 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:05.647908 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298a3f79-b0f8-4cac-ad2b-c40daf7aa2e8 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:05.892423 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298a3f79-b0f8-4cac-ad2b-c40daf7aa2e8 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:05.941031 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6d2462-250d-40bd-9e84-08b70616b452 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:05.956056 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930f82e-ee37-4698-aa41-c08d7eb7621e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:05.957081 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930f82e-ee37-4698-aa41-c08d7eb7621e None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:05.957564 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930f82e-ee37-4698-aa41-c08d7eb7621e None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:05.958039 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930f82e-ee37-4698-aa41-c08d7eb7621e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:05.959047 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7930f82e-ee37-4698-aa41-c08d7eb7621e None admin] RBAC: Adding query filter params (role.id=be23fee6ea264172b277f97af30cc689, scope.project.id=79222f00008144bba451b7a2da2da187, user.id=76d206fbf63149e689df0067d9be2dfd) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:15:05.959570 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7930f82e-ee37-4698-aa41-c08d7eb7621e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:05.961537 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7930f82e-ee37-4698-aa41-c08d7eb7621e None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:05.968886 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 49/94] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 12:15:05 2022] GET /identity/v3/role_assignments?user.id=76d206fbf63149e689df0067d9be2dfd&scope.project.id=79222f00008144bba451b7a2da2da187&role.id=be23fee6ea264172b277f97af30cc689 => generated 259 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:06.041234 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cd3a64-85ca-455b-abbc-6717c3043e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:06.041945 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd3a64-85ca-455b-abbc-6717c3043e14 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:06.042224 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd3a64-85ca-455b-abbc-6717c3043e14 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:06.042497 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd3a64-85ca-455b-abbc-6717c3043e14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:06.067199 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:06.154316 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cd3a64-85ca-455b-abbc-6717c3043e14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:06.155903 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cd3a64-85ca-455b-abbc-6717c3043e14 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:06.296803 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 46/95] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 12:15:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 730 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:15:06.304759 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930f82e-ee37-4698-aa41-c08d7eb7621e None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:06.380644 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:06.460805 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930f82e-ee37-4698-aa41-c08d7eb7621e None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:06.522549 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acc2dd3-7781-4a15-a885-0fb78ca4a429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:06.523628 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc2dd3-7781-4a15-a885-0fb78ca4a429 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:06.524142 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc2dd3-7781-4a15-a885-0fb78ca4a429 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:06.524617 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc2dd3-7781-4a15-a885-0fb78ca4a429 None admin] PATH_INFO: `/v3/projects/8ee31161d5594131a34ea8dcad87d2a1` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:06.526946 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acc2dd3-7781-4a15-a885-0fb78ca4a429 None admin] RBAC: Authorizing `identity:get_project(project_id=8ee31161d5594131a34ea8dcad87d2a1)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:06.528789 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acc2dd3-7781-4a15-a885-0fb78ca4a429 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:06.532372 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 50/96] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 12:15:06 2022] GET /identity/v3/projects/8ee31161d5594131a34ea8dcad87d2a1 => generated 312 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:06.541408 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cd3a64-85ca-455b-abbc-6717c3043e14 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:06.659883 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:06.792349 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cd3a64-85ca-455b-abbc-6717c3043e14 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:06.878382 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb30d2e4-05ce-415c-8420-42adf8ce3398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:06.879468 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb30d2e4-05ce-415c-8420-42adf8ce3398 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:06.879968 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb30d2e4-05ce-415c-8420-42adf8ce3398 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:06.880449 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb30d2e4-05ce-415c-8420-42adf8ce3398 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:06.881839 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb30d2e4-05ce-415c-8420-42adf8ce3398 None admin] RBAC: Adding query filter params (role.id=b5cfd7a855a448359e9017f51d32b6fc, scope.project.id=8ee31161d5594131a34ea8dcad87d2a1, user.id=76d206fbf63149e689df0067d9be2dfd) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:15:06.882469 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb30d2e4-05ce-415c-8420-42adf8ce3398 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:06.885918 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb30d2e4-05ce-415c-8420-42adf8ce3398 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:06.896494 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 47/97] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 12:15:06 2022] GET /identity/v3/role_assignments?user.id=76d206fbf63149e689df0067d9be2dfd&scope.project.id=8ee31161d5594131a34ea8dcad87d2a1&role.id=b5cfd7a855a448359e9017f51d32b6fc => generated 259 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:08.314012 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855109b-91c4-4509-83d0-e1bbc8f9887b None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:08.314725 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855109b-91c4-4509-83d0-e1bbc8f9887b None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:08.315080 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855109b-91c4-4509-83d0-e1bbc8f9887b None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:08.317872 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 51/98] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:15:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:15:08.325304 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7625400-6384-4016-9487-cd7829f1cb27 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:08.326070 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7625400-6384-4016-9487-cd7829f1cb27 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:08.326377 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7625400-6384-4016-9487-cd7829f1cb27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:08.368137 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-a7625400-6384-4016-9487-cd7829f1cb27 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:15:08.370241 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-a7625400-6384-4016-9487-cd7829f1cb27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:15:08.557021 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 48/99] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:15:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 12:15:08.685158 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2e491-2949-47c0-8950-7d815113827b None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:08.685362 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2e491-2949-47c0-8950-7d815113827b None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:08.685657 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2e491-2949-47c0-8950-7d815113827b None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:08.687155 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 52/100] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:15:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:15:08.697410 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf7fc16-cdf0-4667-9295-4c175f10e501 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:08.697780 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf7fc16-cdf0-4667-9295-4c175f10e501 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:08.697990 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf7fc16-cdf0-4667-9295-4c175f10e501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:08.731115 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-aaf7fc16-cdf0-4667-9295-4c175f10e501 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:15:08.732366 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-aaf7fc16-cdf0-4667-9295-4c175f10e501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:15:08.771537 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357e60b0-9985-4ccd-ae97-9f5a25fa823d None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:08.771818 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357e60b0-9985-4ccd-ae97-9f5a25fa823d None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:08.772258 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357e60b0-9985-4ccd-ae97-9f5a25fa823d None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:08.773826 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 53/101] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:15:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:15:08.790174 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e1e4a-3d56-41fc-9229-7f9659bb876a None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:08.791339 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e1e4a-3d56-41fc-9229-7f9659bb876a None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:08.791762 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e1e4a-3d56-41fc-9229-7f9659bb876a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:08.822006 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:08.840890 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-c30e1e4a-3d56-41fc-9229-7f9659bb876a None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:15:08.843018 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-c30e1e4a-3d56-41fc-9229-7f9659bb876a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:15:08.899249 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 49/102] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:15:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 12:15:08.975972 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf7fc16-cdf0-4667-9295-4c175f10e501 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:09.003479 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 54/103] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:15:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 12:15:09.177432 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf7fc16-cdf0-4667-9295-4c175f10e501 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:09.213899 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f655ae46-170c-4b8a-8ca5-a97140b671f0 None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:09.214888 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f655ae46-170c-4b8a-8ca5-a97140b671f0 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:09.215899 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f655ae46-170c-4b8a-8ca5-a97140b671f0 None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:09.218701 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 55/104] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:15:09 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:15:09.224252 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb718ef2-e8d4-403d-8f77-4ed47a28d986 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:09.224853 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb718ef2-e8d4-403d-8f77-4ed47a28d986 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:09.225331 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb718ef2-e8d4-403d-8f77-4ed47a28d986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:09.253190 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-fb718ef2-e8d4-403d-8f77-4ed47a28d986 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:15:09.254739 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-fb718ef2-e8d4-403d-8f77-4ed47a28d986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:15:09.260812 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6e53d4-c0da-4ba7-81c1-679deff998cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:09.266532 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e53d4-c0da-4ba7-81c1-679deff998cf None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:09.267173 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e53d4-c0da-4ba7-81c1-679deff998cf None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:09.267685 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e53d4-c0da-4ba7-81c1-679deff998cf None admin] PATH_INFO: `/v3/domains/default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:09.269197 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6e53d4-c0da-4ba7-81c1-679deff998cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:09.270907 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6e53d4-c0da-4ba7-81c1-679deff998cf None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:09.277733 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 50/105] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:15:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:09.287225 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6e53d4-c0da-4ba7-81c1-679deff998cf None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:09.355461 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:09.376534 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:09.386095 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 56/106] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:15:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 12:15:09.498235 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6e53d4-c0da-4ba7-81c1-679deff998cf None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:09.549169 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf1495a-fb86-4371-8fa0-b64f32c18186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:09.549858 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1495a-fb86-4371-8fa0-b64f32c18186 None admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:09.550089 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1495a-fb86-4371-8fa0-b64f32c18186 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:09.550374 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1495a-fb86-4371-8fa0-b64f32c18186 None admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:09.551095 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf1495a-fb86-4371-8fa0-b64f32c18186 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:09.552632 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf1495a-fb86-4371-8fa0-b64f32c18186 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:09.596410 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb718ef2-e8d4-403d-8f77-4ed47a28d986 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:09.616378 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 51/107] 10.222.0.79 () {60 vars in 1141 bytes} [Wed Aug 31 12:15:09 2022] POST /identity/v3/projects => generated 302 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:15:09.637296 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf1495a-fb86-4371-8fa0-b64f32c18186 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:09.771217 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:09.785976 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf1495a-fb86-4371-8fa0-b64f32c18186 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:09.819306 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb718ef2-e8d4-403d-8f77-4ed47a28d986 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:09.830155 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f197fea6-0b38-49cd-89db-b6f61a1b443d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:09.831264 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f197fea6-0b38-49cd-89db-b6f61a1b443d None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:09.831752 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f197fea6-0b38-49cd-89db-b6f61a1b443d None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:09.832323 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f197fea6-0b38-49cd-89db-b6f61a1b443d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:09.846386 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f197fea6-0b38-49cd-89db-b6f61a1b443d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:15:09.853983 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-f197fea6-0b38-49cd-89db-b6f61a1b443d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:15:09.853983 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:15:09.853983 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:15:09.853983 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:15:09.853983 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:15:09.853983 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:15:09.853983 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:15:09.853983 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:15:09.853983 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:15:09.853983 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:15:09.853983 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:15:09.853983 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:15:09.853983 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:15:09.853983 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:15:09.853983 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:15:09.853983 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:15:09.855000 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:15:09.855000 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:15:09.855000 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:15:09.855000 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:15:09.855000 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:15:09.855000 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:15:09.855000 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:15:09.855000 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:15:09.855000 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:15:09.855000 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:15:09.855000 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:15:09.855000 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:15:09.855000 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:15:09.855000 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:15:09.855000 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:15:09.855000 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:15:09.855846 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:15:09.855846 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:15:09.855846 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:15:09.855846 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:15:09.855846 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:15:09.855846 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:15:09.855846 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:15:09.855846 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:15:09.855846 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:15:09.855846 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:15:09.855846 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:15:09.855846 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:15:09.859674 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 52/108] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 12:15:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:15:09.862244 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73cb57d-18f6-4347-bd2d-9eb8dcc519ae None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:09.863183 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73cb57d-18f6-4347-bd2d-9eb8dcc519ae None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:09.863919 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73cb57d-18f6-4347-bd2d-9eb8dcc519ae None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:09.866659 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 53/109] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:15:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:15:09.868364 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73cb57d-18f6-4347-bd2d-9eb8dcc519ae None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:09.896333 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec80cad-2a59-47e9-aa41-9a3668163689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:09.897386 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec80cad-2a59-47e9-aa41-9a3668163689 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:09.897855 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec80cad-2a59-47e9-aa41-9a3668163689 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:09.898322 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec80cad-2a59-47e9-aa41-9a3668163689 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:09.919113 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec80cad-2a59-47e9-aa41-9a3668163689 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:15:09.928644 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-0ec80cad-2a59-47e9-aa41-9a3668163689 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 12:15:09.928644 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:15:09.928644 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:15:09.928644 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:15:09.928644 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:15:09.928644 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:15:09.928644 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:15:09.928644 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:15:09.928644 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:15:09.928644 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:15:09.928644 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:15:09.928644 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:15:09.928644 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:15:09.928644 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:15:09.928644 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:15:09.928644 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:15:09.930250 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:15:09.930250 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:15:09.930250 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:15:09.930250 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:15:09.930250 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:15:09.930250 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:15:09.930250 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:15:09.930250 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:15:09.930250 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:15:09.930250 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:15:09.930250 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:15:09.930250 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:15:09.930250 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:15:09.930250 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:15:09.930250 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:15:09.930250 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:15:09.932269 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:15:09.932269 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:15:09.932269 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:15:09.932269 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:15:09.932269 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:15:09.932269 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:15:09.932269 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:15:09.932269 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:15:09.932269 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:15:09.932269 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:15:09.932269 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 12:15:09.932269 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:15:09.932269 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 57/110] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 12:15:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:15:09.939173 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec80cad-2a59-47e9-aa41-9a3668163689 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:10.015526 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:10.095846 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73cb57d-18f6-4347-bd2d-9eb8dcc519ae None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:10.152708 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec80cad-2a59-47e9-aa41-9a3668163689 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:10.167744 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b98b6d-6bcf-4e74-89e9-99bcf94f5287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:10.168571 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b98b6d-6bcf-4e74-89e9-99bcf94f5287 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:10.169082 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b98b6d-6bcf-4e74-89e9-99bcf94f5287 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:10.169576 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b98b6d-6bcf-4e74-89e9-99bcf94f5287 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:10.194277 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b98b6d-6bcf-4e74-89e9-99bcf94f5287 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:15:10.205323 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-c7b98b6d-6bcf-4e74-89e9-99bcf94f5287 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:15:10.205323 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:15:10.205323 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:15:10.205323 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:15:10.205323 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:15:10.205323 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:15:10.205323 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:15:10.205323 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:15:10.205323 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:15:10.205323 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:15:10.205323 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:15:10.205323 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:15:10.205323 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:15:10.205323 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:15:10.205323 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:15:10.205323 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:15:10.206267 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:15:10.206267 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:15:10.206267 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:15:10.206267 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:15:10.206267 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:15:10.206267 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:15:10.206267 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:15:10.206267 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:15:10.206267 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:15:10.206267 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:15:10.206267 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:15:10.206267 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:15:10.206267 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:15:10.206267 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:15:10.206267 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:15:10.206267 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:15:10.207088 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:15:10.207088 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:15:10.207088 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:15:10.207088 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:15:10.207088 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:15:10.207088 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:15:10.207088 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:15:10.207088 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:15:10.207088 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:15:10.207088 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:15:10.207088 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:15:10.207088 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:15:10.207694 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 54/111] 10.222.0.79 () {56 vars in 1096 bytes} [Wed Aug 31 12:15:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:15:10.209748 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d473c954-cc8e-436e-b5e4-057e30ad89d6 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:10.211285 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d473c954-cc8e-436e-b5e4-057e30ad89d6 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:10.211285 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d473c954-cc8e-436e-b5e4-057e30ad89d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:10.237143 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32219517-d134-42db-ab90-20b1b9f41617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:10.239256 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32219517-d134-42db-ab90-20b1b9f41617 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:10.240930 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32219517-d134-42db-ab90-20b1b9f41617 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:10.240930 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32219517-d134-42db-ab90-20b1b9f41617 None admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:10.241813 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32219517-d134-42db-ab90-20b1b9f41617 None admin] RBAC: Adding query filter params (name=member) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:15:10.242427 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32219517-d134-42db-ab90-20b1b9f41617 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:10.245455 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-d473c954-cc8e-436e-b5e4-057e30ad89d6 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:15:10.245743 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32219517-d134-42db-ab90-20b1b9f41617 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:10.247316 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-d473c954-cc8e-436e-b5e4-057e30ad89d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:15:10.253055 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:10.272240 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 58/112] 10.222.0.79 () {56 vars in 1101 bytes} [Wed Aug 31 12:15:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:10.274407 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32219517-d134-42db-ab90-20b1b9f41617 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:10.394997 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 55/113] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:15:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:15:10.394997 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d473c954-cc8e-436e-b5e4-057e30ad89d6 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:10.587299 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32219517-d134-42db-ab90-20b1b9f41617 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:10.592529 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:10.677907 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d473c954-cc8e-436e-b5e4-057e30ad89d6 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:10.727723 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeae8b8-0333-4b07-919f-8baeee1b0936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:10.729225 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeae8b8-0333-4b07-919f-8baeee1b0936 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:10.729960 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeae8b8-0333-4b07-919f-8baeee1b0936 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:10.730704 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeae8b8-0333-4b07-919f-8baeee1b0936 None admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:10.732500 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeae8b8-0333-4b07-919f-8baeee1b0936 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:15:10.733823 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeae8b8-0333-4b07-919f-8baeee1b0936 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:10.738444 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeae8b8-0333-4b07-919f-8baeee1b0936 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:10.771370 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 59/114] 10.222.0.79 () {56 vars in 1101 bytes} [Wed Aug 31 12:15:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 498 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:10.781241 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeae8b8-0333-4b07-919f-8baeee1b0936 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:10.809500 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308de1d0-5a4a-4a8e-9024-fd187a1f2813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:10.811039 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308de1d0-5a4a-4a8e-9024-fd187a1f2813 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:10.811812 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308de1d0-5a4a-4a8e-9024-fd187a1f2813 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:10.812543 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308de1d0-5a4a-4a8e-9024-fd187a1f2813 None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:10.816007 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308de1d0-5a4a-4a8e-9024-fd187a1f2813 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:15:10.816832 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308de1d0-5a4a-4a8e-9024-fd187a1f2813 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:10.821365 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308de1d0-5a4a-4a8e-9024-fd187a1f2813 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:10.855835 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 56/115] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 12:15:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 465 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:10.870580 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d0c01-c01d-4b5b-8578-5fd475a0f7a3 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:10.877931 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d0c01-c01d-4b5b-8578-5fd475a0f7a3 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:10.878879 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d0c01-c01d-4b5b-8578-5fd475a0f7a3 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:10.891042 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 57/116] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:15:10 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:15:10.893009 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d0c01-c01d-4b5b-8578-5fd475a0f7a3 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:10.902565 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:11.115084 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeae8b8-0333-4b07-919f-8baeee1b0936 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:11.156978 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d0c01-c01d-4b5b-8578-5fd475a0f7a3 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:11.168444 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451410e0-572e-4b9a-893a-fb657e23aeef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:11.169598 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451410e0-572e-4b9a-893a-fb657e23aeef None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:11.170309 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451410e0-572e-4b9a-893a-fb657e23aeef None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:11.170796 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451410e0-572e-4b9a-893a-fb657e23aeef None admin] PATH_INFO: `/v3/users/76d206fbf63149e689df0067d9be2dfd` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:11.176345 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451410e0-572e-4b9a-893a-fb657e23aeef None admin] RBAC: Authorizing `identity:get_user(user_id=76d206fbf63149e689df0067d9be2dfd)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:11.179330 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451410e0-572e-4b9a-893a-fb657e23aeef None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:11.182842 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 60/117] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 12:15:10 2022] GET /identity/v3/users/76d206fbf63149e689df0067d9be2dfd => generated 275 bytes in 409 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:11.184862 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451410e0-572e-4b9a-893a-fb657e23aeef None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:11.230836 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e14b48-c66e-443a-b9e7-fbb87097d099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:11.231326 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:11.231983 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e14b48-c66e-443a-b9e7-fbb87097d099 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:11.232466 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e14b48-c66e-443a-b9e7-fbb87097d099 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:11.232961 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e14b48-c66e-443a-b9e7-fbb87097d099 None admin] PATH_INFO: `/v3/users/71903a930c9f4dcbb492c8b3afefd5a3` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:11.263330 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e14b48-c66e-443a-b9e7-fbb87097d099 None admin] RBAC: Authorizing `identity:get_user(user_id=71903a930c9f4dcbb492c8b3afefd5a3)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:11.266234 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e14b48-c66e-443a-b9e7-fbb87097d099 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:11.270914 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 58/118] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 12:15:10 2022] GET /identity/v3/users/71903a930c9f4dcbb492c8b3afefd5a3 => generated 289 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:11.271639 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8358afb-b91b-4785-8a9b-2752caf7571f None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:11.272114 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8358afb-b91b-4785-8a9b-2752caf7571f None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:11.272600 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8358afb-b91b-4785-8a9b-2752caf7571f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:11.307121 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-d8358afb-b91b-4785-8a9b-2752caf7571f None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:15:11.309342 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-d8358afb-b91b-4785-8a9b-2752caf7571f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:15:11.324966 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451410e0-572e-4b9a-893a-fb657e23aeef None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:11.376990 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ad79fe-fdce-4dd1-858f-26dd5599fe95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:11.377504 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad79fe-fdce-4dd1-858f-26dd5599fe95 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:11.377779 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad79fe-fdce-4dd1-858f-26dd5599fe95 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:11.378047 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad79fe-fdce-4dd1-858f-26dd5599fe95 None admin] PATH_INFO: `/v3/users/ba867dda5cc7471abb8f3da6ca94b58a` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:11.379255 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ad79fe-fdce-4dd1-858f-26dd5599fe95 None admin] RBAC: Authorizing `identity:get_user(user_id=ba867dda5cc7471abb8f3da6ca94b58a)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:11.380732 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ad79fe-fdce-4dd1-858f-26dd5599fe95 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:11.382341 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 61/119] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 12:15:11 2022] GET /identity/v3/users/ba867dda5cc7471abb8f3da6ca94b58a => generated 247 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:11.390790 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ad79fe-fdce-4dd1-858f-26dd5599fe95 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:11.428500 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:11.458890 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 59/120] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:15:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:15:11.458890 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8358afb-b91b-4785-8a9b-2752caf7571f None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:11.580652 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8358afb-b91b-4785-8a9b-2752caf7571f None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:11.581821 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:11.589944 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ad79fe-fdce-4dd1-858f-26dd5599fe95 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:11.626250 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ece1bc-de8e-40cc-b171-66728c232cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:11.627168 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ece1bc-de8e-40cc-b171-66728c232cf4 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:11.627467 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ece1bc-de8e-40cc-b171-66728c232cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:11.627870 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ece1bc-de8e-40cc-b171-66728c232cf4 None admin] PATH_INFO: `/v3/projects/79222f00008144bba451b7a2da2da187` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:11.629198 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ece1bc-de8e-40cc-b171-66728c232cf4 None admin] RBAC: Authorizing `identity:get_project(project_id=79222f00008144bba451b7a2da2da187)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:11.630707 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ece1bc-de8e-40cc-b171-66728c232cf4 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:11.632494 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 60/121] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 12:15:11 2022] GET /identity/v3/projects/79222f00008144bba451b7a2da2da187 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:11.633296 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ece1bc-de8e-40cc-b171-66728c232cf4 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:11.682247 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2332fa7-239c-442e-acf4-67b5d9079bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:11.683463 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2332fa7-239c-442e-acf4-67b5d9079bc3 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:11.684040 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2332fa7-239c-442e-acf4-67b5d9079bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:11.684610 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2332fa7-239c-442e-acf4-67b5d9079bc3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:11.710776 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:11.716194 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2332fa7-239c-442e-acf4-67b5d9079bc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:15:11.732292 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-b2332fa7-239c-442e-acf4-67b5d9079bc3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 12:15:11.732292 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:15:11.732292 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:15:11.732292 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:15:11.732292 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:15:11.732292 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:15:11.732292 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:15:11.732292 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:15:11.732292 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:15:11.732292 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:15:11.732292 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:15:11.732292 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:15:11.732292 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:15:11.732292 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:15:11.732292 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:15:11.732292 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:15:11.734448 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:15:11.734448 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:15:11.734448 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:15:11.734448 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:15:11.734448 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:15:11.734448 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:15:11.734448 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:15:11.734448 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:15:11.734448 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:15:11.734448 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:15:11.734448 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:15:11.734448 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:15:11.734448 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:15:11.734448 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:15:11.734448 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:15:11.734448 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:15:11.736293 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:15:11.736293 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:15:11.736293 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:15:11.736293 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:15:11.736293 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:15:11.736293 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:15:11.736293 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:15:11.736293 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:15:11.736293 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:15:11.736293 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:15:11.736293 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 12:15:11.736293 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:15:11.736293 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 62/122] 10.222.0.79 () {56 vars in 1114 bytes} [Wed Aug 31 12:15:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:15:11.736293 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2332fa7-239c-442e-acf4-67b5d9079bc3 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:11.774238 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ece1bc-de8e-40cc-b171-66728c232cf4 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:11.817877 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c34ae3-299a-439c-a430-5914bacec712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:11.818619 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c34ae3-299a-439c-a430-5914bacec712 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:11.818929 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c34ae3-299a-439c-a430-5914bacec712 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:11.819203 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c34ae3-299a-439c-a430-5914bacec712 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:11.910334 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c34ae3-299a-439c-a430-5914bacec712 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:11.911775 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c34ae3-299a-439c-a430-5914bacec712 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:11.999240 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:12.029244 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2332fa7-239c-442e-acf4-67b5d9079bc3 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:12.069689 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c182da66-3d30-4820-8dfe-e1968c4283c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:12.070343 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182da66-3d30-4820-8dfe-e1968c4283c5 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:12.070627 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182da66-3d30-4820-8dfe-e1968c4283c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:12.070938 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182da66-3d30-4820-8dfe-e1968c4283c5 None admin] PATH_INFO: `/v3/projects/79222f00008144bba451b7a2da2da187` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:12.072700 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c182da66-3d30-4820-8dfe-e1968c4283c5 None admin] RBAC: Authorizing `identity:get_project(project_id=79222f00008144bba451b7a2da2da187)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:12.074211 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c182da66-3d30-4820-8dfe-e1968c4283c5 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:12.075958 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 63/123] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 12:15:11 2022] GET /identity/v3/projects/79222f00008144bba451b7a2da2da187 => generated 298 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:12.076725 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c182da66-3d30-4820-8dfe-e1968c4283c5 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:12.091920 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 61/124] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 12:15:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:15:12.092801 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c34ae3-299a-439c-a430-5914bacec712 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:12.125623 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:12.211414 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c34ae3-299a-439c-a430-5914bacec712 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:12.242927 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c182da66-3d30-4820-8dfe-e1968c4283c5 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:12.250901 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6a6f25-1b1d-4b0b-b727-18944abcd18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:12.251526 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a6f25-1b1d-4b0b-b727-18944abcd18f None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:12.251809 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a6f25-1b1d-4b0b-b727-18944abcd18f None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:12.252090 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a6f25-1b1d-4b0b-b727-18944abcd18f None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:12.252778 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6a6f25-1b1d-4b0b-b727-18944abcd18f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:15:12.253084 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6a6f25-1b1d-4b0b-b727-18944abcd18f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:12.254501 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6a6f25-1b1d-4b0b-b727-18944abcd18f None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:12.266524 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 62/125] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 12:15:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:12.267446 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6a6f25-1b1d-4b0b-b727-18944abcd18f None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:12.292374 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba73597a-e0ed-4ff4-beaa-17b20f506f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:12.293507 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73597a-e0ed-4ff4-beaa-17b20f506f66 None admin] REQUEST_METHOD: `PUT` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:12.293996 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73597a-e0ed-4ff4-beaa-17b20f506f66 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:12.294500 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73597a-e0ed-4ff4-beaa-17b20f506f66 None admin] PATH_INFO: `/v3/projects/79222f00008144bba451b7a2da2da187/users/76d206fbf63149e689df0067d9be2dfd/roles/b5cfd7a855a448359e9017f51d32b6fc` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:12.294636 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:12.298219 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba73597a-e0ed-4ff4-beaa-17b20f506f66 None admin] RBAC: Authorizing `identity:create_grant(project_id=79222f00008144bba451b7a2da2da187, user_id=76d206fbf63149e689df0067d9be2dfd, role_id=b5cfd7a855a448359e9017f51d32b6fc)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:12.300974 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba73597a-e0ed-4ff4-beaa-17b20f506f66 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:12.321046 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 64/126] 10.222.0.79 () {58 vars in 1439 bytes} [Wed Aug 31 12:15:12 2022] PUT /identity/v3/projects/79222f00008144bba451b7a2da2da187/users/76d206fbf63149e689df0067d9be2dfd/roles/b5cfd7a855a448359e9017f51d32b6fc => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:15:12.323505 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44363d49-44a4-4159-b003-a1c5358a65f6 None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:12.323801 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44363d49-44a4-4159-b003-a1c5358a65f6 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:12.324088 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44363d49-44a4-4159-b003-a1c5358a65f6 None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:12.325952 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 65/127] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:15:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:15:12.326274 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44363d49-44a4-4159-b003-a1c5358a65f6 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:12.429363 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6a6f25-1b1d-4b0b-b727-18944abcd18f None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:12.472695 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:12.494100 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172e65e8-15f1-4e78-b45c-d13ed5e37c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:12.495063 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e65e8-15f1-4e78-b45c-d13ed5e37c46 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:12.495498 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e65e8-15f1-4e78-b45c-d13ed5e37c46 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:12.495941 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e65e8-15f1-4e78-b45c-d13ed5e37c46 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:12.499737 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44363d49-44a4-4159-b003-a1c5358a65f6 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:12.515649 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172e65e8-15f1-4e78-b45c-d13ed5e37c46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:15:12.526641 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-172e65e8-15f1-4e78-b45c-d13ed5e37c46 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:15:12.526641 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:15:12.526641 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:15:12.526641 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:15:12.526641 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:15:12.526641 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:15:12.526641 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:15:12.526641 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:15:12.526641 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:15:12.526641 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:15:12.526641 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:15:12.526641 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:15:12.526641 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:15:12.526641 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:15:12.526641 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:15:12.526641 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:15:12.527812 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:15:12.527812 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:15:12.527812 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:15:12.527812 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:15:12.527812 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:15:12.527812 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:15:12.527812 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:15:12.527812 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:15:12.527812 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:15:12.527812 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:15:12.527812 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:15:12.527812 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:15:12.527812 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:15:12.527812 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:15:12.527812 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:15:12.527812 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:15:12.528649 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:15:12.528649 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:15:12.528649 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:15:12.528649 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:15:12.528649 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:15:12.528649 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:15:12.528649 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:15:12.528649 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:15:12.528649 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:15:12.528649 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:15:12.528649 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:15:12.528649 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:15:12.528649 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 63/128] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 12:15:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:15:12.529364 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172e65e8-15f1-4e78-b45c-d13ed5e37c46 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:12.558280 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d056b35-fcf0-423c-8a5c-b816ea03632d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:12.559290 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d056b35-fcf0-423c-8a5c-b816ea03632d None admin] REQUEST_METHOD: `PUT` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:12.559746 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d056b35-fcf0-423c-8a5c-b816ea03632d None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:12.560189 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d056b35-fcf0-423c-8a5c-b816ea03632d None admin] PATH_INFO: `/v3/projects/79222f00008144bba451b7a2da2da187/users/ba867dda5cc7471abb8f3da6ca94b58a/roles/a332ef951db949b0bad7019fbd28a1b9` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:12.563429 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d056b35-fcf0-423c-8a5c-b816ea03632d None admin] RBAC: Authorizing `identity:create_grant(project_id=79222f00008144bba451b7a2da2da187, user_id=ba867dda5cc7471abb8f3da6ca94b58a, role_id=a332ef951db949b0bad7019fbd28a1b9)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:12.565874 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d056b35-fcf0-423c-8a5c-b816ea03632d None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:12.587002 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 66/129] 10.222.0.79 () {58 vars in 1439 bytes} [Wed Aug 31 12:15:12 2022] PUT /identity/v3/projects/79222f00008144bba451b7a2da2da187/users/ba867dda5cc7471abb8f3da6ca94b58a/roles/a332ef951db949b0bad7019fbd28a1b9 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:15:12.588526 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d056b35-fcf0-423c-8a5c-b816ea03632d None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:12.691070 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:12.717402 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172e65e8-15f1-4e78-b45c-d13ed5e37c46 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:12.750934 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d056b35-fcf0-423c-8a5c-b816ea03632d None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:12.778562 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a64537-1e51-4cc3-bcc9-cd389b8e099a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:12.779291 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a64537-1e51-4cc3-bcc9-cd389b8e099a None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:12.779577 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a64537-1e51-4cc3-bcc9-cd389b8e099a None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:12.779852 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a64537-1e51-4cc3-bcc9-cd389b8e099a None admin] PATH_INFO: `/v3/projects/79222f00008144bba451b7a2da2da187` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:12.781078 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a64537-1e51-4cc3-bcc9-cd389b8e099a None admin] RBAC: Authorizing `identity:get_project(project_id=79222f00008144bba451b7a2da2da187)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:12.782597 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a64537-1e51-4cc3-bcc9-cd389b8e099a None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:12.784368 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 64/130] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 12:15:12 2022] GET /identity/v3/projects/79222f00008144bba451b7a2da2da187 => generated 298 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:12.785638 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fd0084-d245-4918-b7e6-a1508c87010c None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:12.785974 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fd0084-d245-4918-b7e6-a1508c87010c None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:12.786191 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fd0084-d245-4918-b7e6-a1508c87010c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:12.802544 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c856a5-90ab-41cc-82e3-54a4e9250c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:12.803364 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c856a5-90ab-41cc-82e3-54a4e9250c55 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:12.803653 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c856a5-90ab-41cc-82e3-54a4e9250c55 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:12.803925 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c856a5-90ab-41cc-82e3-54a4e9250c55 None admin] PATH_INFO: `/v3/users/76d206fbf63149e689df0067d9be2dfd` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:12.805380 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c856a5-90ab-41cc-82e3-54a4e9250c55 None admin] RBAC: Authorizing `identity:get_user(user_id=76d206fbf63149e689df0067d9be2dfd)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:12.807099 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c856a5-90ab-41cc-82e3-54a4e9250c55 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:12.809198 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 67/131] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 12:15:12 2022] GET /identity/v3/users/76d206fbf63149e689df0067d9be2dfd => generated 275 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:12.809879 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c856a5-90ab-41cc-82e3-54a4e9250c55 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:12.815869 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-76fd0084-d245-4918-b7e6-a1508c87010c None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:15:12.817460 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-76fd0084-d245-4918-b7e6-a1508c87010c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:15:12.842704 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:12.923609 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 65/132] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:15:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:15:12.924621 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fd0084-d245-4918-b7e6-a1508c87010c None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:13.027657 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c856a5-90ab-41cc-82e3-54a4e9250c55 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:13.096181 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cc6852-b796-4dca-9d6e-e84e09884cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:13.097750 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc6852-b796-4dca-9d6e-e84e09884cc7 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:13.100326 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc6852-b796-4dca-9d6e-e84e09884cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:13.101103 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc6852-b796-4dca-9d6e-e84e09884cc7 None admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:13.102457 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cc6852-b796-4dca-9d6e-e84e09884cc7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:15:13.104816 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cc6852-b796-4dca-9d6e-e84e09884cc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:13.109346 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cc6852-b796-4dca-9d6e-e84e09884cc7 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:13.146948 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 68/133] 10.222.0.79 () {56 vars in 1101 bytes} [Wed Aug 31 12:15:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:13.146948 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cc6852-b796-4dca-9d6e-e84e09884cc7 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:13.155391 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:13.232184 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fd0084-d245-4918-b7e6-a1508c87010c None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:13.312337 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85572a0-567a-4813-b593-4420188f9a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:13.314217 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85572a0-567a-4813-b593-4420188f9a08 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:13.314787 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85572a0-567a-4813-b593-4420188f9a08 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:13.315840 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85572a0-567a-4813-b593-4420188f9a08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:13.317665 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85572a0-567a-4813-b593-4420188f9a08 None admin] RBAC: Adding query filter params (role.id=6a7464b68efb4b3089ce4d0d8d03fdf3, scope.project.id=79222f00008144bba451b7a2da2da187, user.id=71903a930c9f4dcbb492c8b3afefd5a3) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:15:13.318539 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85572a0-567a-4813-b593-4420188f9a08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:13.324425 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85572a0-567a-4813-b593-4420188f9a08 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:13.337317 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 66/134] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 12:15:12 2022] GET /identity/v3/role_assignments?user.id=71903a930c9f4dcbb492c8b3afefd5a3&scope.project.id=79222f00008144bba451b7a2da2da187&role.id=6a7464b68efb4b3089ce4d0d8d03fdf3 => generated 259 bytes in 413 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:13.339274 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:13.339473 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85572a0-567a-4813-b593-4420188f9a08 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:13.346238 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cc6852-b796-4dca-9d6e-e84e09884cc7 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:13.438540 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f587ffdb-c561-49e0-ab83-6e36527080e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:13.439304 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f587ffdb-c561-49e0-ab83-6e36527080e0 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:13.439599 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f587ffdb-c561-49e0-ab83-6e36527080e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:13.439887 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f587ffdb-c561-49e0-ab83-6e36527080e0 None admin] PATH_INFO: `/v3/projects/79222f00008144bba451b7a2da2da187` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:13.448145 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f587ffdb-c561-49e0-ab83-6e36527080e0 None admin] RBAC: Authorizing `identity:get_project(project_id=79222f00008144bba451b7a2da2da187)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:13.451057 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f587ffdb-c561-49e0-ab83-6e36527080e0 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:13.454349 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 69/135] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 12:15:13 2022] GET /identity/v3/projects/79222f00008144bba451b7a2da2da187 => generated 298 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:13.468128 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f587ffdb-c561-49e0-ab83-6e36527080e0 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:13.541566 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85572a0-567a-4813-b593-4420188f9a08 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:13.582042 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d6d029-3092-4f59-a294-a01e938cea46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:13.582604 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d6d029-3092-4f59-a294-a01e938cea46 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:13.582908 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d6d029-3092-4f59-a294-a01e938cea46 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:13.583183 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d6d029-3092-4f59-a294-a01e938cea46 None admin] PATH_INFO: `/v3/users/76d206fbf63149e689df0067d9be2dfd` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:13.584554 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d6d029-3092-4f59-a294-a01e938cea46 None admin] RBAC: Authorizing `identity:get_user(user_id=76d206fbf63149e689df0067d9be2dfd)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:13.586332 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d6d029-3092-4f59-a294-a01e938cea46 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:13.588654 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 67/136] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 12:15:13 2022] GET /identity/v3/users/76d206fbf63149e689df0067d9be2dfd => generated 275 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:13.589538 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d6d029-3092-4f59-a294-a01e938cea46 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:13.605141 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:13.716795 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d6d029-3092-4f59-a294-a01e938cea46 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:13.741576 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f587ffdb-c561-49e0-ab83-6e36527080e0 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:13.764608 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda611f-bec8-41e5-a365-5be0ce2d8f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:13.765710 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda611f-bec8-41e5-a365-5be0ce2d8f74 None admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:13.766175 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda611f-bec8-41e5-a365-5be0ce2d8f74 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:13.766600 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda611f-bec8-41e5-a365-5be0ce2d8f74 None admin] PATH_INFO: `/v3/projects/79222f00008144bba451b7a2da2da187/users/76d206fbf63149e689df0067d9be2dfd/roles/be23fee6ea264172b277f97af30cc689` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:13.781098 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fda611f-bec8-41e5-a365-5be0ce2d8f74 None admin] RBAC: Authorizing `identity:create_grant(project_id=79222f00008144bba451b7a2da2da187, user_id=76d206fbf63149e689df0067d9be2dfd, role_id=be23fee6ea264172b277f97af30cc689)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:13.782814 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fda611f-bec8-41e5-a365-5be0ce2d8f74 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:13.809893 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 68/137] 10.222.0.79 () {58 vars in 1439 bytes} [Wed Aug 31 12:15:13 2022] PUT /identity/v3/projects/79222f00008144bba451b7a2da2da187/users/76d206fbf63149e689df0067d9be2dfd/roles/be23fee6ea264172b277f97af30cc689 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:15:13.810725 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda611f-bec8-41e5-a365-5be0ce2d8f74 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:13.819406 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac2a861-1634-4886-ae6d-de7d7a00cb21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:13.820089 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac2a861-1634-4886-ae6d-de7d7a00cb21 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:13.820414 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac2a861-1634-4886-ae6d-de7d7a00cb21 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:13.826930 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac2a861-1634-4886-ae6d-de7d7a00cb21 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:13.828529 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac2a861-1634-4886-ae6d-de7d7a00cb21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:13.830087 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac2a861-1634-4886-ae6d-de7d7a00cb21 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:13.840484 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 70/138] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:15:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:13.842135 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac2a861-1634-4886-ae6d-de7d7a00cb21 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:13.895295 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:14.041707 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:14.099102 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac2a861-1634-4886-ae6d-de7d7a00cb21 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:14.125099 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda611f-bec8-41e5-a365-5be0ce2d8f74 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:14.206279 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08c222a-b5dd-474d-af78-1721c4034dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:14.207501 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c222a-b5dd-474d-af78-1721c4034dad None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:14.208009 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c222a-b5dd-474d-af78-1721c4034dad None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:14.208497 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c222a-b5dd-474d-af78-1721c4034dad None admin] PATH_INFO: `/v3/projects/8ee31161d5594131a34ea8dcad87d2a1` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:14.211007 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161ab230-3cc6-4b76-91c9-0d795e0e0954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:14.212236 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161ab230-3cc6-4b76-91c9-0d795e0e0954 None admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:14.212748 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161ab230-3cc6-4b76-91c9-0d795e0e0954 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:14.213253 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161ab230-3cc6-4b76-91c9-0d795e0e0954 None admin] PATH_INFO: `/v3/users` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:14.214530 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161ab230-3cc6-4b76-91c9-0d795e0e0954 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:14.216217 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08c222a-b5dd-474d-af78-1721c4034dad None admin] RBAC: Authorizing `identity:get_project(project_id=8ee31161d5594131a34ea8dcad87d2a1)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:14.217363 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161ab230-3cc6-4b76-91c9-0d795e0e0954 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:14.218996 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08c222a-b5dd-474d-af78-1721c4034dad None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:14.222316 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 69/139] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 12:15:13 2022] GET /identity/v3/projects/8ee31161d5594131a34ea8dcad87d2a1 => generated 312 bytes in 412 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:14.229450 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08c222a-b5dd-474d-af78-1721c4034dad None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:14.284014 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 71/140] 10.222.0.79 () {60 vars in 1132 bytes} [Wed Aug 31 12:15:13 2022] POST /identity/v3/users => generated 283 bytes in 442 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:15:14.448761 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08c222a-b5dd-474d-af78-1721c4034dad None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:14.529223 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1b0f9c-ddbe-4b0d-8392-fc46c9def53e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:14.530347 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1b0f9c-ddbe-4b0d-8392-fc46c9def53e None admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:14.530830 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1b0f9c-ddbe-4b0d-8392-fc46c9def53e None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:14.531339 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1b0f9c-ddbe-4b0d-8392-fc46c9def53e None admin] PATH_INFO: `/v3/projects/8ee31161d5594131a34ea8dcad87d2a1/users/76d206fbf63149e689df0067d9be2dfd/roles/b5cfd7a855a448359e9017f51d32b6fc` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:14.540738 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1b0f9c-ddbe-4b0d-8392-fc46c9def53e None admin] RBAC: Authorizing `identity:create_grant(project_id=8ee31161d5594131a34ea8dcad87d2a1, user_id=76d206fbf63149e689df0067d9be2dfd, role_id=b5cfd7a855a448359e9017f51d32b6fc)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:14.543917 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1b0f9c-ddbe-4b0d-8392-fc46c9def53e None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:14.567273 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:14.577631 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 70/141] 10.222.0.79 () {58 vars in 1439 bytes} [Wed Aug 31 12:15:14 2022] PUT /identity/v3/projects/8ee31161d5594131a34ea8dcad87d2a1/users/76d206fbf63149e689df0067d9be2dfd/roles/b5cfd7a855a448359e9017f51d32b6fc => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:15:14.963989 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a95699-0f67-464e-95bc-f6d4a517a241 None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:14.964672 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a95699-0f67-464e-95bc-f6d4a517a241 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:14.964940 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a95699-0f67-464e-95bc-f6d4a517a241 None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:14.967860 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 72/142] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:15:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:15:14.974375 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23952b2-d1d0-47c5-a57d-d2d4d7e3c7ae None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:14.974893 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23952b2-d1d0-47c5-a57d-d2d4d7e3c7ae None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:14.975353 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23952b2-d1d0-47c5-a57d-d2d4d7e3c7ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:15.004436 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-e23952b2-d1d0-47c5-a57d-d2d4d7e3c7ae None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:15:15.006043 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-e23952b2-d1d0-47c5-a57d-d2d4d7e3c7ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:15:15.088345 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 71/143] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:15:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:15:15.379621 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a95699-0f67-464e-95bc-f6d4a517a241 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:15.486593 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:15.552601 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a95699-0f67-464e-95bc-f6d4a517a241 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:15.614950 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f019aecb-5097-4fa7-afd6-1a335dc66d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:15.616035 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019aecb-5097-4fa7-afd6-1a335dc66d0f None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:15.616599 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019aecb-5097-4fa7-afd6-1a335dc66d0f None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:15.617094 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019aecb-5097-4fa7-afd6-1a335dc66d0f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:15.637652 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f019aecb-5097-4fa7-afd6-1a335dc66d0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:15:15.648102 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-f019aecb-5097-4fa7-afd6-1a335dc66d0f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:15:15.648102 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:15:15.648102 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:15:15.648102 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:15:15.648102 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:15:15.648102 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:15:15.648102 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:15:15.648102 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:15:15.648102 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:15:15.648102 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:15:15.648102 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:15:15.648102 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:15:15.648102 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:15:15.648102 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:15:15.648102 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:15:15.648102 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:15:15.648992 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:15:15.648992 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:15:15.648992 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:15:15.648992 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:15:15.648992 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:15:15.648992 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:15:15.648992 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:15:15.648992 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:15:15.648992 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:15:15.648992 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:15:15.648992 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:15:15.648992 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:15:15.648992 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:15:15.648992 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:15:15.648992 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:15:15.648992 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:15:15.649895 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:15:15.649895 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:15:15.649895 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:15:15.649895 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:15:15.649895 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:15:15.649895 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:15:15.649895 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:15:15.649895 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:15:15.649895 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:15:15.649895 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:15:15.649895 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:15:15.649895 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:15:15.650512 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 73/144] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 12:15:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:15:15.659410 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23952b2-d1d0-47c5-a57d-d2d4d7e3c7ae None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:15.802759 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23952b2-d1d0-47c5-a57d-d2d4d7e3c7ae None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:15.861967 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:15.877858 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21daf5f-5c4c-490b-9ce0-624aa640dd73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:15.878948 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21daf5f-5c4c-490b-9ce0-624aa640dd73 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:15.879442 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21daf5f-5c4c-490b-9ce0-624aa640dd73 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:15.879924 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21daf5f-5c4c-490b-9ce0-624aa640dd73 None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:15.881228 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21daf5f-5c4c-490b-9ce0-624aa640dd73 None admin] RBAC: Adding query filter params (name=member) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:15:15.881768 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21daf5f-5c4c-490b-9ce0-624aa640dd73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:15.884925 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21daf5f-5c4c-490b-9ce0-624aa640dd73 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:15.905791 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 72/145] 10.222.0.79 () {56 vars in 1101 bytes} [Wed Aug 31 12:15:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:15.915033 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f019aecb-5097-4fa7-afd6-1a335dc66d0f None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:16.109992 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f019aecb-5097-4fa7-afd6-1a335dc66d0f None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:16.164647 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:16.174762 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c74632-b3b5-481a-a287-5dd5d8f8dc29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:16.175874 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c74632-b3b5-481a-a287-5dd5d8f8dc29 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:16.176363 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c74632-b3b5-481a-a287-5dd5d8f8dc29 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:16.176848 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c74632-b3b5-481a-a287-5dd5d8f8dc29 None admin] PATH_INFO: `/v3/users/76d206fbf63149e689df0067d9be2dfd` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:16.178913 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c74632-b3b5-481a-a287-5dd5d8f8dc29 None admin] RBAC: Authorizing `identity:get_user(user_id=76d206fbf63149e689df0067d9be2dfd)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:16.182319 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c74632-b3b5-481a-a287-5dd5d8f8dc29 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:16.185549 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 74/146] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 12:15:15 2022] GET /identity/v3/users/76d206fbf63149e689df0067d9be2dfd => generated 275 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:16.194989 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21daf5f-5c4c-490b-9ce0-624aa640dd73 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:16.393394 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21daf5f-5c4c-490b-9ce0-624aa640dd73 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:16.434723 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f60a5-c3b0-4064-b0a5-717460d399c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:16.435749 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f60a5-c3b0-4064-b0a5-717460d399c0 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:16.436232 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f60a5-c3b0-4064-b0a5-717460d399c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:16.436703 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f60a5-c3b0-4064-b0a5-717460d399c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:16.512293 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:16.524440 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6f60a5-c3b0-4064-b0a5-717460d399c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:16.527305 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6f60a5-c3b0-4064-b0a5-717460d399c0 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:16.653623 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 73/147] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 12:15:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:15:16.663158 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c74632-b3b5-481a-a287-5dd5d8f8dc29 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:16.830834 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df544254-0aa8-4b74-ad6d-58e9ba047782 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:16.831912 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df544254-0aa8-4b74-ad6d-58e9ba047782 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:16.832404 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df544254-0aa8-4b74-ad6d-58e9ba047782 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:16.839001 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 74/148] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:15:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:15:16.851446 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e97a1-7a11-4363-961c-0c0bddf098e2 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:16.852094 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e97a1-7a11-4363-961c-0c0bddf098e2 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:16.852570 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e97a1-7a11-4363-961c-0c0bddf098e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:16.893158 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-670e97a1-7a11-4363-961c-0c0bddf098e2 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:15:16.894750 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-670e97a1-7a11-4363-961c-0c0bddf098e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:15:16.920394 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c74632-b3b5-481a-a287-5dd5d8f8dc29 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:16.995198 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75f8c06-3bcf-4118-a5af-38cb6be67770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:16.996275 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f8c06-3bcf-4118-a5af-38cb6be67770 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:16.996739 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f8c06-3bcf-4118-a5af-38cb6be67770 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:16.997237 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f8c06-3bcf-4118-a5af-38cb6be67770 None admin] PATH_INFO: `/v3/projects/79222f00008144bba451b7a2da2da187` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:16.999415 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75f8c06-3bcf-4118-a5af-38cb6be67770 None admin] RBAC: Authorizing `identity:get_project(project_id=79222f00008144bba451b7a2da2da187)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:17.002204 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75f8c06-3bcf-4118-a5af-38cb6be67770 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:17.013798 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 75/149] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 12:15:16 2022] GET /identity/v3/projects/79222f00008144bba451b7a2da2da187 => generated 298 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:17.018185 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75f8c06-3bcf-4118-a5af-38cb6be67770 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:17.019141 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 75/150] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:15:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:15:17.184860 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:17.269786 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75f8c06-3bcf-4118-a5af-38cb6be67770 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:17.343827 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb07318-b926-4eb2-9d13-47c8f4ad65a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:17.344897 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb07318-b926-4eb2-9d13-47c8f4ad65a3 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:17.345398 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb07318-b926-4eb2-9d13-47c8f4ad65a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:17.345887 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb07318-b926-4eb2-9d13-47c8f4ad65a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:17.347339 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb07318-b926-4eb2-9d13-47c8f4ad65a3 None admin] RBAC: Adding query filter params (role.id=b5cfd7a855a448359e9017f51d32b6fc, scope.project.id=79222f00008144bba451b7a2da2da187, user.id=76d206fbf63149e689df0067d9be2dfd) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:15:17.347870 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb07318-b926-4eb2-9d13-47c8f4ad65a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:17.352849 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb07318-b926-4eb2-9d13-47c8f4ad65a3 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:17.367770 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 76/151] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 12:15:17 2022] GET /identity/v3/role_assignments?user.id=76d206fbf63149e689df0067d9be2dfd&scope.project.id=79222f00008144bba451b7a2da2da187&role.id=b5cfd7a855a448359e9017f51d32b6fc => generated 608 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:17.549969 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe9698-f5c7-4221-b71e-46aacefe1a7d None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:17.550456 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe9698-f5c7-4221-b71e-46aacefe1a7d None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:17.550988 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe9698-f5c7-4221-b71e-46aacefe1a7d None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:17.553614 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 76/152] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:15:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:15:17.562280 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9fc2a3-8c0e-483b-96e9-26b85ed0a866 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:17.562784 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9fc2a3-8c0e-483b-96e9-26b85ed0a866 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:17.563322 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9fc2a3-8c0e-483b-96e9-26b85ed0a866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:17.607701 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-fa9fc2a3-8c0e-483b-96e9-26b85ed0a866 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:15:17.609859 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-fa9fc2a3-8c0e-483b-96e9-26b85ed0a866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:15:17.785262 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 77/153] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:15:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:15:17.803944 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fe9698-f5c7-4221-b71e-46aacefe1a7d None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:17.859483 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:18.072429 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fe9698-f5c7-4221-b71e-46aacefe1a7d None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:18.150773 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cbe793-70d6-48c4-b1f0-d8332189709f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:18.151475 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cbe793-70d6-48c4-b1f0-d8332189709f None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:18.151760 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cbe793-70d6-48c4-b1f0-d8332189709f None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:18.152200 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cbe793-70d6-48c4-b1f0-d8332189709f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:18.179204 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cbe793-70d6-48c4-b1f0-d8332189709f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:15:18.186165 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-87cbe793-70d6-48c4-b1f0-d8332189709f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:15:18.186165 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:15:18.186165 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:15:18.186165 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:15:18.186165 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:15:18.186165 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:15:18.186165 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:15:18.186165 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:15:18.186165 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:15:18.186165 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:15:18.186165 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:15:18.186165 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:15:18.186165 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:15:18.186165 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:15:18.186165 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:15:18.186165 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:15:18.187217 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:15:18.187217 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:15:18.187217 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:15:18.187217 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:15:18.187217 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:15:18.187217 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:15:18.187217 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:15:18.187217 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:15:18.187217 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:15:18.187217 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:15:18.187217 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:15:18.187217 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:15:18.187217 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:15:18.187217 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:15:18.187217 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:15:18.187217 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:15:18.187999 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:15:18.187999 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:15:18.187999 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:15:18.187999 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:15:18.187999 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:15:18.187999 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:15:18.187999 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:15:18.187999 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:15:18.187999 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:15:18.187999 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:15:18.187999 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:15:18.187999 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:15:18.188590 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 77/154] 10.222.0.79 () {56 vars in 1096 bytes} [Wed Aug 31 12:15:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 385 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:15:18.195725 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9fc2a3-8c0e-483b-96e9-26b85ed0a866 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:18.367400 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:18.460723 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9fc2a3-8c0e-483b-96e9-26b85ed0a866 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:18.515440 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574cb252-689d-4a49-9f76-2150902b9f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:18.516454 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574cb252-689d-4a49-9f76-2150902b9f16 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:18.516958 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574cb252-689d-4a49-9f76-2150902b9f16 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:18.517466 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574cb252-689d-4a49-9f76-2150902b9f16 None admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:18.518379 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574cb252-689d-4a49-9f76-2150902b9f16 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:15:18.518990 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574cb252-689d-4a49-9f76-2150902b9f16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:18.520654 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574cb252-689d-4a49-9f76-2150902b9f16 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:18.535447 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 78/155] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 12:15:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:18.544695 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cbe793-70d6-48c4-b1f0-d8332189709f None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:18.661126 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574cb252-689d-4a49-9f76-2150902b9f16 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:18.771364 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:18.833026 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cbe793-70d6-48c4-b1f0-d8332189709f None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:18.938172 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742b3786-bdf0-449a-b9be-a9026e02f920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:18.939153 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b3786-bdf0-449a-b9be-a9026e02f920 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:18.939153 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b3786-bdf0-449a-b9be-a9026e02f920 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:18.939373 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b3786-bdf0-449a-b9be-a9026e02f920 None admin] PATH_INFO: `/v3/users/ba867dda5cc7471abb8f3da6ca94b58a` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:18.943967 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742b3786-bdf0-449a-b9be-a9026e02f920 None admin] RBAC: Authorizing `identity:get_user(user_id=ba867dda5cc7471abb8f3da6ca94b58a)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:18.945541 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742b3786-bdf0-449a-b9be-a9026e02f920 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:18.947780 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 78/156] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 12:15:18 2022] GET /identity/v3/users/ba867dda5cc7471abb8f3da6ca94b58a => generated 247 bytes in 404 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:18.951150 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574cb252-689d-4a49-9f76-2150902b9f16 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:18.954182 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742b3786-bdf0-449a-b9be-a9026e02f920 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:18.996985 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:19.027752 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e95a5b2-25da-449f-abd8-88682879c705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:19.028489 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e95a5b2-25da-449f-abd8-88682879c705 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:19.028788 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e95a5b2-25da-449f-abd8-88682879c705 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:19.031730 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e95a5b2-25da-449f-abd8-88682879c705 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:19.052162 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e95a5b2-25da-449f-abd8-88682879c705 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:15:19.060162 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-4e95a5b2-25da-449f-abd8-88682879c705 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 12:15:19.060162 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:15:19.060162 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:15:19.060162 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:15:19.060162 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:15:19.060162 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:15:19.060162 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:15:19.060162 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:15:19.060162 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:15:19.060162 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:15:19.060162 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:15:19.060162 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:15:19.060162 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:15:19.060162 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:15:19.060162 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:15:19.060162 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:15:19.062001 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:15:19.062001 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:15:19.062001 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:15:19.062001 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:15:19.062001 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:15:19.062001 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:15:19.062001 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:15:19.062001 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:15:19.062001 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:15:19.062001 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:15:19.062001 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:15:19.062001 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:15:19.062001 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:15:19.062001 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:15:19.062001 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:15:19.062001 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:15:19.063625 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:15:19.063625 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:15:19.063625 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:15:19.063625 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:15:19.063625 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:15:19.063625 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:15:19.063625 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:15:19.063625 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:15:19.063625 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:15:19.063625 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:15:19.063625 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 12:15:19.063625 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:15:19.067153 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 79/157] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 12:15:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 401 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:15:19.070220 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e95a5b2-25da-449f-abd8-88682879c705 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:19.191551 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742b3786-bdf0-449a-b9be-a9026e02f920 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:19.244385 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2950d931-29f0-4f56-acd7-089b2fbb08a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:19.245256 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950d931-29f0-4f56-acd7-089b2fbb08a2 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:19.245541 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950d931-29f0-4f56-acd7-089b2fbb08a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:19.245817 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950d931-29f0-4f56-acd7-089b2fbb08a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:19.277369 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e95a5b2-25da-449f-abd8-88682879c705 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:19.286206 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:19.319518 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baa23b2-c3f3-4176-92f3-0e74f5476db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:19.320159 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa23b2-c3f3-4176-92f3-0e74f5476db7 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:19.320457 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa23b2-c3f3-4176-92f3-0e74f5476db7 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:19.320705 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa23b2-c3f3-4176-92f3-0e74f5476db7 None admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:19.321444 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baa23b2-c3f3-4176-92f3-0e74f5476db7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:15:19.322304 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baa23b2-c3f3-4176-92f3-0e74f5476db7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:19.324212 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baa23b2-c3f3-4176-92f3-0e74f5476db7 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:19.334268 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 80/158] 10.222.0.79 () {56 vars in 1101 bytes} [Wed Aug 31 12:15:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:15:19.336012 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f6c5e4-1b6a-4eda-bbea-02d6dddcf9a1 None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:19.336392 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f6c5e4-1b6a-4eda-bbea-02d6dddcf9a1 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:19.336679 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f6c5e4-1b6a-4eda-bbea-02d6dddcf9a1 None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:19.339365 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 81/159] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:15:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:15:19.344912 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f6c5e4-1b6a-4eda-bbea-02d6dddcf9a1 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:19.391875 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2950d931-29f0-4f56-acd7-089b2fbb08a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:19.393408 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2950d931-29f0-4f56-acd7-089b2fbb08a2 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:19.468247 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:19.536692 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 79/160] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 12:15:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 583 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 12:15:19.538099 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f863fda8-b4f2-460b-832e-c065717ea1b9 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:19.538386 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f863fda8-b4f2-460b-832e-c065717ea1b9 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:19.543390 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f863fda8-b4f2-460b-832e-c065717ea1b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:19.564801 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-f863fda8-b4f2-460b-832e-c065717ea1b9 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:15:19.566010 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-f863fda8-b4f2-460b-832e-c065717ea1b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:15:19.631445 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:19.644025 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 80/161] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:15:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:15:19.649338 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f6c5e4-1b6a-4eda-bbea-02d6dddcf9a1 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:19.654902 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3874db0f-ca42-4b76-8292-bc790c386931 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:19.654902 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3874db0f-ca42-4b76-8292-bc790c386931 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:19.654902 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3874db0f-ca42-4b76-8292-bc790c386931 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:19.654902 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 81/162] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:15:19 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:15:19.654902 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3874db0f-ca42-4b76-8292-bc790c386931 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:19.744217 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c192b79-8c66-4b7b-88dd-f985c409a112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:19.745031 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c192b79-8c66-4b7b-88dd-f985c409a112 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:19.745275 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c192b79-8c66-4b7b-88dd-f985c409a112 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:19.745849 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c192b79-8c66-4b7b-88dd-f985c409a112 None admin] PATH_INFO: `/v3/users/71903a930c9f4dcbb492c8b3afefd5a3` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:19.748541 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c192b79-8c66-4b7b-88dd-f985c409a112 None admin] RBAC: Authorizing `identity:get_user(user_id=71903a930c9f4dcbb492c8b3afefd5a3)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:19.750406 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c192b79-8c66-4b7b-88dd-f985c409a112 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:19.752138 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 82/163] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 12:15:19 2022] GET /identity/v3/users/71903a930c9f4dcbb492c8b3afefd5a3 => generated 289 bytes in 408 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:19.756128 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ab711-b46d-4f81-bc63-88c72956fcce None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:19.757157 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ab711-b46d-4f81-bc63-88c72956fcce None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:19.757441 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ab711-b46d-4f81-bc63-88c72956fcce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:19.797548 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-e70ab711-b46d-4f81-bc63-88c72956fcce None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:15:19.798781 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-e70ab711-b46d-4f81-bc63-88c72956fcce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:15:19.846550 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3874db0f-ca42-4b76-8292-bc790c386931 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:19.928227 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe56b33e-076a-4c41-8308-1fef96e6c6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:19.929636 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56b33e-076a-4c41-8308-1fef96e6c6ed None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:19.929919 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56b33e-076a-4c41-8308-1fef96e6c6ed None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:19.930181 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56b33e-076a-4c41-8308-1fef96e6c6ed None admin] PATH_INFO: `/v3/projects/79222f00008144bba451b7a2da2da187` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:19.932752 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe56b33e-076a-4c41-8308-1fef96e6c6ed None admin] RBAC: Authorizing `identity:get_project(project_id=79222f00008144bba451b7a2da2da187)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:19.934493 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe56b33e-076a-4c41-8308-1fef96e6c6ed None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:19.943783 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 82/164] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 12:15:19 2022] GET /identity/v3/projects/79222f00008144bba451b7a2da2da187 => generated 298 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:19.945248 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfaaec1-6c55-4913-ac11-a63071f02ca8 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:19.947766 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfaaec1-6c55-4913-ac11-a63071f02ca8 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:19.948083 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfaaec1-6c55-4913-ac11-a63071f02ca8 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:19.949768 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 83/165] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:15:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:15:19.952775 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 83/166] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:15:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:15:19.953133 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfaaec1-6c55-4913-ac11-a63071f02ca8 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:19.955763 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70ab711-b46d-4f81-bc63-88c72956fcce None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:20.017861 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:20.084033 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfaaec1-6c55-4913-ac11-a63071f02ca8 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:20.117967 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:20.125583 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbeb35e-f0fa-46f8-9577-54413be846d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:20.126241 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbeb35e-f0fa-46f8-9577-54413be846d6 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:20.126519 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbeb35e-f0fa-46f8-9577-54413be846d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:20.126791 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbeb35e-f0fa-46f8-9577-54413be846d6 None admin] PATH_INFO: `/v3/projects/79222f00008144bba451b7a2da2da187` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:20.127989 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbeb35e-f0fa-46f8-9577-54413be846d6 None admin] RBAC: Authorizing `identity:get_project(project_id=79222f00008144bba451b7a2da2da187)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:20.129631 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbeb35e-f0fa-46f8-9577-54413be846d6 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:20.132488 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 84/167] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 12:15:19 2022] GET /identity/v3/projects/79222f00008144bba451b7a2da2da187 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:20.134631 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1302ec-da0f-4c7b-8abe-3289c61ecae1 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:20.134882 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1302ec-da0f-4c7b-8abe-3289c61ecae1 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:20.135075 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1302ec-da0f-4c7b-8abe-3289c61ecae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:20.157272 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-6a1302ec-da0f-4c7b-8abe-3289c61ecae1 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:15:20.158497 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-6a1302ec-da0f-4c7b-8abe-3289c61ecae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:15:20.243052 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 85/168] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:15:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:15:20.244780 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1302ec-da0f-4c7b-8abe-3289c61ecae1 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:20.302087 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:20.377658 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1302ec-da0f-4c7b-8abe-3289c61ecae1 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:20.422289 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70ab711-b46d-4f81-bc63-88c72956fcce None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:20.426680 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe0087e-e253-40af-99b7-fbb07b689949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:20.427639 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe0087e-e253-40af-99b7-fbb07b689949 None admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:20.428064 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe0087e-e253-40af-99b7-fbb07b689949 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:20.428475 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe0087e-e253-40af-99b7-fbb07b689949 None admin] PATH_INFO: `/v3/projects/79222f00008144bba451b7a2da2da187/users/71903a930c9f4dcbb492c8b3afefd5a3/roles/6a7464b68efb4b3089ce4d0d8d03fdf3` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:20.430893 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe0087e-e253-40af-99b7-fbb07b689949 None admin] RBAC: Authorizing `identity:create_grant(project_id=79222f00008144bba451b7a2da2da187, user_id=71903a930c9f4dcbb492c8b3afefd5a3, role_id=6a7464b68efb4b3089ce4d0d8d03fdf3)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:20.433944 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe0087e-e253-40af-99b7-fbb07b689949 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:20.453387 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 86/169] 10.222.0.79 () {58 vars in 1439 bytes} [Wed Aug 31 12:15:20 2022] PUT /identity/v3/projects/79222f00008144bba451b7a2da2da187/users/71903a930c9f4dcbb492c8b3afefd5a3/roles/6a7464b68efb4b3089ce4d0d8d03fdf3 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:15:20.454575 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe0087e-e253-40af-99b7-fbb07b689949 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:20.562410 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f2e579-aaaa-4ac1-97fa-32ae46d2a2df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:20.563654 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f2e579-aaaa-4ac1-97fa-32ae46d2a2df None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:20.564761 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f2e579-aaaa-4ac1-97fa-32ae46d2a2df None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:20.565545 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f2e579-aaaa-4ac1-97fa-32ae46d2a2df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:20.567874 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f2e579-aaaa-4ac1-97fa-32ae46d2a2df None admin] RBAC: Adding query filter params (role.id=a332ef951db949b0bad7019fbd28a1b9, scope.project.id=79222f00008144bba451b7a2da2da187, user.id=ba867dda5cc7471abb8f3da6ca94b58a) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:15:20.568342 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f2e579-aaaa-4ac1-97fa-32ae46d2a2df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:20.579389 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f2e579-aaaa-4ac1-97fa-32ae46d2a2df None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:20.593648 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 84/170] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 12:15:19 2022] GET /identity/v3/role_assignments?user.id=ba867dda5cc7471abb8f3da6ca94b58a&scope.project.id=79222f00008144bba451b7a2da2da187&role.id=a332ef951db949b0bad7019fbd28a1b9 => generated 608 bytes in 638 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:15:20.596702 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb0d69-c518-4781-bb0d-ac7dc8d8effe None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:20.598013 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb0d69-c518-4781-bb0d-ac7dc8d8effe None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:20.598488 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb0d69-c518-4781-bb0d-ac7dc8d8effe None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:20.601494 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 85/171] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:15:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:15:20.610870 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74477f19-4a62-494b-8288-7d4caffb7a14 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:20.611467 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74477f19-4a62-494b-8288-7d4caffb7a14 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:20.611908 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74477f19-4a62-494b-8288-7d4caffb7a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:20.658350 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-74477f19-4a62-494b-8288-7d4caffb7a14 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:15:20.663663 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-74477f19-4a62-494b-8288-7d4caffb7a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:15:20.718704 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe0087e-e253-40af-99b7-fbb07b689949 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:20.723343 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:20.799390 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e8a2ad-c365-4e47-91eb-717f827a39c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:20.800077 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8a2ad-c365-4e47-91eb-717f827a39c8 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:20.800354 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8a2ad-c365-4e47-91eb-717f827a39c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:20.800622 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8a2ad-c365-4e47-91eb-717f827a39c8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:20.820279 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 86/172] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:15:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:15:20.821060 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74477f19-4a62-494b-8288-7d4caffb7a14 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:20.828813 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e8a2ad-c365-4e47-91eb-717f827a39c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:15:20.839301 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-04e8a2ad-c365-4e47-91eb-717f827a39c8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:15:20.839301 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:15:20.839301 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:15:20.839301 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:15:20.839301 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:15:20.839301 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:15:20.839301 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:15:20.839301 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:15:20.839301 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:15:20.839301 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:15:20.839301 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:15:20.839301 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:15:20.839301 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:15:20.839301 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:15:20.839301 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:15:20.839301 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:15:20.841025 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:15:20.841025 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:15:20.841025 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:15:20.841025 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:15:20.841025 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:15:20.841025 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:15:20.841025 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:15:20.841025 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:15:20.841025 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:15:20.841025 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:15:20.841025 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:15:20.841025 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:15:20.841025 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:15:20.841025 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:15:20.841025 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:15:20.841025 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:15:20.842703 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:15:20.842703 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:15:20.842703 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:15:20.842703 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:15:20.842703 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:15:20.842703 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:15:20.842703 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:15:20.842703 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:15:20.842703 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:15:20.842703 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:15:20.842703 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:15:20.842703 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:15:20.842703 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 87/173] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 12:15:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 387 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:15:20.850342 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e8a2ad-c365-4e47-91eb-717f827a39c8 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:20.937191 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:21.021753 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e8a2ad-c365-4e47-91eb-717f827a39c8 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:21.028467 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74477f19-4a62-494b-8288-7d4caffb7a14 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:21.078888 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5954c54-2883-4ae2-8131-304c85bcbf83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:21.079435 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5954c54-2883-4ae2-8131-304c85bcbf83 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:21.079717 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5954c54-2883-4ae2-8131-304c85bcbf83 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:21.079989 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5954c54-2883-4ae2-8131-304c85bcbf83 None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:21.080689 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5954c54-2883-4ae2-8131-304c85bcbf83 None admin] RBAC: Adding query filter params (name=member) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:15:21.080994 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5954c54-2883-4ae2-8131-304c85bcbf83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:21.081379 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c245dc2-4841-4c12-bd25-baf21696089d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:21.082421 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c245dc2-4841-4c12-bd25-baf21696089d None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:21.082544 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5954c54-2883-4ae2-8131-304c85bcbf83 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:21.083084 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c245dc2-4841-4c12-bd25-baf21696089d None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:21.083661 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c245dc2-4841-4c12-bd25-baf21696089d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:21.095322 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 88/174] 10.222.0.79 () {56 vars in 1101 bytes} [Wed Aug 31 12:15:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:21.097045 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c9e28-ae00-4817-841f-b3c1221ce3d0 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:21.097367 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c9e28-ae00-4817-841f-b3c1221ce3d0 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:21.097624 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c9e28-ae00-4817-841f-b3c1221ce3d0 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:21.103911 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 89/175] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:15:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:15:21.103911 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21c9e28-ae00-4817-841f-b3c1221ce3d0 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:21.108190 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c245dc2-4841-4c12-bd25-baf21696089d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:15:21.115378 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-8c245dc2-4841-4c12-bd25-baf21696089d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 12:15:21.115378 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:15:21.115378 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:15:21.115378 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:15:21.115378 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:15:21.115378 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:15:21.115378 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:15:21.115378 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:15:21.115378 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:15:21.115378 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:15:21.115378 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:15:21.115378 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:15:21.115378 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:15:21.115378 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:15:21.115378 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:15:21.115378 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:15:21.116331 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:15:21.116331 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:15:21.116331 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:15:21.116331 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:15:21.116331 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:15:21.116331 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:15:21.116331 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:15:21.116331 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:15:21.116331 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:15:21.116331 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:15:21.116331 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:15:21.116331 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:15:21.116331 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:15:21.116331 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:15:21.116331 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:15:21.116331 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:15:21.117209 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:15:21.117209 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:15:21.117209 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:15:21.117209 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:15:21.117209 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:15:21.117209 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:15:21.117209 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:15:21.117209 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:15:21.117209 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:15:21.117209 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:15:21.117209 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 12:15:21.117209 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:15:21.117209 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 87/176] 10.222.0.79 () {56 vars in 1114 bytes} [Wed Aug 31 12:15:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:15:21.120483 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde79c2-df31-46f6-8181-7890a33e837c None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:21.121062 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde79c2-df31-46f6-8181-7890a33e837c None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:21.121647 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde79c2-df31-46f6-8181-7890a33e837c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:21.144556 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-8dde79c2-df31-46f6-8181-7890a33e837c None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:15:21.146587 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-8dde79c2-df31-46f6-8181-7890a33e837c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:15:21.148670 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:21.238153 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 88/177] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:15:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:15:21.239131 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dde79c2-df31-46f6-8181-7890a33e837c None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:21.270228 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21c9e28-ae00-4817-841f-b3c1221ce3d0 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:21.270764 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:21.316393 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261aaaca-0584-49bb-b6f1-4f8f5f4a1eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:21.317154 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261aaaca-0584-49bb-b6f1-4f8f5f4a1eef None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:21.317589 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261aaaca-0584-49bb-b6f1-4f8f5f4a1eef None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:21.317829 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261aaaca-0584-49bb-b6f1-4f8f5f4a1eef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:21.331306 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261aaaca-0584-49bb-b6f1-4f8f5f4a1eef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:15:21.337867 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-261aaaca-0584-49bb-b6f1-4f8f5f4a1eef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:15:21.337867 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:15:21.337867 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:15:21.337867 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:15:21.337867 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:15:21.337867 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:15:21.337867 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:15:21.337867 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:15:21.337867 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:15:21.337867 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:15:21.337867 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:15:21.337867 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:15:21.337867 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:15:21.337867 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:15:21.337867 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:15:21.337867 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:15:21.339061 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:15:21.339061 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:15:21.339061 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:15:21.339061 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:15:21.339061 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:15:21.339061 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:15:21.339061 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:15:21.339061 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:15:21.339061 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:15:21.339061 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:15:21.339061 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:15:21.339061 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:15:21.339061 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:15:21.339061 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:15:21.339061 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:15:21.339061 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:15:21.340004 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:15:21.340004 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:15:21.340004 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:15:21.340004 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:15:21.340004 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:15:21.340004 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:15:21.340004 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:15:21.340004 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:15:21.340004 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:15:21.340004 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:15:21.340004 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:15:21.340004 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:15:21.340004 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 90/178] 10.222.0.79 () {56 vars in 1096 bytes} [Wed Aug 31 12:15:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:15:21.340673 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261aaaca-0584-49bb-b6f1-4f8f5f4a1eef None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:21.391049 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dde79c2-df31-46f6-8181-7890a33e837c None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:21.435693 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347b7f3f-dbc2-4d52-8697-4427346b5af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:21.437349 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347b7f3f-dbc2-4d52-8697-4427346b5af6 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:21.438786 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347b7f3f-dbc2-4d52-8697-4427346b5af6 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:21.439256 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347b7f3f-dbc2-4d52-8697-4427346b5af6 None admin] PATH_INFO: `/v3/users/76d206fbf63149e689df0067d9be2dfd` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:21.443384 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347b7f3f-dbc2-4d52-8697-4427346b5af6 None admin] RBAC: Authorizing `identity:get_user(user_id=76d206fbf63149e689df0067d9be2dfd)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:21.445743 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347b7f3f-dbc2-4d52-8697-4427346b5af6 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:21.449388 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 89/179] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 12:15:21 2022] GET /identity/v3/users/76d206fbf63149e689df0067d9be2dfd => generated 275 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:21.450544 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347b7f3f-dbc2-4d52-8697-4427346b5af6 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:21.462812 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:21.487607 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261aaaca-0584-49bb-b6f1-4f8f5f4a1eef None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:21.547808 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aef37a-8804-4078-9c56-d3653b3262db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:21.549682 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aef37a-8804-4078-9c56-d3653b3262db None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:21.550203 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aef37a-8804-4078-9c56-d3653b3262db None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:21.550688 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aef37a-8804-4078-9c56-d3653b3262db None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:21.552277 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aef37a-8804-4078-9c56-d3653b3262db None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:15:21.552825 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aef37a-8804-4078-9c56-d3653b3262db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:21.556146 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aef37a-8804-4078-9c56-d3653b3262db None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:21.566486 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 91/180] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 12:15:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:21.567796 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aef37a-8804-4078-9c56-d3653b3262db None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:21.604490 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:21.620220 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347b7f3f-dbc2-4d52-8697-4427346b5af6 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:21.663303 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d2bc5-9cd7-4b74-94ea-53872ea8bb0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:21.664159 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d2bc5-9cd7-4b74-94ea-53872ea8bb0b None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:21.664548 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d2bc5-9cd7-4b74-94ea-53872ea8bb0b None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:21.665960 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d2bc5-9cd7-4b74-94ea-53872ea8bb0b None admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:21.666816 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9d2bc5-9cd7-4b74-94ea-53872ea8bb0b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:15:21.667278 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9d2bc5-9cd7-4b74-94ea-53872ea8bb0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:21.668786 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9d2bc5-9cd7-4b74-94ea-53872ea8bb0b None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:21.679872 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 90/181] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 12:15:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:21.681501 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d2bc5-9cd7-4b74-94ea-53872ea8bb0b None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:21.761452 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aef37a-8804-4078-9c56-d3653b3262db None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:21.807587 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5339d9-afed-4901-a77c-b56b92ac22b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:21.808428 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5339d9-afed-4901-a77c-b56b92ac22b4 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:21.808837 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5339d9-afed-4901-a77c-b56b92ac22b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:21.809288 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5339d9-afed-4901-a77c-b56b92ac22b4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:21.824287 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5339d9-afed-4901-a77c-b56b92ac22b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:15:21.834578 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-6d5339d9-afed-4901-a77c-b56b92ac22b4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 12:15:21.834578 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:15:21.834578 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:15:21.834578 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:15:21.834578 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:15:21.834578 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:15:21.834578 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:15:21.834578 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:15:21.834578 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:15:21.834578 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:15:21.834578 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:15:21.834578 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:15:21.834578 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:15:21.834578 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:15:21.834578 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:15:21.834578 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:15:21.836682 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:15:21.836682 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:15:21.836682 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:15:21.836682 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:15:21.836682 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:15:21.836682 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:15:21.836682 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:15:21.836682 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:15:21.836682 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:15:21.836682 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:15:21.836682 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:15:21.836682 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:15:21.836682 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:15:21.836682 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:15:21.836682 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:15:21.836682 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:15:21.839077 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:15:21.839077 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:15:21.839077 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:15:21.839077 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:15:21.839077 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:15:21.839077 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:15:21.839077 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:15:21.839077 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:15:21.839077 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:15:21.839077 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:15:21.839077 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 12:15:21.839077 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:15:21.839077 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 92/182] 10.222.0.79 () {56 vars in 1114 bytes} [Wed Aug 31 12:15:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:15:21.839077 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5339d9-afed-4901-a77c-b56b92ac22b4 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:21.860104 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:21.879704 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d2bc5-9cd7-4b74-94ea-53872ea8bb0b None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:21.940117 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebc82bc-2fac-4dbe-afa4-1b9522b40acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:21.941535 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebc82bc-2fac-4dbe-afa4-1b9522b40acd None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:21.942234 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebc82bc-2fac-4dbe-afa4-1b9522b40acd None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:21.943252 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebc82bc-2fac-4dbe-afa4-1b9522b40acd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:21.995178 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:21.997330 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5339d9-afed-4901-a77c-b56b92ac22b4 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:22.040615 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552302bc-9fc0-4888-844b-bdc5258713de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:22.041663 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552302bc-9fc0-4888-844b-bdc5258713de None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:22.042027 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552302bc-9fc0-4888-844b-bdc5258713de None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:22.042220 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552302bc-9fc0-4888-844b-bdc5258713de None admin] PATH_INFO: `/v3/users/76d206fbf63149e689df0067d9be2dfd` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:22.043494 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552302bc-9fc0-4888-844b-bdc5258713de None admin] RBAC: Authorizing `identity:get_user(user_id=76d206fbf63149e689df0067d9be2dfd)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:22.044989 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552302bc-9fc0-4888-844b-bdc5258713de None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:22.046988 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 93/183] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 12:15:21 2022] GET /identity/v3/users/76d206fbf63149e689df0067d9be2dfd => generated 275 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:22.053482 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552302bc-9fc0-4888-844b-bdc5258713de None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:22.081973 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebc82bc-2fac-4dbe-afa4-1b9522b40acd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:22.084996 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebc82bc-2fac-4dbe-afa4-1b9522b40acd None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:22.199694 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:22.245427 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552302bc-9fc0-4888-844b-bdc5258713de None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:22.269629 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 91/184] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 12:15:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 585 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:15:22.269629 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebc82bc-2fac-4dbe-afa4-1b9522b40acd None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:22.309623 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532a3327-9380-48db-9ef2-3282bf80c427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:22.311190 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a3327-9380-48db-9ef2-3282bf80c427 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:22.311464 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a3327-9380-48db-9ef2-3282bf80c427 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:22.311795 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a3327-9380-48db-9ef2-3282bf80c427 None admin] PATH_INFO: `/v3/users/d7da81fe1a1e486eb2f8d911a1dc1775` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:22.330746 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532a3327-9380-48db-9ef2-3282bf80c427 None admin] RBAC: Authorizing `identity:get_user(user_id=d7da81fe1a1e486eb2f8d911a1dc1775)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:22.332994 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532a3327-9380-48db-9ef2-3282bf80c427 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:22.338896 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 94/185] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 12:15:22 2022] GET /identity/v3/users/d7da81fe1a1e486eb2f8d911a1dc1775 => generated 283 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:22.340094 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532a3327-9380-48db-9ef2-3282bf80c427 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:22.346897 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:22.424352 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebc82bc-2fac-4dbe-afa4-1b9522b40acd None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:22.492057 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e7f269-f45b-4932-9d06-dd13c8c43cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:22.492978 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e7f269-f45b-4932-9d06-dd13c8c43cc5 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:22.494392 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e7f269-f45b-4932-9d06-dd13c8c43cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:22.494828 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e7f269-f45b-4932-9d06-dd13c8c43cc5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:22.497061 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e7f269-f45b-4932-9d06-dd13c8c43cc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:22.499966 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e7f269-f45b-4932-9d06-dd13c8c43cc5 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:22.503110 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 92/186] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:15:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:22.504276 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e7f269-f45b-4932-9d06-dd13c8c43cc5 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:22.518958 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532a3327-9380-48db-9ef2-3282bf80c427 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:22.564637 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75f14dd-e29a-49fb-a7cc-14cc0c38b1be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:22.565337 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f14dd-e29a-49fb-a7cc-14cc0c38b1be None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:22.565604 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f14dd-e29a-49fb-a7cc-14cc0c38b1be None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:22.565869 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f14dd-e29a-49fb-a7cc-14cc0c38b1be None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:22.566545 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75f14dd-e29a-49fb-a7cc-14cc0c38b1be None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:15:22.566842 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75f14dd-e29a-49fb-a7cc-14cc0c38b1be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:22.568244 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75f14dd-e29a-49fb-a7cc-14cc0c38b1be None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:22.572189 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:22.580308 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 95/187] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 12:15:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:22.581187 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75f14dd-e29a-49fb-a7cc-14cc0c38b1be None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:22.645204 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e7f269-f45b-4932-9d06-dd13c8c43cc5 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:22.689500 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:22.706767 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e53ab1e-a67a-4445-afe0-4ef0bd36fd4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:22.707758 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e53ab1e-a67a-4445-afe0-4ef0bd36fd4c None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:22.708208 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e53ab1e-a67a-4445-afe0-4ef0bd36fd4c None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:22.708634 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e53ab1e-a67a-4445-afe0-4ef0bd36fd4c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:22.737127 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75f14dd-e29a-49fb-a7cc-14cc0c38b1be None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:22.794669 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e941fd3c-7cdb-4c85-b03d-87f46c94ad65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:22.795391 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e941fd3c-7cdb-4c85-b03d-87f46c94ad65 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:22.795672 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e941fd3c-7cdb-4c85-b03d-87f46c94ad65 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:22.795947 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e941fd3c-7cdb-4c85-b03d-87f46c94ad65 None admin] PATH_INFO: `/v3/projects/8ee31161d5594131a34ea8dcad87d2a1` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:22.797145 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e941fd3c-7cdb-4c85-b03d-87f46c94ad65 None admin] RBAC: Authorizing `identity:get_project(project_id=8ee31161d5594131a34ea8dcad87d2a1)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:22.799187 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e941fd3c-7cdb-4c85-b03d-87f46c94ad65 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:22.801057 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 96/188] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 12:15:22 2022] GET /identity/v3/projects/8ee31161d5594131a34ea8dcad87d2a1 => generated 312 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:22.801958 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e941fd3c-7cdb-4c85-b03d-87f46c94ad65 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:22.823358 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e53ab1e-a67a-4445-afe0-4ef0bd36fd4c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:22.824866 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e53ab1e-a67a-4445-afe0-4ef0bd36fd4c None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:22.884887 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:22.943800 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e941fd3c-7cdb-4c85-b03d-87f46c94ad65 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:22.959866 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 93/189] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 12:15:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:15:22.961031 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e53ab1e-a67a-4445-afe0-4ef0bd36fd4c None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:22.993685 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:22.996792 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af43a40-8d91-4b9c-b56f-7d3ed15bead2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:22.997614 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af43a40-8d91-4b9c-b56f-7d3ed15bead2 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:22.997868 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af43a40-8d91-4b9c-b56f-7d3ed15bead2 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:22.998143 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af43a40-8d91-4b9c-b56f-7d3ed15bead2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:23.091172 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e53ab1e-a67a-4445-afe0-4ef0bd36fd4c None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:23.097812 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af43a40-8d91-4b9c-b56f-7d3ed15bead2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:23.100722 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af43a40-8d91-4b9c-b56f-7d3ed15bead2 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:23.140019 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f076b-490a-47a9-99f3-1eb01893d678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:23.141078 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f076b-490a-47a9-99f3-1eb01893d678 None admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:23.141348 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f076b-490a-47a9-99f3-1eb01893d678 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:23.141617 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f076b-490a-47a9-99f3-1eb01893d678 None admin] PATH_INFO: `/v3/users` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:23.142274 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5f076b-490a-47a9-99f3-1eb01893d678 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:23.143762 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5f076b-490a-47a9-99f3-1eb01893d678 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:23.174897 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 94/190] 10.222.0.79 () {60 vars in 1132 bytes} [Wed Aug 31 12:15:22 2022] POST /identity/v3/users => generated 297 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:15:23.174897 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f076b-490a-47a9-99f3-1eb01893d678 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:23.247480 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:23.289030 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:23.313496 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 97/191] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 12:15:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:15:23.314404 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af43a40-8d91-4b9c-b56f-7d3ed15bead2 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:23.328393 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f076b-490a-47a9-99f3-1eb01893d678 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:23.370930 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49703c54-652d-4066-bcad-1ac572cf1d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:23.371626 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49703c54-652d-4066-bcad-1ac572cf1d79 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:23.371912 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49703c54-652d-4066-bcad-1ac572cf1d79 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:23.372187 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49703c54-652d-4066-bcad-1ac572cf1d79 None admin] PATH_INFO: `/v3/users/d7da81fe1a1e486eb2f8d911a1dc1775` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:23.373404 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49703c54-652d-4066-bcad-1ac572cf1d79 None admin] RBAC: Authorizing `identity:get_user(user_id=d7da81fe1a1e486eb2f8d911a1dc1775)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:23.374921 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49703c54-652d-4066-bcad-1ac572cf1d79 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:23.376951 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 95/192] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 12:15:23 2022] GET /identity/v3/users/d7da81fe1a1e486eb2f8d911a1dc1775 => generated 283 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:23.377827 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49703c54-652d-4066-bcad-1ac572cf1d79 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:23.478302 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af43a40-8d91-4b9c-b56f-7d3ed15bead2 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:23.520264 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eb93da-5f58-43ee-b053-1aa28ce4dbda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:23.520887 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb93da-5f58-43ee-b053-1aa28ce4dbda None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:23.521161 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb93da-5f58-43ee-b053-1aa28ce4dbda None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:23.521460 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb93da-5f58-43ee-b053-1aa28ce4dbda None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:23.522810 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eb93da-5f58-43ee-b053-1aa28ce4dbda None admin] RBAC: Adding query filter params (role.id=b5cfd7a855a448359e9017f51d32b6fc, scope.project.id=8ee31161d5594131a34ea8dcad87d2a1, user.id=76d206fbf63149e689df0067d9be2dfd) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:15:23.523155 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eb93da-5f58-43ee-b053-1aa28ce4dbda None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:23.525728 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eb93da-5f58-43ee-b053-1aa28ce4dbda None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:23.535156 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 98/193] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 12:15:23 2022] GET /identity/v3/role_assignments?user.id=76d206fbf63149e689df0067d9be2dfd&scope.project.id=8ee31161d5594131a34ea8dcad87d2a1&role.id=b5cfd7a855a448359e9017f51d32b6fc => generated 608 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:23.536058 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eb93da-5f58-43ee-b053-1aa28ce4dbda None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:23.540295 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49703c54-652d-4066-bcad-1ac572cf1d79 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:23.590872 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:23.596587 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed67c63d-e720-40d3-88b7-e3a0e9d572e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:23.597334 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67c63d-e720-40d3-88b7-e3a0e9d572e0 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:23.597749 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67c63d-e720-40d3-88b7-e3a0e9d572e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:23.598209 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67c63d-e720-40d3-88b7-e3a0e9d572e0 None admin] PATH_INFO: `/v3/projects/79222f00008144bba451b7a2da2da187` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:23.604999 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed67c63d-e720-40d3-88b7-e3a0e9d572e0 None admin] RBAC: Authorizing `identity:get_project(project_id=79222f00008144bba451b7a2da2da187)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:23.608373 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed67c63d-e720-40d3-88b7-e3a0e9d572e0 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:23.612269 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 96/194] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 12:15:23 2022] GET /identity/v3/projects/79222f00008144bba451b7a2da2da187 => generated 298 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:23.613995 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed67c63d-e720-40d3-88b7-e3a0e9d572e0 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:23.643629 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:23.748972 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eb93da-5f58-43ee-b053-1aa28ce4dbda None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:23.810779 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96c4898-8ce0-4264-a6c9-dab763691e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:23.811861 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c4898-8ce0-4264-a6c9-dab763691e85 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:23.812384 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c4898-8ce0-4264-a6c9-dab763691e85 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:23.812664 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c4898-8ce0-4264-a6c9-dab763691e85 None admin] PATH_INFO: `/v3/projects/c28fc617d7054dbeb5fd1e39107959fc` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:23.815528 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96c4898-8ce0-4264-a6c9-dab763691e85 None admin] RBAC: Authorizing `identity:get_project(project_id=c28fc617d7054dbeb5fd1e39107959fc)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:23.817080 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96c4898-8ce0-4264-a6c9-dab763691e85 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:23.825366 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 99/195] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 12:15:23 2022] GET /identity/v3/projects/c28fc617d7054dbeb5fd1e39107959fc => generated 302 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:23.827961 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974abf3-76fa-41af-bddd-83cc406da7fa None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:23.828843 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974abf3-76fa-41af-bddd-83cc406da7fa None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:23.829606 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974abf3-76fa-41af-bddd-83cc406da7fa None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:23.832420 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 100/196] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:15:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:15:23.838551 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed67c63d-e720-40d3-88b7-e3a0e9d572e0 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:23.839530 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2974abf3-76fa-41af-bddd-83cc406da7fa None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:23.928180 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534346d2-6876-44bd-a2d4-3e9a88005f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:23.929352 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534346d2-6876-44bd-a2d4-3e9a88005f7d None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:23.929632 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534346d2-6876-44bd-a2d4-3e9a88005f7d None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:23.929910 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534346d2-6876-44bd-a2d4-3e9a88005f7d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:24.075339 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:24.088257 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2974abf3-76fa-41af-bddd-83cc406da7fa None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:24.111159 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534346d2-6876-44bd-a2d4-3e9a88005f7d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:24.114598 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534346d2-6876-44bd-a2d4-3e9a88005f7d None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:24.146937 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4173a324-00dc-4c57-b699-7b14b7a7796a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:24.147953 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173a324-00dc-4c57-b699-7b14b7a7796a None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:24.148446 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173a324-00dc-4c57-b699-7b14b7a7796a None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:24.148919 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173a324-00dc-4c57-b699-7b14b7a7796a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:24.150895 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4173a324-00dc-4c57-b699-7b14b7a7796a None admin] RBAC: Adding query filter params (role.id=be23fee6ea264172b277f97af30cc689, scope.project.id=79222f00008144bba451b7a2da2da187, user.id=76d206fbf63149e689df0067d9be2dfd) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:15:24.151429 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4173a324-00dc-4c57-b699-7b14b7a7796a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:24.153334 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:24.154256 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4173a324-00dc-4c57-b699-7b14b7a7796a None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:24.174523 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 101/197] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 12:15:23 2022] GET /identity/v3/role_assignments?user.id=76d206fbf63149e689df0067d9be2dfd&scope.project.id=79222f00008144bba451b7a2da2da187&role.id=be23fee6ea264172b277f97af30cc689 => generated 608 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:24.176857 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832ce5a1-1538-4f50-9542-68c28e46f7f3 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:24.177354 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832ce5a1-1538-4f50-9542-68c28e46f7f3 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:24.177808 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832ce5a1-1538-4f50-9542-68c28e46f7f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:24.222999 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-832ce5a1-1538-4f50-9542-68c28e46f7f3 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:15:24.222999 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-832ce5a1-1538-4f50-9542-68c28e46f7f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:15:24.304655 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 102/198] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:15:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:15:24.304655 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832ce5a1-1538-4f50-9542-68c28e46f7f3 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:24.416308 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:24.427650 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832ce5a1-1538-4f50-9542-68c28e46f7f3 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:24.444800 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 97/199] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 12:15:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 832 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:15:24.457206 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534346d2-6876-44bd-a2d4-3e9a88005f7d None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:24.474152 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac75059-3ef8-4d34-b545-635b0dc27d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:24.474702 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac75059-3ef8-4d34-b545-635b0dc27d05 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:24.475043 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac75059-3ef8-4d34-b545-635b0dc27d05 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:24.475329 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac75059-3ef8-4d34-b545-635b0dc27d05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:24.476297 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac75059-3ef8-4d34-b545-635b0dc27d05 None admin] RBAC: Adding query filter params (role.id=a332ef951db949b0bad7019fbd28a1b9, scope.project.id=c28fc617d7054dbeb5fd1e39107959fc, user.id=d7da81fe1a1e486eb2f8d911a1dc1775) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:15:24.476610 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac75059-3ef8-4d34-b545-635b0dc27d05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:24.478384 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac75059-3ef8-4d34-b545-635b0dc27d05 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:24.485076 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 103/200] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 12:15:24 2022] GET /identity/v3/role_assignments?user.id=d7da81fe1a1e486eb2f8d911a1dc1775&scope.project.id=c28fc617d7054dbeb5fd1e39107959fc&role.id=a332ef951db949b0bad7019fbd28a1b9 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:24.663063 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534346d2-6876-44bd-a2d4-3e9a88005f7d None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:24.719291 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:24.756376 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad48597d-4c16-42d8-9612-17fe15caee37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:24.757348 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad48597d-4c16-42d8-9612-17fe15caee37 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:24.757813 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad48597d-4c16-42d8-9612-17fe15caee37 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:24.758270 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad48597d-4c16-42d8-9612-17fe15caee37 None admin] PATH_INFO: `/v3/projects/c28fc617d7054dbeb5fd1e39107959fc` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:24.760695 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad48597d-4c16-42d8-9612-17fe15caee37 None admin] RBAC: Authorizing `identity:get_project(project_id=c28fc617d7054dbeb5fd1e39107959fc)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:24.763491 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad48597d-4c16-42d8-9612-17fe15caee37 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:24.766552 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 98/201] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 12:15:24 2022] GET /identity/v3/projects/c28fc617d7054dbeb5fd1e39107959fc => generated 302 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:24.776314 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac75059-3ef8-4d34-b545-635b0dc27d05 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:24.884619 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad48597d-4c16-42d8-9612-17fe15caee37 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:24.997272 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac75059-3ef8-4d34-b545-635b0dc27d05 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:25.070029 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e126139-9f22-40b1-9d73-e9edcb44ddba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:25.071136 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e126139-9f22-40b1-9d73-e9edcb44ddba None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:25.071822 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e126139-9f22-40b1-9d73-e9edcb44ddba None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:25.072311 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e126139-9f22-40b1-9d73-e9edcb44ddba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:25.073733 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e126139-9f22-40b1-9d73-e9edcb44ddba None admin] RBAC: Adding query filter params (role.id=be23fee6ea264172b277f97af30cc689, scope.project.id=c28fc617d7054dbeb5fd1e39107959fc, user.id=d7da81fe1a1e486eb2f8d911a1dc1775) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:15:25.074287 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e126139-9f22-40b1-9d73-e9edcb44ddba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:25.077108 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e126139-9f22-40b1-9d73-e9edcb44ddba None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:25.093171 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 104/202] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 12:15:24 2022] GET /identity/v3/role_assignments?user.id=d7da81fe1a1e486eb2f8d911a1dc1775&scope.project.id=c28fc617d7054dbeb5fd1e39107959fc&role.id=be23fee6ea264172b277f97af30cc689 => generated 259 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:25.146199 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad48597d-4c16-42d8-9612-17fe15caee37 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:25.201030 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83567a2a-c135-40d9-8d7e-8d3546deb962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:25.201703 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83567a2a-c135-40d9-8d7e-8d3546deb962 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:25.201983 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83567a2a-c135-40d9-8d7e-8d3546deb962 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:25.202253 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83567a2a-c135-40d9-8d7e-8d3546deb962 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:25.219662 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83567a2a-c135-40d9-8d7e-8d3546deb962 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:15:25.230148 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-83567a2a-c135-40d9-8d7e-8d3546deb962 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 12:15:25.230148 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:15:25.230148 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:15:25.230148 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:15:25.230148 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:15:25.230148 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:15:25.230148 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:15:25.230148 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:15:25.230148 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:15:25.230148 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:15:25.230148 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:15:25.230148 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:15:25.230148 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:15:25.230148 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:15:25.230148 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:15:25.230148 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:15:25.231913 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:15:25.231913 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:15:25.231913 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:15:25.231913 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:15:25.231913 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:15:25.231913 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:15:25.231913 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:15:25.231913 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:15:25.231913 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:15:25.231913 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:15:25.231913 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:15:25.231913 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:15:25.231913 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:15:25.231913 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:15:25.231913 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:15:25.231913 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:15:25.233531 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:15:25.233531 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:15:25.233531 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:15:25.233531 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:15:25.233531 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:15:25.233531 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:15:25.233531 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:15:25.233531 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:15:25.233531 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:15:25.233531 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:15:25.233531 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 12:15:25.233531 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:15:25.233531 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 99/203] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 12:15:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:15:25.244860 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e126139-9f22-40b1-9d73-e9edcb44ddba None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:25.292643 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:25.454885 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e126139-9f22-40b1-9d73-e9edcb44ddba None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:25.522895 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d1048d-e5fe-4545-89c5-36a1554013f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:25.525695 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d1048d-e5fe-4545-89c5-36a1554013f2 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:25.526621 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d1048d-e5fe-4545-89c5-36a1554013f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:25.527421 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d1048d-e5fe-4545-89c5-36a1554013f2 None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:25.528933 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d1048d-e5fe-4545-89c5-36a1554013f2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:15:25.529776 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d1048d-e5fe-4545-89c5-36a1554013f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:25.532756 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d1048d-e5fe-4545-89c5-36a1554013f2 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:25.562962 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 105/204] 10.222.0.79 () {56 vars in 1101 bytes} [Wed Aug 31 12:15:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:25.573204 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83567a2a-c135-40d9-8d7e-8d3546deb962 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:25.672289 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:25.776730 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83567a2a-c135-40d9-8d7e-8d3546deb962 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:25.844287 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffffcbd-48c7-45dc-858d-84825ba76ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:25.845365 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffffcbd-48c7-45dc-858d-84825ba76ee7 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:25.845853 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffffcbd-48c7-45dc-858d-84825ba76ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:25.846329 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffffcbd-48c7-45dc-858d-84825ba76ee7 None admin] PATH_INFO: `/v3/users/71903a930c9f4dcbb492c8b3afefd5a3` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:25.848471 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffffcbd-48c7-45dc-858d-84825ba76ee7 None admin] RBAC: Authorizing `identity:get_user(user_id=71903a930c9f4dcbb492c8b3afefd5a3)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:25.851153 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffffcbd-48c7-45dc-858d-84825ba76ee7 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:25.854826 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 100/205] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 12:15:25 2022] GET /identity/v3/users/71903a930c9f4dcbb492c8b3afefd5a3 => generated 289 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:25.864004 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d1048d-e5fe-4545-89c5-36a1554013f2 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:25.990880 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:25.991069 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5530d2-05ca-4254-a051-2088cc15057f None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:25.991069 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5530d2-05ca-4254-a051-2088cc15057f None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:25.991069 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5530d2-05ca-4254-a051-2088cc15057f None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:25.991069 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 101/206] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:15:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:15:25.994626 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b2b5c6-ed44-4748-9b93-3771f1cf8366 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:25.994939 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b2b5c6-ed44-4748-9b93-3771f1cf8366 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:25.995270 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b2b5c6-ed44-4748-9b93-3771f1cf8366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:26.014068 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-98b2b5c6-ed44-4748-9b93-3771f1cf8366 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:15:26.015310 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-98b2b5c6-ed44-4748-9b93-3771f1cf8366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:15:26.018276 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d1048d-e5fe-4545-89c5-36a1554013f2 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:26.084690 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3df792c-38af-4f39-aed9-48e0bc44c805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:26.085707 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df792c-38af-4f39-aed9-48e0bc44c805 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:26.085816 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df792c-38af-4f39-aed9-48e0bc44c805 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:26.086029 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df792c-38af-4f39-aed9-48e0bc44c805 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:26.091614 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 102/207] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:15:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 12:15:26.191735 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3df792c-38af-4f39-aed9-48e0bc44c805 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:26.193236 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3df792c-38af-4f39-aed9-48e0bc44c805 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:26.259561 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1525a2c-0801-4947-a4ad-32227a1b9b20 None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:26.260181 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1525a2c-0801-4947-a4ad-32227a1b9b20 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:26.260684 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1525a2c-0801-4947-a4ad-32227a1b9b20 None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:26.262571 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 103/208] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:15:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:15:26.276358 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e9e82-dd36-40d0-8c8c-f013b36f657b None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:26.276987 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e9e82-dd36-40d0-8c8c-f013b36f657b None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:26.277462 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e9e82-dd36-40d0-8c8c-f013b36f657b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:26.308754 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-546e9e82-dd36-40d0-8c8c-f013b36f657b None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:15:26.310332 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-546e9e82-dd36-40d0-8c8c-f013b36f657b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:15:26.324111 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:26.374987 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 106/209] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 12:15:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 12:15:26.380980 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3df792c-38af-4f39-aed9-48e0bc44c805 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:26.387560 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:26.423473 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 104/210] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:15:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:15:26.516992 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546e9e82-dd36-40d0-8c8c-f013b36f657b None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:26.638742 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3df792c-38af-4f39-aed9-48e0bc44c805 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:26.714455 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546e9e82-dd36-40d0-8c8c-f013b36f657b None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:26.731682 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab071da-be04-4238-91e5-30afa64ef9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:26.732352 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab071da-be04-4238-91e5-30afa64ef9bc None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:26.732632 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab071da-be04-4238-91e5-30afa64ef9bc None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:26.732906 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab071da-be04-4238-91e5-30afa64ef9bc None admin] PATH_INFO: `/v3/projects/79222f00008144bba451b7a2da2da187` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:26.735861 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab071da-be04-4238-91e5-30afa64ef9bc None admin] RBAC: Authorizing `identity:get_project(project_id=79222f00008144bba451b7a2da2da187)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:26.737364 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab071da-be04-4238-91e5-30afa64ef9bc None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:26.740215 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 107/211] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 12:15:26 2022] GET /identity/v3/projects/79222f00008144bba451b7a2da2da187 => generated 298 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:26.745557 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab071da-be04-4238-91e5-30afa64ef9bc None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:26.778837 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4785c5c-7eb4-4565-b938-db5f74034611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:26.779950 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4785c5c-7eb4-4565-b938-db5f74034611 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:26.780433 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4785c5c-7eb4-4565-b938-db5f74034611 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:26.780906 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4785c5c-7eb4-4565-b938-db5f74034611 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:26.804927 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4785c5c-7eb4-4565-b938-db5f74034611 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:15:26.819713 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-d4785c5c-7eb4-4565-b938-db5f74034611 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:15:26.819713 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:15:26.819713 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:15:26.819713 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:15:26.819713 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:15:26.819713 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:15:26.819713 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:15:26.819713 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:15:26.819713 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:15:26.819713 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:15:26.819713 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:15:26.819713 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:15:26.819713 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:15:26.819713 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:15:26.819713 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:15:26.819713 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:15:26.820682 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:15:26.820682 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:15:26.820682 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:15:26.820682 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:15:26.820682 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:15:26.820682 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:15:26.820682 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:15:26.820682 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:15:26.820682 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:15:26.820682 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:15:26.820682 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:15:26.820682 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:15:26.820682 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:15:26.820682 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:15:26.820682 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:15:26.820682 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:15:26.823276 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:15:26.823276 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:15:26.823276 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:15:26.823276 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:15:26.823276 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:15:26.823276 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:15:26.823276 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:15:26.823276 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:15:26.823276 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:15:26.823276 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:15:26.823276 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:15:26.823276 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:15:26.823276 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 105/212] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 12:15:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:15:26.838522 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4785c5c-7eb4-4565-b938-db5f74034611 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:26.910760 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:26.956255 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:27.013730 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab071da-be04-4238-91e5-30afa64ef9bc None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:27.085559 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4fa942-8e97-4cdd-a871-a69f78fb77f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:27.086582 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4fa942-8e97-4cdd-a871-a69f78fb77f8 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:27.087662 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4fa942-8e97-4cdd-a871-a69f78fb77f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:27.088132 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4fa942-8e97-4cdd-a871-a69f78fb77f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:27.089971 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4fa942-8e97-4cdd-a871-a69f78fb77f8 None admin] RBAC: Adding query filter params (role.id=6a7464b68efb4b3089ce4d0d8d03fdf3, scope.project.id=79222f00008144bba451b7a2da2da187, user.id=71903a930c9f4dcbb492c8b3afefd5a3) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:15:27.091310 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4fa942-8e97-4cdd-a871-a69f78fb77f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:27.093010 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4fa942-8e97-4cdd-a871-a69f78fb77f8 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:27.104075 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 108/213] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 12:15:26 2022] GET /identity/v3/role_assignments?user.id=71903a930c9f4dcbb492c8b3afefd5a3&scope.project.id=79222f00008144bba451b7a2da2da187&role.id=6a7464b68efb4b3089ce4d0d8d03fdf3 => generated 608 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:15:27.105537 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4fa942-8e97-4cdd-a871-a69f78fb77f8 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:27.125877 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4785c5c-7eb4-4565-b938-db5f74034611 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:27.172936 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3416e116-6711-429d-aa39-88472857e201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:27.173483 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416e116-6711-429d-aa39-88472857e201 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:27.173768 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416e116-6711-429d-aa39-88472857e201 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:27.174038 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416e116-6711-429d-aa39-88472857e201 None admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:27.174741 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3416e116-6711-429d-aa39-88472857e201 None admin] RBAC: Adding query filter params (name=member) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:15:27.175091 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3416e116-6711-429d-aa39-88472857e201 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:27.176620 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3416e116-6711-429d-aa39-88472857e201 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:27.195484 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 106/214] 10.222.0.79 () {56 vars in 1101 bytes} [Wed Aug 31 12:15:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:15:27.205135 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3416e116-6711-429d-aa39-88472857e201 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:27.364320 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4fa942-8e97-4cdd-a871-a69f78fb77f8 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:27.386050 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:27.402809 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:27.414112 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f989e2-05ee-41ad-95e5-2bf08ea548d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:27.414764 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f989e2-05ee-41ad-95e5-2bf08ea548d8 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:27.415109 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f989e2-05ee-41ad-95e5-2bf08ea548d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:27.415382 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f989e2-05ee-41ad-95e5-2bf08ea548d8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:27.416652 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f989e2-05ee-41ad-95e5-2bf08ea548d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:27.417553 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3416e116-6711-429d-aa39-88472857e201 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:27.418152 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f989e2-05ee-41ad-95e5-2bf08ea548d8 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:27.420209 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 109/215] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:15:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:27.429717 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f989e2-05ee-41ad-95e5-2bf08ea548d8 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:27.504502 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffb49ea-9795-4dc9-94e6-4b52547888f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:27.505506 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb49ea-9795-4dc9-94e6-4b52547888f9 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:27.505963 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb49ea-9795-4dc9-94e6-4b52547888f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:27.506423 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb49ea-9795-4dc9-94e6-4b52547888f9 None admin] PATH_INFO: `/v3/users/f521b542b844420abacc131239f9458b` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:27.537469 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffb49ea-9795-4dc9-94e6-4b52547888f9 None admin] RBAC: Authorizing `identity:get_user(user_id=f521b542b844420abacc131239f9458b)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:27.543415 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffb49ea-9795-4dc9-94e6-4b52547888f9 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:27.543415 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 107/216] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 12:15:27 2022] GET /identity/v3/users/f521b542b844420abacc131239f9458b => generated 297 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:15:27.545159 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cad828-f80d-4257-8d8b-fbda34a85953 None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:27.549398 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cad828-f80d-4257-8d8b-fbda34a85953 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:27.549398 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cad828-f80d-4257-8d8b-fbda34a85953 None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:27.549398 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 108/217] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:15:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:15:27.552882 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cad828-f80d-4257-8d8b-fbda34a85953 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:27.613560 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f989e2-05ee-41ad-95e5-2bf08ea548d8 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:27.664990 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533df180-47b9-422d-867a-858fa923ec79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:27.666698 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533df180-47b9-422d-867a-858fa923ec79 None admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:27.666698 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533df180-47b9-422d-867a-858fa923ec79 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:27.666935 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533df180-47b9-422d-867a-858fa923ec79 None admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:27.667992 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533df180-47b9-422d-867a-858fa923ec79 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:27.670420 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533df180-47b9-422d-867a-858fa923ec79 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:27.704470 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 110/218] 10.222.0.79 () {60 vars in 1132 bytes} [Wed Aug 31 12:15:27 2022] POST /identity/v3/users => generated 297 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:15:27.706508 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3205b154-54e4-4340-bc46-023febbf9554 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:27.707025 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3205b154-54e4-4340-bc46-023febbf9554 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:27.707475 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3205b154-54e4-4340-bc46-023febbf9554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:27.719487 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cad828-f80d-4257-8d8b-fbda34a85953 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:27.738731 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-3205b154-54e4-4340-bc46-023febbf9554 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:15:27.740935 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-3205b154-54e4-4340-bc46-023febbf9554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:15:27.772060 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477ebe6d-dd52-41b1-a062-2d2d6e09ebef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:27.772961 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ebe6d-dd52-41b1-a062-2d2d6e09ebef None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:27.773391 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ebe6d-dd52-41b1-a062-2d2d6e09ebef None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:27.773823 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ebe6d-dd52-41b1-a062-2d2d6e09ebef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:27.798598 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:27.811031 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:27.873094 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 111/219] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:15:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:15:27.878290 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477ebe6d-dd52-41b1-a062-2d2d6e09ebef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:27.880196 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477ebe6d-dd52-41b1-a062-2d2d6e09ebef None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:27.923842 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e19e7e5-56a9-437e-87bd-912fe47010eb None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:27.924320 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e19e7e5-56a9-437e-87bd-912fe47010eb None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:27.924786 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e19e7e5-56a9-437e-87bd-912fe47010eb None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:27.927269 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 112/220] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:15:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:15:27.936918 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d91138-73d0-426f-a3fa-94bef9a710bd None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:27.937422 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d91138-73d0-426f-a3fa-94bef9a710bd None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:27.938060 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d91138-73d0-426f-a3fa-94bef9a710bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:27.971107 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-e4d91138-73d0-426f-a3fa-94bef9a710bd None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:15:27.973181 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-e4d91138-73d0-426f-a3fa-94bef9a710bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:15:28.023447 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 109/221] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 12:15:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 12:15:28.030436 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477ebe6d-dd52-41b1-a062-2d2d6e09ebef None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:28.093060 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 113/222] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:15:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 12:15:28.122767 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:28.186676 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d91138-73d0-426f-a3fa-94bef9a710bd None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:28.195318 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477ebe6d-dd52-41b1-a062-2d2d6e09ebef None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:28.279554 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4141f9-cbfd-48f4-9d54-b3937ca5136f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:28.280653 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4141f9-cbfd-48f4-9d54-b3937ca5136f None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:28.281095 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4141f9-cbfd-48f4-9d54-b3937ca5136f None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:28.281545 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4141f9-cbfd-48f4-9d54-b3937ca5136f None admin] PATH_INFO: `/v3/projects/c28fc617d7054dbeb5fd1e39107959fc` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:28.283621 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4141f9-cbfd-48f4-9d54-b3937ca5136f None admin] RBAC: Authorizing `identity:get_project(project_id=c28fc617d7054dbeb5fd1e39107959fc)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:28.286645 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4141f9-cbfd-48f4-9d54-b3937ca5136f None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:28.290913 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 110/223] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 12:15:28 2022] GET /identity/v3/projects/c28fc617d7054dbeb5fd1e39107959fc => generated 302 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:15:28.302474 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4141f9-cbfd-48f4-9d54-b3937ca5136f None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:28.416437 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:28.424457 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d91138-73d0-426f-a3fa-94bef9a710bd None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:28.490567 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2947045-30f9-4473-8bff-7ac11e4f445b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:28.492068 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2947045-30f9-4473-8bff-7ac11e4f445b None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:28.492833 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2947045-30f9-4473-8bff-7ac11e4f445b None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:28.494080 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2947045-30f9-4473-8bff-7ac11e4f445b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:28.514776 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2947045-30f9-4473-8bff-7ac11e4f445b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:15:28.525412 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-f2947045-30f9-4473-8bff-7ac11e4f445b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:15:28.525412 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:15:28.525412 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:15:28.525412 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:15:28.525412 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:15:28.525412 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:15:28.525412 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:15:28.525412 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:15:28.525412 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:15:28.525412 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:15:28.525412 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:15:28.525412 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:15:28.525412 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:15:28.525412 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:15:28.525412 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:15:28.525412 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:15:28.527218 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:15:28.527218 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:15:28.527218 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:15:28.527218 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:15:28.527218 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:15:28.527218 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:15:28.527218 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:15:28.527218 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:15:28.527218 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:15:28.527218 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:15:28.527218 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:15:28.527218 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:15:28.527218 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:15:28.527218 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:15:28.527218 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:15:28.527218 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:15:28.528797 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:15:28.528797 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:15:28.528797 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:15:28.528797 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:15:28.528797 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:15:28.528797 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:15:28.528797 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:15:28.528797 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:15:28.528797 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:15:28.528797 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:15:28.528797 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:15:28.528797 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:15:28.531559 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4141f9-cbfd-48f4-9d54-b3937ca5136f None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:28.539374 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 114/224] 10.222.0.79 () {56 vars in 1096 bytes} [Wed Aug 31 12:15:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:15:28.542066 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2947045-30f9-4473-8bff-7ac11e4f445b None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:28.597385 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:28.606478 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52be3f58-499f-4a92-81fc-ec0be7a43fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:28.607526 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be3f58-499f-4a92-81fc-ec0be7a43fbe None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:28.607992 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be3f58-499f-4a92-81fc-ec0be7a43fbe None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:28.608487 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be3f58-499f-4a92-81fc-ec0be7a43fbe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:28.610094 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52be3f58-499f-4a92-81fc-ec0be7a43fbe None admin] RBAC: Adding query filter params (role.id=b5cfd7a855a448359e9017f51d32b6fc, scope.project.id=c28fc617d7054dbeb5fd1e39107959fc, user.id=f521b542b844420abacc131239f9458b) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:15:28.610626 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52be3f58-499f-4a92-81fc-ec0be7a43fbe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:28.613556 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52be3f58-499f-4a92-81fc-ec0be7a43fbe None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:28.625910 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 111/225] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 12:15:28 2022] GET /identity/v3/role_assignments?user.id=f521b542b844420abacc131239f9458b&scope.project.id=c28fc617d7054dbeb5fd1e39107959fc&role.id=b5cfd7a855a448359e9017f51d32b6fc => generated 259 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:15:28.627367 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52be3f58-499f-4a92-81fc-ec0be7a43fbe None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:28.795159 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2947045-30f9-4473-8bff-7ac11e4f445b None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:28.869942 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52be3f58-499f-4a92-81fc-ec0be7a43fbe None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:28.885210 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee8f50b-2943-4ae7-88d1-0cc1239a63ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:28.885970 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee8f50b-2943-4ae7-88d1-0cc1239a63ee None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:28.886321 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee8f50b-2943-4ae7-88d1-0cc1239a63ee None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:28.886603 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee8f50b-2943-4ae7-88d1-0cc1239a63ee None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:28.906187 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee8f50b-2943-4ae7-88d1-0cc1239a63ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:15:28.919781 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-8ee8f50b-2943-4ae7-88d1-0cc1239a63ee None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 12:15:28.919781 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:15:28.919781 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:15:28.919781 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:15:28.919781 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:15:28.919781 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:15:28.919781 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:15:28.919781 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:15:28.919781 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:15:28.919781 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:15:28.919781 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:15:28.919781 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:15:28.919781 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:15:28.919781 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:15:28.919781 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:15:28.919781 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:15:28.920746 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:15:28.920746 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:15:28.920746 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:15:28.920746 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:15:28.920746 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:15:28.920746 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:15:28.920746 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:15:28.920746 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:15:28.920746 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:15:28.920746 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:15:28.920746 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:15:28.920746 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:15:28.920746 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:15:28.920746 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:15:28.920746 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:15:28.920746 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:15:28.922000 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:15:28.922000 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:15:28.922000 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:15:28.922000 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:15:28.922000 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:15:28.922000 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:15:28.922000 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:15:28.922000 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:15:28.922000 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:15:28.922000 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:15:28.922000 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 12:15:28.922000 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:15:28.922000 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 115/226] 10.222.0.79 () {56 vars in 1114 bytes} [Wed Aug 31 12:15:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 381 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:15:28.927877 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee8f50b-2943-4ae7-88d1-0cc1239a63ee None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:28.963614 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9467a12-0603-4e2b-8afe-fc672e9e17e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:28.964255 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9467a12-0603-4e2b-8afe-fc672e9e17e9 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:28.964537 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9467a12-0603-4e2b-8afe-fc672e9e17e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:28.964810 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9467a12-0603-4e2b-8afe-fc672e9e17e9 None admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:28.965505 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9467a12-0603-4e2b-8afe-fc672e9e17e9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:15:28.965811 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9467a12-0603-4e2b-8afe-fc672e9e17e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:28.971768 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9467a12-0603-4e2b-8afe-fc672e9e17e9 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:28.973162 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:28.998120 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 112/227] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 12:15:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:29.004174 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9467a12-0603-4e2b-8afe-fc672e9e17e9 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:29.091535 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee8f50b-2943-4ae7-88d1-0cc1239a63ee None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:29.146737 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5014c419-1b01-4b41-829d-2ddb3e843e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:29.147810 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5014c419-1b01-4b41-829d-2ddb3e843e00 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:29.148691 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5014c419-1b01-4b41-829d-2ddb3e843e00 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:29.150645 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5014c419-1b01-4b41-829d-2ddb3e843e00 None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:29.152757 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5014c419-1b01-4b41-829d-2ddb3e843e00 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:15:29.153653 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5014c419-1b01-4b41-829d-2ddb3e843e00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:29.156582 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5014c419-1b01-4b41-829d-2ddb3e843e00 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:29.173884 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 116/228] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 12:15:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:29.174266 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:29.182059 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5014c419-1b01-4b41-829d-2ddb3e843e00 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:29.345320 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9467a12-0603-4e2b-8afe-fc672e9e17e9 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:29.461808 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:29.468564 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e0eda3-5102-4dd7-9c71-8a1e4974c994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:29.471422 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e0eda3-5102-4dd7-9c71-8a1e4974c994 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:29.472328 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e0eda3-5102-4dd7-9c71-8a1e4974c994 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:29.473175 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e0eda3-5102-4dd7-9c71-8a1e4974c994 None admin] PATH_INFO: `/v3/users/d7da81fe1a1e486eb2f8d911a1dc1775` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:29.475836 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e0eda3-5102-4dd7-9c71-8a1e4974c994 None admin] RBAC: Authorizing `identity:get_user(user_id=d7da81fe1a1e486eb2f8d911a1dc1775)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:29.479974 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e0eda3-5102-4dd7-9c71-8a1e4974c994 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:29.484234 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 113/229] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 12:15:29 2022] GET /identity/v3/users/d7da81fe1a1e486eb2f8d911a1dc1775 => generated 283 bytes in 480 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:15:29.492800 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e0eda3-5102-4dd7-9c71-8a1e4974c994 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:29.532769 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5014c419-1b01-4b41-829d-2ddb3e843e00 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:29.612103 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a3520-edf5-4ba6-b712-d37304acbe17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:29.615362 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a3520-edf5-4ba6-b712-d37304acbe17 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:29.618927 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a3520-edf5-4ba6-b712-d37304acbe17 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:29.622881 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a3520-edf5-4ba6-b712-d37304acbe17 None admin] PATH_INFO: `/v3/users/d7da81fe1a1e486eb2f8d911a1dc1775` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:29.626479 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2a3520-edf5-4ba6-b712-d37304acbe17 None admin] RBAC: Authorizing `identity:get_user(user_id=d7da81fe1a1e486eb2f8d911a1dc1775)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:29.631478 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2a3520-edf5-4ba6-b712-d37304acbe17 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:29.641239 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 117/230] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 12:15:29 2022] GET /identity/v3/users/d7da81fe1a1e486eb2f8d911a1dc1775 => generated 283 bytes in 461 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:29.647738 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a3520-edf5-4ba6-b712-d37304acbe17 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:29.828754 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e0eda3-5102-4dd7-9c71-8a1e4974c994 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:29.864720 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:29.927462 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40e2664-f8fc-4904-b835-e062fbf42a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:29.929597 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e2664-f8fc-4904-b835-e062fbf42a08 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:29.932726 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e2664-f8fc-4904-b835-e062fbf42a08 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:29.933486 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e2664-f8fc-4904-b835-e062fbf42a08 None admin] PATH_INFO: `/v3/projects/c28fc617d7054dbeb5fd1e39107959fc` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:29.936437 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40e2664-f8fc-4904-b835-e062fbf42a08 None admin] RBAC: Authorizing `identity:get_project(project_id=c28fc617d7054dbeb5fd1e39107959fc)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:29.940545 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40e2664-f8fc-4904-b835-e062fbf42a08 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:29.945782 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 114/231] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 12:15:29 2022] GET /identity/v3/projects/c28fc617d7054dbeb5fd1e39107959fc => generated 302 bytes in 454 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:15:29.958899 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40e2664-f8fc-4904-b835-e062fbf42a08 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:29.959131 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a3520-edf5-4ba6-b712-d37304acbe17 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:30.085705 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40e2664-f8fc-4904-b835-e062fbf42a08 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:30.119861 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9094327-e893-489e-8edf-f2a83a3a1c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:30.120432 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9094327-e893-489e-8edf-f2a83a3a1c0f None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:30.120713 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9094327-e893-489e-8edf-f2a83a3a1c0f None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:30.121002 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9094327-e893-489e-8edf-f2a83a3a1c0f None admin] PATH_INFO: `/v3/projects/c28fc617d7054dbeb5fd1e39107959fc` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:30.124595 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a09edb-ef8f-4003-87dc-bfa83dc8e95a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:30.125270 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a09edb-ef8f-4003-87dc-bfa83dc8e95a None admin] REQUEST_METHOD: `PUT` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:30.125548 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a09edb-ef8f-4003-87dc-bfa83dc8e95a None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:30.125822 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a09edb-ef8f-4003-87dc-bfa83dc8e95a None admin] PATH_INFO: `/v3/projects/c28fc617d7054dbeb5fd1e39107959fc/users/d7da81fe1a1e486eb2f8d911a1dc1775/roles/a332ef951db949b0bad7019fbd28a1b9` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:30.127575 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9094327-e893-489e-8edf-f2a83a3a1c0f None admin] RBAC: Authorizing `identity:get_project(project_id=c28fc617d7054dbeb5fd1e39107959fc)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:30.127852 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a09edb-ef8f-4003-87dc-bfa83dc8e95a None admin] RBAC: Authorizing `identity:create_grant(project_id=c28fc617d7054dbeb5fd1e39107959fc, user_id=d7da81fe1a1e486eb2f8d911a1dc1775, role_id=a332ef951db949b0bad7019fbd28a1b9)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:30.129060 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9094327-e893-489e-8edf-f2a83a3a1c0f None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:30.129300 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a09edb-ef8f-4003-87dc-bfa83dc8e95a None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:30.131087 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 118/232] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 12:15:29 2022] GET /identity/v3/projects/c28fc617d7054dbeb5fd1e39107959fc => generated 302 bytes in 484 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:30.142792 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9094327-e893-489e-8edf-f2a83a3a1c0f None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:30.159148 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 115/233] 10.222.0.79 () {58 vars in 1439 bytes} [Wed Aug 31 12:15:29 2022] PUT /identity/v3/projects/c28fc617d7054dbeb5fd1e39107959fc/users/d7da81fe1a1e486eb2f8d911a1dc1775/roles/a332ef951db949b0bad7019fbd28a1b9 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:15:30.170603 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:30.295734 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9094327-e893-489e-8edf-f2a83a3a1c0f None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:30.347414 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d863ebf-0f68-4bb2-9362-fb4ce993b252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:30.348534 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d863ebf-0f68-4bb2-9362-fb4ce993b252 None admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:30.349077 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d863ebf-0f68-4bb2-9362-fb4ce993b252 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:30.349597 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d863ebf-0f68-4bb2-9362-fb4ce993b252 None admin] PATH_INFO: `/v3/projects/c28fc617d7054dbeb5fd1e39107959fc/users/d7da81fe1a1e486eb2f8d911a1dc1775/roles/be23fee6ea264172b277f97af30cc689` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:30.352841 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d863ebf-0f68-4bb2-9362-fb4ce993b252 None admin] RBAC: Authorizing `identity:create_grant(project_id=c28fc617d7054dbeb5fd1e39107959fc, user_id=d7da81fe1a1e486eb2f8d911a1dc1775, role_id=be23fee6ea264172b277f97af30cc689)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:30.354624 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d863ebf-0f68-4bb2-9362-fb4ce993b252 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:30.380794 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 119/234] 10.222.0.79 () {58 vars in 1439 bytes} [Wed Aug 31 12:15:30 2022] PUT /identity/v3/projects/c28fc617d7054dbeb5fd1e39107959fc/users/d7da81fe1a1e486eb2f8d911a1dc1775/roles/be23fee6ea264172b277f97af30cc689 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:15:31.044450 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a059e-7363-4d00-85d5-9c679f9b9622 None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:31.045443 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a059e-7363-4d00-85d5-9c679f9b9622 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:31.045936 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a059e-7363-4d00-85d5-9c679f9b9622 None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:31.047934 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 116/235] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:15:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:15:31.053176 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7126841-80ce-4ab7-8aaf-9208b332d19b None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:31.054030 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7126841-80ce-4ab7-8aaf-9208b332d19b None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:31.054504 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7126841-80ce-4ab7-8aaf-9208b332d19b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:31.071678 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece92f9-2049-47ff-a8fb-06f6e4fdf47e None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:31.072294 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece92f9-2049-47ff-a8fb-06f6e4fdf47e None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:31.072793 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece92f9-2049-47ff-a8fb-06f6e4fdf47e None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:31.074345 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 117/236] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:15:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:15:31.079784 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c701af-9194-4c66-bd5e-83e6044c0ff2 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:31.080342 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c701af-9194-4c66-bd5e-83e6044c0ff2 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:31.080840 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c701af-9194-4c66-bd5e-83e6044c0ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:31.104143 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-c7126841-80ce-4ab7-8aaf-9208b332d19b None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:15:31.105714 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-c7126841-80ce-4ab7-8aaf-9208b332d19b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:15:31.108978 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-55c701af-9194-4c66-bd5e-83e6044c0ff2 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:15:31.111271 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-55c701af-9194-4c66-bd5e-83e6044c0ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:15:31.168252 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:31.218621 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 120/237] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:15:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:15:31.220267 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d2eca-79a8-46c6-a47a-d7eac29a2859 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:31.220740 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d2eca-79a8-46c6-a47a-d7eac29a2859 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:31.221302 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d2eca-79a8-46c6-a47a-d7eac29a2859 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:31.222964 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 121/238] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:15:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:15:31.232116 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e823f9be-6c8d-4373-8613-1e6fa56d1b36 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:31.232679 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e823f9be-6c8d-4373-8613-1e6fa56d1b36 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:31.233131 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e823f9be-6c8d-4373-8613-1e6fa56d1b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:31.234560 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 118/239] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:15:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:15:31.252730 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:31.273329 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-e823f9be-6c8d-4373-8613-1e6fa56d1b36 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:15:31.275687 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-e823f9be-6c8d-4373-8613-1e6fa56d1b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:15:31.385783 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 122/240] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:15:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:15:31.616753 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c701af-9194-4c66-bd5e-83e6044c0ff2 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:31.754125 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c701af-9194-4c66-bd5e-83e6044c0ff2 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:31.776532 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e823f9be-6c8d-4373-8613-1e6fa56d1b36 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:31.824767 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92f0bfb-e580-4478-94c8-d2b616cda9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:31.825451 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f0bfb-e580-4478-94c8-d2b616cda9fd None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:31.825736 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f0bfb-e580-4478-94c8-d2b616cda9fd None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:31.826008 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f0bfb-e580-4478-94c8-d2b616cda9fd None admin] PATH_INFO: `/v3/roles/member` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:31.852219 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92f0bfb-e580-4478-94c8-d2b616cda9fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:15:31.859537 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-b92f0bfb-e580-4478-94c8-d2b616cda9fd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:15:31.859537 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:15:31.859537 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:15:31.859537 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:15:31.859537 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:15:31.859537 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:15:31.859537 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:15:31.859537 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:15:31.859537 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:15:31.859537 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:15:31.859537 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:15:31.859537 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:15:31.859537 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:15:31.859537 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:15:31.859537 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:15:31.859537 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:15:31.860520 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:15:31.860520 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:15:31.860520 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:15:31.860520 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:15:31.860520 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:15:31.860520 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:15:31.860520 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:15:31.860520 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:15:31.860520 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:15:31.860520 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:15:31.860520 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:15:31.860520 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:15:31.860520 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:15:31.860520 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:15:31.860520 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:15:31.860520 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:15:31.861316 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:15:31.861316 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:15:31.861316 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:15:31.861316 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:15:31.861316 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:15:31.861316 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:15:31.861316 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:15:31.861316 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:15:31.861316 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:15:31.861316 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:15:31.861316 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:15:31.861316 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:15:31.869456 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 119/241] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 12:15:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:15:31.869456 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92f0bfb-e580-4478-94c8-d2b616cda9fd None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:31.920472 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:31.973379 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e823f9be-6c8d-4373-8613-1e6fa56d1b36 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:32.029954 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec73ccc5-c294-4f75-9ec6-89b55243e39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:32.030762 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec73ccc5-c294-4f75-9ec6-89b55243e39e None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:32.031170 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec73ccc5-c294-4f75-9ec6-89b55243e39e None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:32.031536 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec73ccc5-c294-4f75-9ec6-89b55243e39e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:32.033482 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec73ccc5-c294-4f75-9ec6-89b55243e39e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:32.035516 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec73ccc5-c294-4f75-9ec6-89b55243e39e None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:32.038273 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 123/242] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:15:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:32.039591 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec73ccc5-c294-4f75-9ec6-89b55243e39e None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:32.048725 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:32.053910 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92f0bfb-e580-4478-94c8-d2b616cda9fd None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:32.096214 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d96f89-debe-42c1-966d-f596758fd01a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:32.097147 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d96f89-debe-42c1-966d-f596758fd01a None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:32.097589 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d96f89-debe-42c1-966d-f596758fd01a None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:32.098007 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d96f89-debe-42c1-966d-f596758fd01a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:32.112142 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d96f89-debe-42c1-966d-f596758fd01a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:15:32.117568 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-d3d96f89-debe-42c1-966d-f596758fd01a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 12:15:32.117568 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:15:32.117568 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:15:32.117568 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:15:32.117568 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:15:32.117568 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:15:32.117568 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:15:32.117568 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:15:32.117568 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:15:32.117568 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:15:32.117568 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:15:32.117568 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:15:32.117568 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:15:32.117568 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:15:32.117568 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:15:32.117568 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:15:32.119529 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:15:32.119529 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:15:32.119529 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:15:32.119529 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:15:32.119529 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:15:32.119529 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:15:32.119529 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:15:32.119529 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:15:32.119529 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:15:32.119529 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:15:32.119529 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:15:32.119529 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:15:32.119529 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:15:32.119529 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:15:32.119529 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:15:32.119529 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:15:32.120349 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:15:32.120349 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:15:32.120349 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:15:32.120349 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:15:32.120349 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:15:32.120349 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:15:32.120349 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:15:32.120349 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:15:32.120349 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:15:32.120349 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:15:32.120349 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 12:15:32.120349 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:15:32.127162 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 120/243] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 12:15:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:15:32.128374 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d96f89-debe-42c1-966d-f596758fd01a None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:32.214680 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec73ccc5-c294-4f75-9ec6-89b55243e39e None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:32.239772 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:32.252782 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d96f89-debe-42c1-966d-f596758fd01a None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:32.276476 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004af78e-690a-4789-a15f-6a0f8d74e69e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:32.277865 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004af78e-690a-4789-a15f-6a0f8d74e69e None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:32.278515 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004af78e-690a-4789-a15f-6a0f8d74e69e None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:32.279233 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004af78e-690a-4789-a15f-6a0f8d74e69e None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:32.280654 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004af78e-690a-4789-a15f-6a0f8d74e69e None admin] RBAC: Adding query filter params (name=member) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:15:32.281374 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004af78e-690a-4789-a15f-6a0f8d74e69e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:32.284290 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004af78e-690a-4789-a15f-6a0f8d74e69e None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:32.297655 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f9d949-3d96-46e6-82b2-977125d7f3c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:32.298574 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9d949-3d96-46e6-82b2-977125d7f3c8 None admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:32.299094 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9d949-3d96-46e6-82b2-977125d7f3c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:32.299692 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9d949-3d96-46e6-82b2-977125d7f3c8 None admin] PATH_INFO: `/v3/users` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:32.300525 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f9d949-3d96-46e6-82b2-977125d7f3c8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:32.302160 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f9d949-3d96-46e6-82b2-977125d7f3c8 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:32.302316 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 124/244] 10.222.0.79 () {56 vars in 1101 bytes} [Wed Aug 31 12:15:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:32.304022 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004af78e-690a-4789-a15f-6a0f8d74e69e None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:32.366025 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 121/245] 10.222.0.79 () {60 vars in 1132 bytes} [Wed Aug 31 12:15:32 2022] POST /identity/v3/users => generated 293 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:15:32.366025 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f9d949-3d96-46e6-82b2-977125d7f3c8 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:32.437609 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:32.531944 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004af78e-690a-4789-a15f-6a0f8d74e69e None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:32.561224 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f9d949-3d96-46e6-82b2-977125d7f3c8 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:32.609609 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3460c7-5c11-461a-b76c-625f27947505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:32.610510 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3460c7-5c11-461a-b76c-625f27947505 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:32.610996 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3460c7-5c11-461a-b76c-625f27947505 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:32.611454 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3460c7-5c11-461a-b76c-625f27947505 None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:32.612317 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3460c7-5c11-461a-b76c-625f27947505 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:15:32.612782 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3460c7-5c11-461a-b76c-625f27947505 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:32.614551 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3460c7-5c11-461a-b76c-625f27947505 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:32.627134 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61ee16f-7df3-4e73-8a4a-db0f7cdd53d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:32.627647 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 125/246] 10.222.0.79 () {56 vars in 1101 bytes} [Wed Aug 31 12:15:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:32.632002 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ee16f-7df3-4e73-8a4a-db0f7cdd53d8 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:32.632002 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ee16f-7df3-4e73-8a4a-db0f7cdd53d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:32.632002 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ee16f-7df3-4e73-8a4a-db0f7cdd53d8 None admin] PATH_INFO: `/v3/users/f521b542b844420abacc131239f9458b` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:32.632946 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61ee16f-7df3-4e73-8a4a-db0f7cdd53d8 None admin] RBAC: Authorizing `identity:get_user(user_id=f521b542b844420abacc131239f9458b)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:32.634556 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61ee16f-7df3-4e73-8a4a-db0f7cdd53d8 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:32.634736 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3460c7-5c11-461a-b76c-625f27947505 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:32.636719 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 122/247] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 12:15:32 2022] GET /identity/v3/users/f521b542b844420abacc131239f9458b => generated 297 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:32.653996 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61ee16f-7df3-4e73-8a4a-db0f7cdd53d8 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:32.678125 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:32.777069 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3460c7-5c11-461a-b76c-625f27947505 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:32.802160 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61ee16f-7df3-4e73-8a4a-db0f7cdd53d8 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:32.820927 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:32.827007 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9d7858-c2eb-4703-b1e7-dee8ca31fbfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:32.828137 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d7858-c2eb-4703-b1e7-dee8ca31fbfb None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:32.828632 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d7858-c2eb-4703-b1e7-dee8ca31fbfb None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:32.829167 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d7858-c2eb-4703-b1e7-dee8ca31fbfb None admin] PATH_INFO: `/v3/users/65186cac74954cb2803c2ee2b2f55e56` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:32.847315 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9d7858-c2eb-4703-b1e7-dee8ca31fbfb None admin] RBAC: Authorizing `identity:get_user(user_id=65186cac74954cb2803c2ee2b2f55e56)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:32.849081 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9d7858-c2eb-4703-b1e7-dee8ca31fbfb None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:32.851272 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 126/248] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 12:15:32 2022] GET /identity/v3/users/65186cac74954cb2803c2ee2b2f55e56 => generated 297 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:32.852584 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74210e64-c077-42c7-8465-d9a67faa26f1 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:32.852861 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74210e64-c077-42c7-8465-d9a67faa26f1 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:32.853194 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74210e64-c077-42c7-8465-d9a67faa26f1 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:32.854583 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 127/249] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:15:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:15:32.855584 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150dde5e-4bf6-46ad-bdd5-dcf71ff9ca9e None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:32.855864 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150dde5e-4bf6-46ad-bdd5-dcf71ff9ca9e None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:32.856132 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150dde5e-4bf6-46ad-bdd5-dcf71ff9ca9e None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:32.857633 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 128/250] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:15:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:15:32.860969 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10f219b-04cf-4edb-9d1a-bd103910c7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:32.861649 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f219b-04cf-4edb-9d1a-bd103910c7fa None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:32.861933 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f219b-04cf-4edb-9d1a-bd103910c7fa None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:32.862232 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f219b-04cf-4edb-9d1a-bd103910c7fa None admin] PATH_INFO: `/v3/projects/c28fc617d7054dbeb5fd1e39107959fc` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:32.862372 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150dde5e-4bf6-46ad-bdd5-dcf71ff9ca9e None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:32.863583 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10f219b-04cf-4edb-9d1a-bd103910c7fa None admin] RBAC: Authorizing `identity:get_project(project_id=c28fc617d7054dbeb5fd1e39107959fc)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:32.865220 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10f219b-04cf-4edb-9d1a-bd103910c7fa None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:32.867003 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 123/251] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 12:15:32 2022] GET /identity/v3/projects/c28fc617d7054dbeb5fd1e39107959fc => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:15:32.868868 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e27f3da-46de-4ec1-b66e-d9d1e9c9450e None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:32.869311 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e27f3da-46de-4ec1-b66e-d9d1e9c9450e None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:32.869775 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e27f3da-46de-4ec1-b66e-d9d1e9c9450e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:32.906002 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-0e27f3da-46de-4ec1-b66e-d9d1e9c9450e None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:15:32.908426 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-0e27f3da-46de-4ec1-b66e-d9d1e9c9450e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:15:33.003086 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150dde5e-4bf6-46ad-bdd5-dcf71ff9ca9e None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:33.005086 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 124/252] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:15:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:15:33.006752 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89988d56-7b77-42b4-aa0b-50022a51b135 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:33.007266 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89988d56-7b77-42b4-aa0b-50022a51b135 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:33.007790 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89988d56-7b77-42b4-aa0b-50022a51b135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:33.029769 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-89988d56-7b77-42b4-aa0b-50022a51b135 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:15:33.031519 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-89988d56-7b77-42b4-aa0b-50022a51b135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:15:33.045269 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:33.073049 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6312f1-0792-47ab-ad0c-aa5a7307aab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:33.073596 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6312f1-0792-47ab-ad0c-aa5a7307aab6 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:33.073882 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6312f1-0792-47ab-ad0c-aa5a7307aab6 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:33.074147 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6312f1-0792-47ab-ad0c-aa5a7307aab6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:33.211072 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 125/253] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:15:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:15:33.218898 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89988d56-7b77-42b4-aa0b-50022a51b135 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:33.238385 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:33.281152 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6312f1-0792-47ab-ad0c-aa5a7307aab6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:33.284144 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6312f1-0792-47ab-ad0c-aa5a7307aab6 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:33.526243 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89988d56-7b77-42b4-aa0b-50022a51b135 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:33.635082 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 129/254] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 12:15:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 773 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:15:33.636596 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6312f1-0792-47ab-ad0c-aa5a7307aab6 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:33.642554 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d3bf69-0e93-44e7-80c3-1b8bb3953815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:33.643724 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3bf69-0e93-44e7-80c3-1b8bb3953815 None admin] REQUEST_METHOD: `PUT` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:33.645011 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3bf69-0e93-44e7-80c3-1b8bb3953815 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:33.645011 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3bf69-0e93-44e7-80c3-1b8bb3953815 None admin] PATH_INFO: `/v3/projects/c28fc617d7054dbeb5fd1e39107959fc/users/f521b542b844420abacc131239f9458b/roles/b5cfd7a855a448359e9017f51d32b6fc` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:33.648316 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d3bf69-0e93-44e7-80c3-1b8bb3953815 None admin] RBAC: Authorizing `identity:create_grant(project_id=c28fc617d7054dbeb5fd1e39107959fc, user_id=f521b542b844420abacc131239f9458b, role_id=b5cfd7a855a448359e9017f51d32b6fc)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:33.652095 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d3bf69-0e93-44e7-80c3-1b8bb3953815 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:33.685664 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 126/255] 10.222.0.79 () {58 vars in 1439 bytes} [Wed Aug 31 12:15:33 2022] PUT /identity/v3/projects/c28fc617d7054dbeb5fd1e39107959fc/users/f521b542b844420abacc131239f9458b/roles/b5cfd7a855a448359e9017f51d32b6fc => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:15:33.691240 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d3bf69-0e93-44e7-80c3-1b8bb3953815 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:33.700920 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:33.818228 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:33.869632 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6312f1-0792-47ab-ad0c-aa5a7307aab6 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:33.948386 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d3bf69-0e93-44e7-80c3-1b8bb3953815 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:33.960083 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ba6991-d23b-4d35-8091-9cad1623c3ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:33.961289 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba6991-d23b-4d35-8091-9cad1623c3ca None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:33.961784 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba6991-d23b-4d35-8091-9cad1623c3ca None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:33.962467 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba6991-d23b-4d35-8091-9cad1623c3ca None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:33.987668 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ba6991-d23b-4d35-8091-9cad1623c3ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:15:33.995852 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-87ba6991-d23b-4d35-8091-9cad1623c3ca None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 12:15:33.995852 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:15:33.995852 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:15:33.995852 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:15:33.995852 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:15:33.995852 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:15:33.995852 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:15:33.995852 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:15:33.995852 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:15:33.995852 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:15:33.995852 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:15:33.995852 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:15:33.995852 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:15:33.995852 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:15:33.995852 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:15:33.995852 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:15:33.996829 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:15:33.996829 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:15:33.996829 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:15:33.996829 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:15:33.996829 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:15:33.996829 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:15:33.996829 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:15:33.996829 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:15:33.996829 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:15:33.996829 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:15:33.996829 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:15:33.996829 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:15:33.996829 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:15:33.996829 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:15:33.996829 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:15:33.996829 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:15:33.997640 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:15:33.997640 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:15:33.997640 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:15:33.997640 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:15:33.997640 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:15:33.997640 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:15:33.997640 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:15:33.997640 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:15:33.997640 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:15:33.997640 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:15:33.997640 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 12:15:33.997640 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:15:33.999688 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 130/256] 10.222.0.79 () {56 vars in 1114 bytes} [Wed Aug 31 12:15:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:15:34.000678 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ba6991-d23b-4d35-8091-9cad1623c3ca None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:34.022557 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201bdec0-2010-49ee-99f2-54741326f73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:34.023491 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201bdec0-2010-49ee-99f2-54741326f73a None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:34.023951 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201bdec0-2010-49ee-99f2-54741326f73a None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:34.024934 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201bdec0-2010-49ee-99f2-54741326f73a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:34.037934 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201bdec0-2010-49ee-99f2-54741326f73a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:15:34.044451 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-201bdec0-2010-49ee-99f2-54741326f73a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:15:34.044451 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:15:34.044451 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:15:34.044451 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:15:34.044451 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:15:34.044451 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:15:34.044451 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:15:34.044451 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:15:34.044451 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:15:34.044451 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:15:34.044451 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:15:34.044451 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:15:34.044451 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:15:34.044451 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:15:34.044451 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:15:34.044451 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:15:34.045525 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:15:34.045525 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:15:34.045525 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:15:34.045525 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:15:34.045525 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:15:34.045525 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:15:34.045525 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:15:34.045525 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:15:34.045525 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:15:34.045525 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:15:34.045525 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:15:34.045525 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:15:34.045525 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:15:34.045525 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:15:34.045525 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:15:34.045525 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:15:34.046374 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:15:34.046374 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:15:34.046374 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:15:34.046374 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:15:34.046374 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:15:34.046374 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:15:34.046374 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:15:34.046374 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:15:34.046374 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:15:34.046374 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:15:34.046374 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:15:34.046374 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:15:34.048601 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 127/257] 10.222.0.79 () {56 vars in 1096 bytes} [Wed Aug 31 12:15:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 362 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:15:34.049604 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201bdec0-2010-49ee-99f2-54741326f73a None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:34.165062 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:34.206692 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ba6991-d23b-4d35-8091-9cad1623c3ca None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:34.219596 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201bdec0-2010-49ee-99f2-54741326f73a None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:34.267607 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fe19c1-a40c-40de-84a2-cb702e7634e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:34.269012 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe19c1-a40c-40de-84a2-cb702e7634e2 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:34.269494 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe19c1-a40c-40de-84a2-cb702e7634e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:34.270012 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe19c1-a40c-40de-84a2-cb702e7634e2 None admin] PATH_INFO: `/v3/projects/c28fc617d7054dbeb5fd1e39107959fc` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:34.271500 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fe19c1-a40c-40de-84a2-cb702e7634e2 None admin] RBAC: Authorizing `identity:get_project(project_id=c28fc617d7054dbeb5fd1e39107959fc)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:34.273357 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fe19c1-a40c-40de-84a2-cb702e7634e2 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:34.276386 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 131/258] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 12:15:33 2022] GET /identity/v3/projects/c28fc617d7054dbeb5fd1e39107959fc => generated 302 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:34.277425 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fe19c1-a40c-40de-84a2-cb702e7634e2 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:34.295827 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd89e5-0878-4b95-81f5-2435274d5121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:34.296849 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd89e5-0878-4b95-81f5-2435274d5121 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:34.297357 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd89e5-0878-4b95-81f5-2435274d5121 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:34.297851 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd89e5-0878-4b95-81f5-2435274d5121 None admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:34.298729 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cd89e5-0878-4b95-81f5-2435274d5121 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:15:34.299570 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cd89e5-0878-4b95-81f5-2435274d5121 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:34.303204 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cd89e5-0878-4b95-81f5-2435274d5121 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:34.311696 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:34.324315 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 128/259] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 12:15:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:34.325531 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd89e5-0878-4b95-81f5-2435274d5121 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:34.568782 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fe19c1-a40c-40de-84a2-cb702e7634e2 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:34.639005 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd89e5-0878-4b95-81f5-2435274d5121 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:34.687265 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2ec4e3-f4c6-4a8b-8ea8-aef9aebcd823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:34.688243 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ec4e3-f4c6-4a8b-8ea8-aef9aebcd823 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:34.688720 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ec4e3-f4c6-4a8b-8ea8-aef9aebcd823 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:34.689193 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ec4e3-f4c6-4a8b-8ea8-aef9aebcd823 None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:34.690648 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2ec4e3-f4c6-4a8b-8ea8-aef9aebcd823 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:15:34.691212 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2ec4e3-f4c6-4a8b-8ea8-aef9aebcd823 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:34.693792 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2ec4e3-f4c6-4a8b-8ea8-aef9aebcd823 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:34.730086 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 132/260] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 12:15:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 453 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:34.734169 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:34.740089 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2ec4e3-f4c6-4a8b-8ea8-aef9aebcd823 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:34.769027 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c4315d-3c41-470f-8b40-ea1558eddee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:34.770130 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c4315d-3c41-470f-8b40-ea1558eddee1 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:34.774008 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c4315d-3c41-470f-8b40-ea1558eddee1 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:34.775760 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c4315d-3c41-470f-8b40-ea1558eddee1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:34.777211 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c4315d-3c41-470f-8b40-ea1558eddee1 None admin] RBAC: Adding query filter params (role.id=6a7464b68efb4b3089ce4d0d8d03fdf3, scope.project.id=c28fc617d7054dbeb5fd1e39107959fc, user.id=65186cac74954cb2803c2ee2b2f55e56) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:15:34.778394 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c4315d-3c41-470f-8b40-ea1558eddee1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:34.781762 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c4315d-3c41-470f-8b40-ea1558eddee1 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:34.801807 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 129/261] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 12:15:34 2022] GET /identity/v3/role_assignments?user.id=65186cac74954cb2803c2ee2b2f55e56&scope.project.id=c28fc617d7054dbeb5fd1e39107959fc&role.id=6a7464b68efb4b3089ce4d0d8d03fdf3 => generated 259 bytes in 476 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:34.803114 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c4315d-3c41-470f-8b40-ea1558eddee1 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:35.023935 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:35.074491 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c4315d-3c41-470f-8b40-ea1558eddee1 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:35.092979 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2ec4e3-f4c6-4a8b-8ea8-aef9aebcd823 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:35.112748 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7b3634-3341-49fb-ab6c-d115fd265645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:35.113562 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b3634-3341-49fb-ab6c-d115fd265645 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:35.113849 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b3634-3341-49fb-ab6c-d115fd265645 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:35.114124 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b3634-3341-49fb-ab6c-d115fd265645 None admin] PATH_INFO: `/v3/users/d7da81fe1a1e486eb2f8d911a1dc1775` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:35.115393 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7b3634-3341-49fb-ab6c-d115fd265645 None admin] RBAC: Authorizing `identity:get_user(user_id=d7da81fe1a1e486eb2f8d911a1dc1775)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:35.116889 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7b3634-3341-49fb-ab6c-d115fd265645 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:35.119609 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 130/262] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 12:15:34 2022] GET /identity/v3/users/d7da81fe1a1e486eb2f8d911a1dc1775 => generated 283 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:35.125269 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7b3634-3341-49fb-ab6c-d115fd265645 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:35.177879 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6d3bae-abb3-46f1-90cf-9539fa596d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:35.180277 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d3bae-abb3-46f1-90cf-9539fa596d8f None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:35.180277 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d3bae-abb3-46f1-90cf-9539fa596d8f None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:35.180277 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d3bae-abb3-46f1-90cf-9539fa596d8f None admin] PATH_INFO: `/v3/users/d7da81fe1a1e486eb2f8d911a1dc1775` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:35.180277 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6d3bae-abb3-46f1-90cf-9539fa596d8f None admin] RBAC: Authorizing `identity:get_user(user_id=d7da81fe1a1e486eb2f8d911a1dc1775)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:35.182757 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6d3bae-abb3-46f1-90cf-9539fa596d8f None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:35.184773 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 133/263] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 12:15:34 2022] GET /identity/v3/users/d7da81fe1a1e486eb2f8d911a1dc1775 => generated 283 bytes in 454 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:35.190892 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6d3bae-abb3-46f1-90cf-9539fa596d8f None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:35.303585 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:35.409121 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7b3634-3341-49fb-ab6c-d115fd265645 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:35.481025 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6d3bae-abb3-46f1-90cf-9539fa596d8f None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:35.502192 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a67ab7-f687-4c2e-bdc2-e5a90b3fc1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:35.503293 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a67ab7-f687-4c2e-bdc2-e5a90b3fc1e4 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:35.503772 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a67ab7-f687-4c2e-bdc2-e5a90b3fc1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:35.504221 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a67ab7-f687-4c2e-bdc2-e5a90b3fc1e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:35.546140 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cb8492-b1ac-441e-933a-7ea3283a910b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:35.546772 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cb8492-b1ac-441e-933a-7ea3283a910b None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:35.547084 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cb8492-b1ac-441e-933a-7ea3283a910b None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:35.547361 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cb8492-b1ac-441e-933a-7ea3283a910b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:35.567083 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:35.644065 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cb8492-b1ac-441e-933a-7ea3283a910b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:35.645823 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cb8492-b1ac-441e-933a-7ea3283a910b None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:35.777799 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a67ab7-f687-4c2e-bdc2-e5a90b3fc1e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:35.780464 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a67ab7-f687-4c2e-bdc2-e5a90b3fc1e4 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:35.950461 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 134/264] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 12:15:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 758 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:15:35.957020 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cb8492-b1ac-441e-933a-7ea3283a910b None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:36.014549 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:36.118142 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:36.171035 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 131/265] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 12:15:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 1046 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:15:36.178603 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a67ab7-f687-4c2e-bdc2-e5a90b3fc1e4 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:36.354528 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cb8492-b1ac-441e-933a-7ea3283a910b None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:36.516052 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebac1ca-be08-49d6-b869-a051d57a7e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:36.517012 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebac1ca-be08-49d6-b869-a051d57a7e66 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:36.517406 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebac1ca-be08-49d6-b869-a051d57a7e66 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:36.517915 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebac1ca-be08-49d6-b869-a051d57a7e66 None admin] PATH_INFO: `/v3/projects/c28fc617d7054dbeb5fd1e39107959fc` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:36.524056 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebac1ca-be08-49d6-b869-a051d57a7e66 None admin] RBAC: Authorizing `identity:get_project(project_id=c28fc617d7054dbeb5fd1e39107959fc)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:36.527382 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebac1ca-be08-49d6-b869-a051d57a7e66 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:36.530549 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 135/266] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 12:15:35 2022] GET /identity/v3/projects/c28fc617d7054dbeb5fd1e39107959fc => generated 302 bytes in 575 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:15:36.538421 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebac1ca-be08-49d6-b869-a051d57a7e66 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:36.543245 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a67ab7-f687-4c2e-bdc2-e5a90b3fc1e4 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:36.662625 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86062fdf-46db-4217-a208-9a64fa7f1c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:36.663565 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86062fdf-46db-4217-a208-9a64fa7f1c5c None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:36.663987 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86062fdf-46db-4217-a208-9a64fa7f1c5c None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:36.664408 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86062fdf-46db-4217-a208-9a64fa7f1c5c None admin] PATH_INFO: `/v3/projects/c28fc617d7054dbeb5fd1e39107959fc` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:36.667046 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86062fdf-46db-4217-a208-9a64fa7f1c5c None admin] RBAC: Authorizing `identity:get_project(project_id=c28fc617d7054dbeb5fd1e39107959fc)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:36.669709 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86062fdf-46db-4217-a208-9a64fa7f1c5c None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:36.675617 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 132/267] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 12:15:36 2022] GET /identity/v3/projects/c28fc617d7054dbeb5fd1e39107959fc => generated 302 bytes in 498 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:15:36.690897 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8384fbda-13f3-4311-96ab-5e744850baa9 None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:36.691719 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8384fbda-13f3-4311-96ab-5e744850baa9 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:36.692770 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8384fbda-13f3-4311-96ab-5e744850baa9 None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:36.699808 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 133/268] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:15:36 2022] GET /identity => generated 270 bytes in 23 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:15:36.701439 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8384fbda-13f3-4311-96ab-5e744850baa9 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:36.791177 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:36.893188 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebac1ca-be08-49d6-b869-a051d57a7e66 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:36.917951 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:36.926657 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8384fbda-13f3-4311-96ab-5e744850baa9 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:36.971853 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b862639-442d-497f-bd6c-5810da452e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:36.972146 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93874c73-ed4d-41c2-90a8-77862fc6f987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:36.973103 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93874c73-ed4d-41c2-90a8-77862fc6f987 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:36.973603 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93874c73-ed4d-41c2-90a8-77862fc6f987 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:36.973892 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93874c73-ed4d-41c2-90a8-77862fc6f987 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:36.974056 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b862639-442d-497f-bd6c-5810da452e62 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:36.974651 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93874c73-ed4d-41c2-90a8-77862fc6f987 None admin] RBAC: Adding query filter params (role.id=a332ef951db949b0bad7019fbd28a1b9, scope.project.id=c28fc617d7054dbeb5fd1e39107959fc, user.id=d7da81fe1a1e486eb2f8d911a1dc1775) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:15:36.974998 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93874c73-ed4d-41c2-90a8-77862fc6f987 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:36.975163 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b862639-442d-497f-bd6c-5810da452e62 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:36.975839 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b862639-442d-497f-bd6c-5810da452e62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:36.976498 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93874c73-ed4d-41c2-90a8-77862fc6f987 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:36.977780 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b862639-442d-497f-bd6c-5810da452e62 None admin] RBAC: Adding query filter params (role.id=be23fee6ea264172b277f97af30cc689, scope.project.id=c28fc617d7054dbeb5fd1e39107959fc, user.id=d7da81fe1a1e486eb2f8d911a1dc1775) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:15:36.978568 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b862639-442d-497f-bd6c-5810da452e62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:36.981843 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b862639-442d-497f-bd6c-5810da452e62 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:36.991160 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 134/269] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 12:15:36 2022] GET /identity/v3/role_assignments?user.id=d7da81fe1a1e486eb2f8d911a1dc1775&scope.project.id=c28fc617d7054dbeb5fd1e39107959fc&role.id=a332ef951db949b0bad7019fbd28a1b9 => generated 608 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:36.993172 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6321e5-4d87-4f51-8c8b-730ed5647448 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:36.993588 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6321e5-4d87-4f51-8c8b-730ed5647448 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:36.993871 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6321e5-4d87-4f51-8c8b-730ed5647448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:36.996016 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 136/270] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 12:15:36 2022] GET /identity/v3/role_assignments?user.id=d7da81fe1a1e486eb2f8d911a1dc1775&scope.project.id=c28fc617d7054dbeb5fd1e39107959fc&role.id=be23fee6ea264172b277f97af30cc689 => generated 608 bytes in 459 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:36.998613 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6fa78-5aa7-4176-8298-c7366863dc2f None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:36.999366 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6fa78-5aa7-4176-8298-c7366863dc2f None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:37.000138 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6fa78-5aa7-4176-8298-c7366863dc2f None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:37.002807 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 137/271] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:15:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:15:37.030108 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a071570-99f3-457f-b636-90dee58e9a76 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:37.031026 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a071570-99f3-457f-b636-90dee58e9a76 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:37.031718 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a071570-99f3-457f-b636-90dee58e9a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:37.043045 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-2f6321e5-4d87-4f51-8c8b-730ed5647448 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:15:37.044748 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-2f6321e5-4d87-4f51-8c8b-730ed5647448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:15:37.093494 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-3a071570-99f3-457f-b636-90dee58e9a76 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:15:37.095861 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-3a071570-99f3-457f-b636-90dee58e9a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:15:37.205039 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 138/272] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:15:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:15:37.224820 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 135/273] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:15:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:15:37.504468 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253f6cd-4d9c-4193-8838-713a6d33aca8 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:37.504999 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253f6cd-4d9c-4193-8838-713a6d33aca8 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:37.505432 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253f6cd-4d9c-4193-8838-713a6d33aca8 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:37.507361 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 139/274] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:15:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:15:37.516566 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43d48d5-82e7-4f98-8c45-ff0403a1ce84 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:37.517068 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43d48d5-82e7-4f98-8c45-ff0403a1ce84 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:37.517561 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43d48d5-82e7-4f98-8c45-ff0403a1ce84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:37.560468 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-f43d48d5-82e7-4f98-8c45-ff0403a1ce84 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:15:37.562567 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-f43d48d5-82e7-4f98-8c45-ff0403a1ce84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:15:37.594371 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:37.620254 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3dc47b-6c77-4cd4-a503-477f20749522 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:37.621604 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3dc47b-6c77-4cd4-a503-477f20749522 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:37.622097 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3dc47b-6c77-4cd4-a503-477f20749522 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:37.627952 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 140/275] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:15:37 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:15:37.633988 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a34754c-22cf-4472-bab1-778fd5b9f93c None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:37.634226 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a34754c-22cf-4472-bab1-778fd5b9f93c None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:37.634568 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a34754c-22cf-4472-bab1-778fd5b9f93c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:37.654665 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-7a34754c-22cf-4472-bab1-778fd5b9f93c None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:15:37.656157 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-7a34754c-22cf-4472-bab1-778fd5b9f93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:15:37.740918 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 136/276] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:15:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:15:37.742218 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 141/277] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:15:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:15:37.746944 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43d48d5-82e7-4f98-8c45-ff0403a1ce84 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:37.822118 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a34754c-22cf-4472-bab1-778fd5b9f93c None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:37.862570 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:37.948499 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43d48d5-82e7-4f98-8c45-ff0403a1ce84 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:37.957833 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a34754c-22cf-4472-bab1-778fd5b9f93c None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:37.993666 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce69e2a7-8363-477e-8ad2-be49a00926ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:37.994477 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69e2a7-8363-477e-8ad2-be49a00926ac None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:37.994882 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69e2a7-8363-477e-8ad2-be49a00926ac None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:37.995406 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69e2a7-8363-477e-8ad2-be49a00926ac None admin] PATH_INFO: `/v3/roles/member` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:38.004138 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02faaed3-8a41-45e0-9f9f-dafccca93199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:38.004817 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02faaed3-8a41-45e0-9f9f-dafccca93199 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:38.005095 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02faaed3-8a41-45e0-9f9f-dafccca93199 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:38.005362 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02faaed3-8a41-45e0-9f9f-dafccca93199 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:38.006673 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02faaed3-8a41-45e0-9f9f-dafccca93199 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:38.008322 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02faaed3-8a41-45e0-9f9f-dafccca93199 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:38.010583 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 142/278] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:15:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:38.015137 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce69e2a7-8363-477e-8ad2-be49a00926ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:15:38.019982 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02faaed3-8a41-45e0-9f9f-dafccca93199 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:38.022676 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-ce69e2a7-8363-477e-8ad2-be49a00926ac None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:15:38.022676 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:15:38.022676 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:15:38.022676 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:15:38.022676 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:15:38.022676 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:15:38.022676 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:15:38.022676 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:15:38.022676 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:15:38.022676 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:15:38.022676 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:15:38.022676 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:15:38.022676 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:15:38.022676 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:15:38.022676 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:15:38.022676 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:15:38.023754 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:15:38.023754 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:15:38.023754 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:15:38.023754 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:15:38.023754 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:15:38.023754 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:15:38.023754 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:15:38.023754 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:15:38.023754 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:15:38.023754 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:15:38.023754 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:15:38.023754 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:15:38.023754 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:15:38.023754 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:15:38.023754 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:15:38.023754 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:15:38.025742 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:15:38.025742 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:15:38.025742 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:15:38.025742 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:15:38.025742 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:15:38.025742 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:15:38.025742 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:15:38.025742 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:15:38.025742 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:15:38.025742 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:15:38.025742 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:15:38.025742 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:15:38.033276 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 137/279] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 12:15:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:15:38.034635 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce69e2a7-8363-477e-8ad2-be49a00926ac None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:38.056821 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:38.167854 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce69e2a7-8363-477e-8ad2-be49a00926ac None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:38.191169 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02faaed3-8a41-45e0-9f9f-dafccca93199 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:38.192981 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:38.207450 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a0bed0-6187-4cce-87fc-369aba1db754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:38.208082 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a0bed0-6187-4cce-87fc-369aba1db754 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:38.208362 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a0bed0-6187-4cce-87fc-369aba1db754 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:38.208632 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a0bed0-6187-4cce-87fc-369aba1db754 None admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:38.209321 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a0bed0-6187-4cce-87fc-369aba1db754 None admin] RBAC: Adding query filter params (name=member) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:15:38.209619 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a0bed0-6187-4cce-87fc-369aba1db754 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:38.211365 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a0bed0-6187-4cce-87fc-369aba1db754 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:38.225109 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 138/280] 10.222.0.79 () {56 vars in 1101 bytes} [Wed Aug 31 12:15:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:38.226516 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a0bed0-6187-4cce-87fc-369aba1db754 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:38.241995 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98c1e22-2827-4cc8-b5d5-bcc4f8fcb719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:38.242614 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98c1e22-2827-4cc8-b5d5-bcc4f8fcb719 None admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:38.243493 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98c1e22-2827-4cc8-b5d5-bcc4f8fcb719 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:38.243792 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98c1e22-2827-4cc8-b5d5-bcc4f8fcb719 None admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:38.244521 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98c1e22-2827-4cc8-b5d5-bcc4f8fcb719 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:38.245998 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98c1e22-2827-4cc8-b5d5-bcc4f8fcb719 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:38.273061 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 143/281] 10.222.0.79 () {60 vars in 1132 bytes} [Wed Aug 31 12:15:38 2022] POST /identity/v3/users => generated 293 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:15:38.276847 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98c1e22-2827-4cc8-b5d5-bcc4f8fcb719 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:38.329571 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:38.381327 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a0bed0-6187-4cce-87fc-369aba1db754 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:38.432160 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98c1e22-2827-4cc8-b5d5-bcc4f8fcb719 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:38.445408 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a4ca37-9230-4db4-ada4-c0977a621a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:38.447756 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4ca37-9230-4db4-ada4-c0977a621a16 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:38.448105 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4ca37-9230-4db4-ada4-c0977a621a16 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:38.448384 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4ca37-9230-4db4-ada4-c0977a621a16 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:38.466006 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a4ca37-9230-4db4-ada4-c0977a621a16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:15:38.471825 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-54a4ca37-9230-4db4-ada4-c0977a621a16 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:15:38.471825 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:15:38.471825 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:15:38.471825 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:15:38.471825 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:15:38.471825 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:15:38.471825 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:15:38.471825 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:15:38.471825 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:15:38.471825 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:15:38.471825 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:15:38.471825 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:15:38.471825 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:15:38.471825 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:15:38.471825 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:15:38.471825 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:15:38.472841 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:15:38.472841 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:15:38.472841 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:15:38.472841 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:15:38.472841 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:15:38.472841 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:15:38.472841 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:15:38.472841 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:15:38.472841 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:15:38.472841 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:15:38.472841 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:15:38.472841 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:15:38.472841 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:15:38.472841 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:15:38.472841 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:15:38.472841 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:15:38.473670 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:15:38.473670 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:15:38.473670 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:15:38.473670 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:15:38.473670 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:15:38.473670 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:15:38.473670 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:15:38.473670 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:15:38.473670 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:15:38.473670 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:15:38.473670 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:15:38.473670 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:15:38.473670 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 139/282] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 12:15:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:15:38.474336 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a4ca37-9230-4db4-ada4-c0977a621a16 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:38.496237 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe24f0c1-9eee-4924-9283-c9d1f3221d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:38.496890 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe24f0c1-9eee-4924-9283-c9d1f3221d74 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:38.497169 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe24f0c1-9eee-4924-9283-c9d1f3221d74 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:38.497433 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe24f0c1-9eee-4924-9283-c9d1f3221d74 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:38.514154 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe24f0c1-9eee-4924-9283-c9d1f3221d74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:15:38.520254 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-fe24f0c1-9eee-4924-9283-c9d1f3221d74 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 12:15:38.520254 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:15:38.520254 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:15:38.520254 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:15:38.520254 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:15:38.520254 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:15:38.520254 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:15:38.520254 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:15:38.520254 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:15:38.520254 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:15:38.520254 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:15:38.520254 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:15:38.520254 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:15:38.520254 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:15:38.520254 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:15:38.520254 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:15:38.521349 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:15:38.521349 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:15:38.521349 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:15:38.521349 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:15:38.521349 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:15:38.521349 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:15:38.521349 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:15:38.521349 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:15:38.521349 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:15:38.521349 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:15:38.521349 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:15:38.521349 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:15:38.521349 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:15:38.521349 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:15:38.521349 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:15:38.521349 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:15:38.522266 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:15:38.522266 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:15:38.522266 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:15:38.522266 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:15:38.522266 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:15:38.522266 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:15:38.522266 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:15:38.522266 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:15:38.522266 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:15:38.522266 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:15:38.522266 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 12:15:38.522266 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:15:38.525507 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 144/283] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 12:15:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:15:38.526994 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe24f0c1-9eee-4924-9283-c9d1f3221d74 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:38.561855 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:38.639567 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a4ca37-9230-4db4-ada4-c0977a621a16 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:38.685757 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:38.694468 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbdf263-a39e-4626-af20-b6f01ac048e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:38.695567 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbdf263-a39e-4626-af20-b6f01ac048e5 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:38.695567 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbdf263-a39e-4626-af20-b6f01ac048e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:38.695833 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbdf263-a39e-4626-af20-b6f01ac048e5 None admin] PATH_INFO: `/v3/users/d8ef83bac0494f4091de1c6cdef0d63f` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:38.715494 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbdf263-a39e-4626-af20-b6f01ac048e5 None admin] RBAC: Authorizing `identity:get_user(user_id=d8ef83bac0494f4091de1c6cdef0d63f)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:38.718278 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbdf263-a39e-4626-af20-b6f01ac048e5 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:38.721427 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe24f0c1-9eee-4924-9283-c9d1f3221d74 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:38.721908 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 140/284] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 12:15:38 2022] GET /identity/v3/users/d8ef83bac0494f4091de1c6cdef0d63f => generated 293 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:38.723503 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbdf263-a39e-4626-af20-b6f01ac048e5 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:38.764274 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc70673-fb6c-4536-9964-d9b6a154ecfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:38.765341 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc70673-fb6c-4536-9964-d9b6a154ecfe None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:38.765880 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc70673-fb6c-4536-9964-d9b6a154ecfe None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:38.766456 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc70673-fb6c-4536-9964-d9b6a154ecfe None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:38.767280 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc70673-fb6c-4536-9964-d9b6a154ecfe None admin] RBAC: Adding query filter params (name=member) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:15:38.767653 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc70673-fb6c-4536-9964-d9b6a154ecfe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:38.769262 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc70673-fb6c-4536-9964-d9b6a154ecfe None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:38.780632 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 145/285] 10.222.0.79 () {56 vars in 1101 bytes} [Wed Aug 31 12:15:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:38.781947 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc70673-fb6c-4536-9964-d9b6a154ecfe None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:38.886660 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:38.923933 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc70673-fb6c-4536-9964-d9b6a154ecfe None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:38.954025 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbdf263-a39e-4626-af20-b6f01ac048e5 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:38.989211 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16563a57-7d92-47b8-9611-363182854207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:38.990183 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16563a57-7d92-47b8-9611-363182854207 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:38.990658 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16563a57-7d92-47b8-9611-363182854207 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:38.991180 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16563a57-7d92-47b8-9611-363182854207 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:38.992622 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16563a57-7d92-47b8-9611-363182854207 None admin] RBAC: Adding query filter params (role.id=b5cfd7a855a448359e9017f51d32b6fc, user.id=d8ef83bac0494f4091de1c6cdef0d63f, scope.system=all) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:15:38.993244 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16563a57-7d92-47b8-9611-363182854207 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:38.997093 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16563a57-7d92-47b8-9611-363182854207 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:39.006247 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 146/286] 10.222.0.79 () {56 vars in 1308 bytes} [Wed Aug 31 12:15:38 2022] GET /identity/v3/role_assignments?user.id=d8ef83bac0494f4091de1c6cdef0d63f&scope.system=all&role.id=b5cfd7a855a448359e9017f51d32b6fc => generated 226 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:39.007800 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16563a57-7d92-47b8-9611-363182854207 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:39.031383 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5fdd96-5891-4e9b-96e2-8b025d59faed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:39.036186 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5fdd96-5891-4e9b-96e2-8b025d59faed None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:39.037250 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5fdd96-5891-4e9b-96e2-8b025d59faed None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:39.042886 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5fdd96-5891-4e9b-96e2-8b025d59faed None admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:39.042886 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5fdd96-5891-4e9b-96e2-8b025d59faed None admin] RBAC: Adding query filter params (name=reader) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:15:39.042886 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5fdd96-5891-4e9b-96e2-8b025d59faed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:39.047784 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5fdd96-5891-4e9b-96e2-8b025d59faed None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:39.067640 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 141/287] 10.222.0.79 () {56 vars in 1101 bytes} [Wed Aug 31 12:15:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:39.076700 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5fdd96-5891-4e9b-96e2-8b025d59faed None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:39.202409 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:39.268647 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5fdd96-5891-4e9b-96e2-8b025d59faed None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:39.293221 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16563a57-7d92-47b8-9611-363182854207 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:39.366789 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b487f9e5-029f-4f0a-bc9e-5be27240153a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:39.368096 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487f9e5-029f-4f0a-bc9e-5be27240153a None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:39.368379 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487f9e5-029f-4f0a-bc9e-5be27240153a None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:39.368645 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487f9e5-029f-4f0a-bc9e-5be27240153a None admin] PATH_INFO: `/v3/users/65186cac74954cb2803c2ee2b2f55e56` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:39.371323 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b97ddb1-7a0a-4af5-8301-1b72417f78ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:39.371989 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b97ddb1-7a0a-4af5-8301-1b72417f78ea None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:39.372264 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b97ddb1-7a0a-4af5-8301-1b72417f78ea None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:39.372532 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b97ddb1-7a0a-4af5-8301-1b72417f78ea None admin] PATH_INFO: `/v3/users/f521b542b844420abacc131239f9458b` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:39.373957 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b487f9e5-029f-4f0a-bc9e-5be27240153a None admin] RBAC: Authorizing `identity:get_user(user_id=65186cac74954cb2803c2ee2b2f55e56)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:39.375506 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b487f9e5-029f-4f0a-bc9e-5be27240153a None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:39.376786 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b97ddb1-7a0a-4af5-8301-1b72417f78ea None admin] RBAC: Authorizing `identity:get_user(user_id=f521b542b844420abacc131239f9458b)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:39.380221 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b97ddb1-7a0a-4af5-8301-1b72417f78ea None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:39.381998 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 147/288] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 12:15:39 2022] GET /identity/v3/users/f521b542b844420abacc131239f9458b => generated 297 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:39.382314 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 142/289] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 12:15:39 2022] GET /identity/v3/users/65186cac74954cb2803c2ee2b2f55e56 => generated 297 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:39.388883 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b97ddb1-7a0a-4af5-8301-1b72417f78ea None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:39.389141 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b487f9e5-029f-4f0a-bc9e-5be27240153a None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:39.417691 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:39.593338 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b487f9e5-029f-4f0a-bc9e-5be27240153a None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:39.659200 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:39.689211 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b97ddb1-7a0a-4af5-8301-1b72417f78ea None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:39.712267 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85a212f-fcb2-4efd-8b15-200832fb3827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:39.713332 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a212f-fcb2-4efd-8b15-200832fb3827 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:39.713712 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a212f-fcb2-4efd-8b15-200832fb3827 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:39.714088 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a212f-fcb2-4efd-8b15-200832fb3827 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:39.768682 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412d4ec7-04d4-4097-a3a1-4eff73812217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:39.770569 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412d4ec7-04d4-4097-a3a1-4eff73812217 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:39.771279 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412d4ec7-04d4-4097-a3a1-4eff73812217 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:39.772988 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412d4ec7-04d4-4097-a3a1-4eff73812217 None admin] PATH_INFO: `/v3/projects/c28fc617d7054dbeb5fd1e39107959fc` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:39.776053 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412d4ec7-04d4-4097-a3a1-4eff73812217 None admin] RBAC: Authorizing `identity:get_project(project_id=c28fc617d7054dbeb5fd1e39107959fc)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:39.781472 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412d4ec7-04d4-4097-a3a1-4eff73812217 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:39.792471 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 148/290] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 12:15:39 2022] GET /identity/v3/projects/c28fc617d7054dbeb5fd1e39107959fc => generated 302 bytes in 404 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:39.804296 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412d4ec7-04d4-4097-a3a1-4eff73812217 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:39.946885 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85a212f-fcb2-4efd-8b15-200832fb3827 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:39.948143 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85a212f-fcb2-4efd-8b15-200832fb3827 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:40.035134 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:40.060593 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412d4ec7-04d4-4097-a3a1-4eff73812217 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:40.110821 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28967c0e-d4b3-4110-ab04-ac0f5aa5491a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:40.113629 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28967c0e-d4b3-4110-ab04-ac0f5aa5491a None admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:40.114094 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28967c0e-d4b3-4110-ab04-ac0f5aa5491a None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:40.114472 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28967c0e-d4b3-4110-ab04-ac0f5aa5491a None admin] PATH_INFO: `/v3/projects/c28fc617d7054dbeb5fd1e39107959fc/users/65186cac74954cb2803c2ee2b2f55e56/roles/6a7464b68efb4b3089ce4d0d8d03fdf3` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:40.121423 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28967c0e-d4b3-4110-ab04-ac0f5aa5491a None admin] RBAC: Authorizing `identity:create_grant(project_id=c28fc617d7054dbeb5fd1e39107959fc, user_id=65186cac74954cb2803c2ee2b2f55e56, role_id=6a7464b68efb4b3089ce4d0d8d03fdf3)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:40.124128 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28967c0e-d4b3-4110-ab04-ac0f5aa5491a None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:40.162038 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 149/291] 10.222.0.79 () {58 vars in 1439 bytes} [Wed Aug 31 12:15:39 2022] PUT /identity/v3/projects/c28fc617d7054dbeb5fd1e39107959fc/users/65186cac74954cb2803c2ee2b2f55e56/roles/6a7464b68efb4b3089ce4d0d8d03fdf3 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:15:40.224204 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 143/292] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 12:15:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 836 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:15:40.231304 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28967c0e-d4b3-4110-ab04-ac0f5aa5491a None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:40.420201 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28967c0e-d4b3-4110-ab04-ac0f5aa5491a None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:40.474014 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8b5e4a-0a10-4a34-9f04-4ab03a1b2e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:40.475333 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b5e4a-0a10-4a34-9f04-4ab03a1b2e51 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:40.475740 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b5e4a-0a10-4a34-9f04-4ab03a1b2e51 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:40.476229 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b5e4a-0a10-4a34-9f04-4ab03a1b2e51 None admin] PATH_INFO: `/v3/projects/c28fc617d7054dbeb5fd1e39107959fc` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:40.478885 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8b5e4a-0a10-4a34-9f04-4ab03a1b2e51 None admin] RBAC: Authorizing `identity:get_project(project_id=c28fc617d7054dbeb5fd1e39107959fc)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:40.481643 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8b5e4a-0a10-4a34-9f04-4ab03a1b2e51 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:40.485460 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 150/293] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 12:15:40 2022] GET /identity/v3/projects/c28fc617d7054dbeb5fd1e39107959fc => generated 302 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:40.495571 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85a212f-fcb2-4efd-8b15-200832fb3827 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:40.555980 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:40.771212 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85a212f-fcb2-4efd-8b15-200832fb3827 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:40.841579 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28014c84-486e-4571-8698-ba84c0465aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:40.842731 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28014c84-486e-4571-8698-ba84c0465aa2 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:40.843241 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28014c84-486e-4571-8698-ba84c0465aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:40.843702 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28014c84-486e-4571-8698-ba84c0465aa2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:40.845120 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28014c84-486e-4571-8698-ba84c0465aa2 None admin] RBAC: Adding query filter params (role.id=b5cfd7a855a448359e9017f51d32b6fc, scope.project.id=c28fc617d7054dbeb5fd1e39107959fc, user.id=f521b542b844420abacc131239f9458b) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:15:40.845651 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28014c84-486e-4571-8698-ba84c0465aa2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:40.848452 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28014c84-486e-4571-8698-ba84c0465aa2 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:40.861012 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 144/294] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 12:15:40 2022] GET /identity/v3/role_assignments?user.id=f521b542b844420abacc131239f9458b&scope.project.id=c28fc617d7054dbeb5fd1e39107959fc&role.id=b5cfd7a855a448359e9017f51d32b6fc => generated 608 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:40.928840 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29eb5f-70ae-41a7-87ff-dbd0e3281521 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:40.929396 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29eb5f-70ae-41a7-87ff-dbd0e3281521 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:40.929805 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29eb5f-70ae-41a7-87ff-dbd0e3281521 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:40.933525 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 151/295] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:15:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:15:40.939969 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1535d03e-caef-4673-9f6a-6a7ef01ab6bb None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:40.940430 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1535d03e-caef-4673-9f6a-6a7ef01ab6bb None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:40.940870 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1535d03e-caef-4673-9f6a-6a7ef01ab6bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:40.976003 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-1535d03e-caef-4673-9f6a-6a7ef01ab6bb None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:15:40.978154 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-1535d03e-caef-4673-9f6a-6a7ef01ab6bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:15:41.097124 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 145/296] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:15:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:15:41.348061 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39d24f-ac3a-4653-afc5-2b279bfd90b1 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:41.348422 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39d24f-ac3a-4653-afc5-2b279bfd90b1 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:41.348826 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39d24f-ac3a-4653-afc5-2b279bfd90b1 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:41.360299 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 152/297] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:15:41 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:15:41.369553 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a79f3e7-92b4-4367-a18b-0937f9361494 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:41.370046 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a79f3e7-92b4-4367-a18b-0937f9361494 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:41.370524 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a79f3e7-92b4-4367-a18b-0937f9361494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:41.389538 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a39d24f-ac3a-4653-afc5-2b279bfd90b1 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:41.399923 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-5a79f3e7-92b4-4367-a18b-0937f9361494 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:15:41.401145 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-5a79f3e7-92b4-4367-a18b-0937f9361494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:15:41.412559 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:41.422505 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:41.504725 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 146/298] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:15:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:15:41.575368 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a39d24f-ac3a-4653-afc5-2b279bfd90b1 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:41.615603 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d8859a-183e-467d-b517-57c63a015fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:41.616086 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d8859a-183e-467d-b517-57c63a015fd6 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:41.616421 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d8859a-183e-467d-b517-57c63a015fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:41.616695 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d8859a-183e-467d-b517-57c63a015fd6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:41.630545 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d8859a-183e-467d-b517-57c63a015fd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:15:41.636334 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-f7d8859a-183e-467d-b517-57c63a015fd6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 12:15:41.636334 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:15:41.636334 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:15:41.636334 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:15:41.636334 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:15:41.636334 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:15:41.636334 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:15:41.636334 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:15:41.636334 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:15:41.636334 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:15:41.636334 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:15:41.636334 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:15:41.636334 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:15:41.636334 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:15:41.636334 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:15:41.636334 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:15:41.638090 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:15:41.638090 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:15:41.638090 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:15:41.638090 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:15:41.638090 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:15:41.638090 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:15:41.638090 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:15:41.638090 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:15:41.638090 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:15:41.638090 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:15:41.638090 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:15:41.638090 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:15:41.638090 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:15:41.638090 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:15:41.638090 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:15:41.638090 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:15:41.639696 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:15:41.639696 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:15:41.639696 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:15:41.639696 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:15:41.639696 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:15:41.639696 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:15:41.639696 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:15:41.639696 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:15:41.639696 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:15:41.639696 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:15:41.639696 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 12:15:41.639696 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:15:41.645302 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 153/299] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 12:15:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:15:41.645522 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a79f3e7-92b4-4367-a18b-0937f9361494 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:41.681176 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfbb986-7e1c-4980-818f-affb6bfdf95a None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:41.681492 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfbb986-7e1c-4980-818f-affb6bfdf95a None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:41.681709 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfbb986-7e1c-4980-818f-affb6bfdf95a None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:41.683470 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 154/300] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:15:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:15:41.689093 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7deb31d-a62b-4e6b-9203-23c23efe717e None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:41.689362 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7deb31d-a62b-4e6b-9203-23c23efe717e None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:41.689626 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7deb31d-a62b-4e6b-9203-23c23efe717e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:41.709476 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-d7deb31d-a62b-4e6b-9203-23c23efe717e None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:15:41.711010 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-d7deb31d-a62b-4e6b-9203-23c23efe717e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:15:41.788952 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:41.794660 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a79f3e7-92b4-4367-a18b-0937f9361494 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:41.802889 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 155/301] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:15:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 12:15:41.841176 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21935a2-4908-45e8-929b-b79bf0698afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:41.841818 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21935a2-4908-45e8-929b-b79bf0698afd None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:41.842103 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21935a2-4908-45e8-929b-b79bf0698afd None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:41.842385 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21935a2-4908-45e8-929b-b79bf0698afd None admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:41.843097 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21935a2-4908-45e8-929b-b79bf0698afd None admin] RBAC: Adding query filter params (name=reader) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:15:41.843409 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21935a2-4908-45e8-929b-b79bf0698afd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:41.844936 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21935a2-4908-45e8-929b-b79bf0698afd None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:41.859932 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 147/302] 10.222.0.79 () {56 vars in 1101 bytes} [Wed Aug 31 12:15:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:41.861452 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7deb31d-a62b-4e6b-9203-23c23efe717e None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:42.002791 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7deb31d-a62b-4e6b-9203-23c23efe717e None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:42.016523 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21935a2-4908-45e8-929b-b79bf0698afd None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:42.035296 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:42.077878 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a326ee-40fc-4458-9487-682e0ecd8e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:42.078945 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a326ee-40fc-4458-9487-682e0ecd8e2c None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:42.079400 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a326ee-40fc-4458-9487-682e0ecd8e2c None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:42.079848 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a326ee-40fc-4458-9487-682e0ecd8e2c None admin] PATH_INFO: `/v3/users/90076e4e890d472fad8d9e63e58f0685` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:42.110625 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a326ee-40fc-4458-9487-682e0ecd8e2c None admin] RBAC: Authorizing `identity:get_user(user_id=90076e4e890d472fad8d9e63e58f0685)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:42.112844 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a326ee-40fc-4458-9487-682e0ecd8e2c None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:42.115248 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 156/303] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 12:15:41 2022] GET /identity/v3/users/90076e4e890d472fad8d9e63e58f0685 => generated 293 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:15:42.116307 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a326ee-40fc-4458-9487-682e0ecd8e2c None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:42.184790 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21935a2-4908-45e8-929b-b79bf0698afd None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:42.199751 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:42.235910 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be40d9f0-dcf9-4e72-846d-3750ec9366e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:42.236792 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be40d9f0-dcf9-4e72-846d-3750ec9366e7 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:42.237253 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be40d9f0-dcf9-4e72-846d-3750ec9366e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:42.237756 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be40d9f0-dcf9-4e72-846d-3750ec9366e7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:42.239325 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be40d9f0-dcf9-4e72-846d-3750ec9366e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:42.241066 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be40d9f0-dcf9-4e72-846d-3750ec9366e7 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:42.249835 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 148/304] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:15:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:42.250748 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be40d9f0-dcf9-4e72-846d-3750ec9366e7 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:42.253433 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a326ee-40fc-4458-9487-682e0ecd8e2c None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:42.304871 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dd1786-981a-4a94-8ff5-29a8fa5ba03b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:42.306820 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd1786-981a-4a94-8ff5-29a8fa5ba03b None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:42.307311 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd1786-981a-4a94-8ff5-29a8fa5ba03b None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:42.307677 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd1786-981a-4a94-8ff5-29a8fa5ba03b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:42.326439 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dd1786-981a-4a94-8ff5-29a8fa5ba03b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:15:42.335482 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-e0dd1786-981a-4a94-8ff5-29a8fa5ba03b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:15:42.335482 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:15:42.335482 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:15:42.335482 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:15:42.335482 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:15:42.335482 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:15:42.335482 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:15:42.335482 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:15:42.335482 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:15:42.335482 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:15:42.335482 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:15:42.335482 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:15:42.335482 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:15:42.335482 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:15:42.335482 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:15:42.335482 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:15:42.336519 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:15:42.336519 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:15:42.336519 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:15:42.336519 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:15:42.336519 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:15:42.336519 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:15:42.336519 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:15:42.336519 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:15:42.336519 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:15:42.336519 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:15:42.336519 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:15:42.336519 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:15:42.336519 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:15:42.336519 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:15:42.336519 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:15:42.336519 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:15:42.337864 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:15:42.337864 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:15:42.337864 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:15:42.337864 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:15:42.337864 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:15:42.337864 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:15:42.337864 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:15:42.337864 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:15:42.337864 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:15:42.337864 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:15:42.337864 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:15:42.337864 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:15:42.340592 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 157/305] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 12:15:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:15:42.340592 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dd1786-981a-4a94-8ff5-29a8fa5ba03b None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:42.371970 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:42.415615 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be40d9f0-dcf9-4e72-846d-3750ec9366e7 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:42.475873 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8e37fd-060b-405c-8f4d-e75b168606f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:42.476854 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e37fd-060b-405c-8f4d-e75b168606f2 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:42.477343 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e37fd-060b-405c-8f4d-e75b168606f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:42.478341 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e37fd-060b-405c-8f4d-e75b168606f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:42.479695 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8e37fd-060b-405c-8f4d-e75b168606f2 None admin] RBAC: Adding query filter params (role.id=6a7464b68efb4b3089ce4d0d8d03fdf3, user.id=90076e4e890d472fad8d9e63e58f0685, scope.system=all) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:15:42.480633 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8e37fd-060b-405c-8f4d-e75b168606f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:42.483386 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8e37fd-060b-405c-8f4d-e75b168606f2 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:42.502883 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 149/306] 10.222.0.79 () {56 vars in 1308 bytes} [Wed Aug 31 12:15:42 2022] GET /identity/v3/role_assignments?user.id=90076e4e890d472fad8d9e63e58f0685&scope.system=all&role.id=6a7464b68efb4b3089ce4d0d8d03fdf3 => generated 226 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:42.502883 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8e37fd-060b-405c-8f4d-e75b168606f2 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:42.535891 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dd1786-981a-4a94-8ff5-29a8fa5ba03b None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:42.572229 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:42.612218 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd30feb-89f7-4489-8cbc-3087f3496892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:42.612856 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd30feb-89f7-4489-8cbc-3087f3496892 None admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:42.613137 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd30feb-89f7-4489-8cbc-3087f3496892 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:42.613403 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd30feb-89f7-4489-8cbc-3087f3496892 None admin] PATH_INFO: `/v3/groups` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:42.614060 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd30feb-89f7-4489-8cbc-3087f3496892 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:42.615883 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd30feb-89f7-4489-8cbc-3087f3496892 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:42.636006 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 158/307] 10.222.0.79 () {60 vars in 1134 bytes} [Wed Aug 31 12:15:42 2022] POST /identity/v3/groups => generated 229 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:15:42.704151 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8e37fd-060b-405c-8f4d-e75b168606f2 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:42.742494 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d44cb-93f0-4485-8a67-65ec5636852c None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:42.743382 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d44cb-93f0-4485-8a67-65ec5636852c None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:42.743663 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d44cb-93f0-4485-8a67-65ec5636852c None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:42.745391 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 159/308] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:15:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:15:42.751430 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a0e93-61c4-4980-8abd-dc008087ee83 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:42.751786 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a0e93-61c4-4980-8abd-dc008087ee83 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:42.752094 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a0e93-61c4-4980-8abd-dc008087ee83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:42.773714 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-403a0e93-61c4-4980-8abd-dc008087ee83 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:15:42.776109 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-403a0e93-61c4-4980-8abd-dc008087ee83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:15:42.777758 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334c27ed-c8c5-4617-bf53-f3c2c4e3ee8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:42.780753 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c27ed-c8c5-4617-bf53-f3c2c4e3ee8f None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:42.781519 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c27ed-c8c5-4617-bf53-f3c2c4e3ee8f None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:42.782174 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c27ed-c8c5-4617-bf53-f3c2c4e3ee8f None admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:42.783809 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334c27ed-c8c5-4617-bf53-f3c2c4e3ee8f None admin] RBAC: Adding query filter params (name=member) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:15:42.784543 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334c27ed-c8c5-4617-bf53-f3c2c4e3ee8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:42.788883 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334c27ed-c8c5-4617-bf53-f3c2c4e3ee8f None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:42.804053 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:42.823844 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 150/309] 10.222.0.79 () {56 vars in 1101 bytes} [Wed Aug 31 12:15:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:42.825659 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334c27ed-c8c5-4617-bf53-f3c2c4e3ee8f None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:42.871252 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 160/310] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:15:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 12:15:43.017622 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334c27ed-c8c5-4617-bf53-f3c2c4e3ee8f None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:43.068692 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a625fc41-9dd9-429c-86d1-142d7ca28e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:43.069245 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625fc41-9dd9-429c-86d1-142d7ca28e18 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:43.069523 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625fc41-9dd9-429c-86d1-142d7ca28e18 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:43.069785 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625fc41-9dd9-429c-86d1-142d7ca28e18 None admin] PATH_INFO: `/v3/users/d8ef83bac0494f4091de1c6cdef0d63f` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:43.075869 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a625fc41-9dd9-429c-86d1-142d7ca28e18 None admin] RBAC: Authorizing `identity:get_user(user_id=d8ef83bac0494f4091de1c6cdef0d63f)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:43.077367 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a625fc41-9dd9-429c-86d1-142d7ca28e18 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:43.079484 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 151/311] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 12:15:42 2022] GET /identity/v3/users/d8ef83bac0494f4091de1c6cdef0d63f => generated 293 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:15:43.089444 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403a0e93-61c4-4980-8abd-dc008087ee83 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:43.142206 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a625fc41-9dd9-429c-86d1-142d7ca28e18 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:43.246622 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403a0e93-61c4-4980-8abd-dc008087ee83 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:43.251500 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:43.263278 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:43.303896 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a625fc41-9dd9-429c-86d1-142d7ca28e18 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:43.315511 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118c54a6-f6dc-4820-b059-52bdca99733b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:43.316640 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c54a6-f6dc-4820-b059-52bdca99733b None admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:43.317121 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c54a6-f6dc-4820-b059-52bdca99733b None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:43.317817 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c54a6-f6dc-4820-b059-52bdca99733b None admin] PATH_INFO: `/v3/system/users/d8ef83bac0494f4091de1c6cdef0d63f/roles/b5cfd7a855a448359e9017f51d32b6fc` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:43.321136 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118c54a6-f6dc-4820-b059-52bdca99733b None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d8ef83bac0494f4091de1c6cdef0d63f, role_id=b5cfd7a855a448359e9017f51d32b6fc)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:43.323846 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118c54a6-f6dc-4820-b059-52bdca99733b None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:43.341604 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 161/312] 10.222.0.79 () {58 vars in 1334 bytes} [Wed Aug 31 12:15:43 2022] PUT /identity/v3/system/users/d8ef83bac0494f4091de1c6cdef0d63f/roles/b5cfd7a855a448359e9017f51d32b6fc => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:15:43.378524 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630a8977-dde9-477c-b4af-446cd0983851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:43.380150 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630a8977-dde9-477c-b4af-446cd0983851 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:43.380636 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630a8977-dde9-477c-b4af-446cd0983851 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:43.381220 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630a8977-dde9-477c-b4af-446cd0983851 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:43.408483 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630a8977-dde9-477c-b4af-446cd0983851 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:15:43.427156 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-630a8977-dde9-477c-b4af-446cd0983851 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 12:15:43.427156 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:15:43.427156 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:15:43.427156 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:15:43.427156 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:15:43.427156 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:15:43.427156 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:15:43.427156 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:15:43.427156 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:15:43.427156 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:15:43.427156 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:15:43.427156 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:15:43.427156 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:15:43.427156 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:15:43.427156 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:15:43.427156 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:15:43.428138 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:15:43.428138 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:15:43.428138 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:15:43.428138 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:15:43.428138 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:15:43.428138 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:15:43.428138 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:15:43.428138 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:15:43.428138 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:15:43.428138 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:15:43.428138 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:15:43.428138 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:15:43.428138 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:15:43.428138 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:15:43.428138 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:15:43.428138 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:15:43.428955 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:15:43.428955 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:15:43.428955 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:15:43.428955 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:15:43.428955 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:15:43.428955 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:15:43.428955 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:15:43.428955 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:15:43.428955 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:15:43.428955 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:15:43.428955 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 12:15:43.428955 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:15:43.430192 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 152/313] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 12:15:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:15:43.436193 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118c54a6-f6dc-4820-b059-52bdca99733b None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:43.591317 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118c54a6-f6dc-4820-b059-52bdca99733b None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:43.652351 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc12897-15f7-448d-9b21-55008818e85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:43.653278 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc12897-15f7-448d-9b21-55008818e85b None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:43.653749 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc12897-15f7-448d-9b21-55008818e85b None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:43.654196 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc12897-15f7-448d-9b21-55008818e85b None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:43.655400 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc12897-15f7-448d-9b21-55008818e85b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:15:43.655917 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc12897-15f7-448d-9b21-55008818e85b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:43.658400 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc12897-15f7-448d-9b21-55008818e85b None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:43.673949 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 162/314] 10.222.0.79 () {56 vars in 1101 bytes} [Wed Aug 31 12:15:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:43.683234 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630a8977-dde9-477c-b4af-446cd0983851 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:43.881174 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630a8977-dde9-477c-b4af-446cd0983851 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:43.934830 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:43.949954 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3a6237-cc81-4ee5-b4d0-234a32192148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:43.951114 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a6237-cc81-4ee5-b4d0-234a32192148 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:43.951866 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a6237-cc81-4ee5-b4d0-234a32192148 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:43.952709 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a6237-cc81-4ee5-b4d0-234a32192148 None admin] PATH_INFO: `/v3/users/65186cac74954cb2803c2ee2b2f55e56` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:43.954892 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3a6237-cc81-4ee5-b4d0-234a32192148 None admin] RBAC: Authorizing `identity:get_user(user_id=65186cac74954cb2803c2ee2b2f55e56)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:43.957632 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3a6237-cc81-4ee5-b4d0-234a32192148 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:43.962017 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 153/315] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 12:15:43 2022] GET /identity/v3/users/65186cac74954cb2803c2ee2b2f55e56 => generated 297 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:43.971168 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc12897-15f7-448d-9b21-55008818e85b None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:44.031176 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:44.168941 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc12897-15f7-448d-9b21-55008818e85b None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:44.234814 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5428894-5484-4824-8c8e-ab84e1af99db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:44.236395 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5428894-5484-4824-8c8e-ab84e1af99db None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:44.237181 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5428894-5484-4824-8c8e-ab84e1af99db None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:44.237930 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5428894-5484-4824-8c8e-ab84e1af99db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:44.366782 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5428894-5484-4824-8c8e-ab84e1af99db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:44.368685 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5428894-5484-4824-8c8e-ab84e1af99db None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:44.403368 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:44.479820 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 163/316] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 12:15:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:15:44.489676 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3a6237-cc81-4ee5-b4d0-234a32192148 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:44.686709 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3a6237-cc81-4ee5-b4d0-234a32192148 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:44.725466 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d897d9d-2d2c-4c65-bee4-ddc1d5b4dce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:44.726031 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d897d9d-2d2c-4c65-bee4-ddc1d5b4dce9 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:44.726307 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d897d9d-2d2c-4c65-bee4-ddc1d5b4dce9 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:44.726579 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d897d9d-2d2c-4c65-bee4-ddc1d5b4dce9 None admin] PATH_INFO: `/v3/projects/c28fc617d7054dbeb5fd1e39107959fc` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:44.728395 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d897d9d-2d2c-4c65-bee4-ddc1d5b4dce9 None admin] RBAC: Authorizing `identity:get_project(project_id=c28fc617d7054dbeb5fd1e39107959fc)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:44.729879 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d897d9d-2d2c-4c65-bee4-ddc1d5b4dce9 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:44.732070 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 154/317] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 12:15:44 2022] GET /identity/v3/projects/c28fc617d7054dbeb5fd1e39107959fc => generated 302 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:44.741951 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5428894-5484-4824-8c8e-ab84e1af99db None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:44.868131 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5428894-5484-4824-8c8e-ab84e1af99db None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:44.905894 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:44.913979 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6d9d3b-1ac8-442a-8827-932b2134a805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:44.914663 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6d9d3b-1ac8-442a-8827-932b2134a805 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:44.914944 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6d9d3b-1ac8-442a-8827-932b2134a805 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:44.915222 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6d9d3b-1ac8-442a-8827-932b2134a805 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:44.915967 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6d9d3b-1ac8-442a-8827-932b2134a805 None admin] RBAC: Adding query filter params (role.id=6a7464b68efb4b3089ce4d0d8d03fdf3, scope.project.id=c28fc617d7054dbeb5fd1e39107959fc, user.id=65186cac74954cb2803c2ee2b2f55e56) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:15:44.916286 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6d9d3b-1ac8-442a-8827-932b2134a805 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:44.917762 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6d9d3b-1ac8-442a-8827-932b2134a805 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:44.924921 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 164/318] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 12:15:44 2022] GET /identity/v3/role_assignments?user.id=65186cac74954cb2803c2ee2b2f55e56&scope.project.id=c28fc617d7054dbeb5fd1e39107959fc&role.id=6a7464b68efb4b3089ce4d0d8d03fdf3 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:45.040878 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b276e53-47ab-497b-b506-fc6e06ee9769 None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:45.041947 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b276e53-47ab-497b-b506-fc6e06ee9769 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:45.042435 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b276e53-47ab-497b-b506-fc6e06ee9769 None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:45.044555 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 155/319] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:15:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:15:45.050693 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16abbcd1-e43e-44d6-830d-5f8a3bb41d47 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:45.051402 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16abbcd1-e43e-44d6-830d-5f8a3bb41d47 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:45.051890 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16abbcd1-e43e-44d6-830d-5f8a3bb41d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:45.072796 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-16abbcd1-e43e-44d6-830d-5f8a3bb41d47 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:15:45.074431 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-16abbcd1-e43e-44d6-830d-5f8a3bb41d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:15:45.208692 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 165/320] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:15:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:15:45.253395 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2b63b8-84a6-4d46-945e-d47c403ac6bb None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:45.253651 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2b63b8-84a6-4d46-945e-d47c403ac6bb None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:45.254001 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2b63b8-84a6-4d46-945e-d47c403ac6bb None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:45.255553 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 156/321] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:15:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:15:45.262566 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee4492e-bc96-4fac-b92c-d6f6a009e770 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:45.263151 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee4492e-bc96-4fac-b92c-d6f6a009e770 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:45.263593 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee4492e-bc96-4fac-b92c-d6f6a009e770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:45.299291 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-aee4492e-bc96-4fac-b92c-d6f6a009e770 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:15:45.301770 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-aee4492e-bc96-4fac-b92c-d6f6a009e770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:15:45.397540 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 166/322] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:15:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:15:45.643405 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8157b230-165b-47dc-ad34-41291f64bc65 None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:45.643642 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8157b230-165b-47dc-ad34-41291f64bc65 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:45.644023 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8157b230-165b-47dc-ad34-41291f64bc65 None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:45.645206 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 157/323] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:15:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:15:45.652386 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca16d0-6cbc-4eb3-a584-2492391b6039 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:45.652903 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca16d0-6cbc-4eb3-a584-2492391b6039 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:45.653308 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca16d0-6cbc-4eb3-a584-2492391b6039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:45.673442 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-fcca16d0-6cbc-4eb3-a584-2492391b6039 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:15:45.674827 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-fcca16d0-6cbc-4eb3-a584-2492391b6039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:15:45.677852 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8157b230-165b-47dc-ad34-41291f64bc65 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:45.755183 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:45.780451 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 167/324] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:15:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:15:45.782467 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcca16d0-6cbc-4eb3-a584-2492391b6039 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:45.799926 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:45.862800 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8157b230-165b-47dc-ad34-41291f64bc65 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:45.927109 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e29c4e7-8de9-408e-ae99-70efeeb27b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:45.928043 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29c4e7-8de9-408e-ae99-70efeeb27b38 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:45.928535 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29c4e7-8de9-408e-ae99-70efeeb27b38 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:45.929009 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29c4e7-8de9-408e-ae99-70efeeb27b38 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:45.931852 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e29c4e7-8de9-408e-ae99-70efeeb27b38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:45.934680 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e29c4e7-8de9-408e-ae99-70efeeb27b38 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:45.937788 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 158/325] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:15:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:45.948899 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e29c4e7-8de9-408e-ae99-70efeeb27b38 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:45.975460 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcca16d0-6cbc-4eb3-a584-2492391b6039 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:46.038754 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d181b5e-1aec-4671-848e-20fcadf62d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:46.041297 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d181b5e-1aec-4671-848e-20fcadf62d29 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:46.041947 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d181b5e-1aec-4671-848e-20fcadf62d29 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:46.042563 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d181b5e-1aec-4671-848e-20fcadf62d29 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:46.061757 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d181b5e-1aec-4671-848e-20fcadf62d29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:15:46.070232 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-3d181b5e-1aec-4671-848e-20fcadf62d29 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 12:15:46.070232 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:15:46.070232 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:15:46.070232 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:15:46.070232 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:15:46.070232 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:15:46.070232 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:15:46.070232 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:15:46.070232 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:15:46.070232 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:15:46.070232 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:15:46.070232 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:15:46.070232 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:15:46.070232 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:15:46.070232 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:15:46.070232 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:15:46.072848 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:15:46.072848 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:15:46.072848 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:15:46.072848 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:15:46.072848 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:15:46.072848 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:15:46.072848 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:15:46.072848 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:15:46.072848 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:15:46.072848 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:15:46.072848 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:15:46.072848 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:15:46.072848 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:15:46.072848 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:15:46.072848 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:15:46.072848 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:15:46.074322 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:15:46.074322 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:15:46.074322 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:15:46.074322 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:15:46.074322 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:15:46.074322 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:15:46.074322 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:15:46.074322 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:15:46.074322 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:15:46.074322 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:15:46.074322 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 12:15:46.074322 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:15:46.074322 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 168/326] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 12:15:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:15:46.074322 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d181b5e-1aec-4671-848e-20fcadf62d29 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:46.115095 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e29c4e7-8de9-408e-ae99-70efeeb27b38 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:46.139782 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:46.156987 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:46.164678 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1167a86-bf63-497d-a25c-6747fd2e2b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:46.165522 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1167a86-bf63-497d-a25c-6747fd2e2b82 None admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:46.165841 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1167a86-bf63-497d-a25c-6747fd2e2b82 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:46.166198 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1167a86-bf63-497d-a25c-6747fd2e2b82 None admin] PATH_INFO: `/v3/groups` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:46.167025 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1167a86-bf63-497d-a25c-6747fd2e2b82 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:46.168647 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1167a86-bf63-497d-a25c-6747fd2e2b82 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:46.200935 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 159/327] 10.222.0.79 () {60 vars in 1134 bytes} [Wed Aug 31 12:15:45 2022] POST /identity/v3/groups => generated 226 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:15:46.200935 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1167a86-bf63-497d-a25c-6747fd2e2b82 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:46.234983 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d181b5e-1aec-4671-848e-20fcadf62d29 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:46.307455 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913a092d-a527-4f91-9b00-feb9b0703c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:46.308718 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913a092d-a527-4f91-9b00-feb9b0703c91 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:46.309204 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913a092d-a527-4f91-9b00-feb9b0703c91 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:46.309843 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913a092d-a527-4f91-9b00-feb9b0703c91 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:46.331292 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913a092d-a527-4f91-9b00-feb9b0703c91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:15:46.342717 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-913a092d-a527-4f91-9b00-feb9b0703c91 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:15:46.342717 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:15:46.342717 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:15:46.342717 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:15:46.342717 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:15:46.342717 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:15:46.342717 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:15:46.342717 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:15:46.342717 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:15:46.342717 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:15:46.342717 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:15:46.342717 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:15:46.342717 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:15:46.342717 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:15:46.342717 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:15:46.342717 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:15:46.343900 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:15:46.343900 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:15:46.343900 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:15:46.343900 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:15:46.343900 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:15:46.343900 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:15:46.343900 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:15:46.343900 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:15:46.343900 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:15:46.343900 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:15:46.343900 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:15:46.343900 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:15:46.343900 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:15:46.343900 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:15:46.343900 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:15:46.343900 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:15:46.344739 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:15:46.344739 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:15:46.344739 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:15:46.344739 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:15:46.344739 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:15:46.344739 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:15:46.344739 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:15:46.344739 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:15:46.344739 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:15:46.344739 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:15:46.344739 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:15:46.344739 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:15:46.345369 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1167a86-bf63-497d-a25c-6747fd2e2b82 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:46.345444 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 169/328] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 12:15:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:15:46.356967 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913a092d-a527-4f91-9b00-feb9b0703c91 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:46.402423 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048ed4d8-922c-42ef-9c46-cb3d9dd3899d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:46.403109 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ed4d8-922c-42ef-9c46-cb3d9dd3899d None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:46.403452 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ed4d8-922c-42ef-9c46-cb3d9dd3899d None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:46.403736 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ed4d8-922c-42ef-9c46-cb3d9dd3899d None admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:46.404453 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048ed4d8-922c-42ef-9c46-cb3d9dd3899d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:15:46.404763 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048ed4d8-922c-42ef-9c46-cb3d9dd3899d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:46.406317 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048ed4d8-922c-42ef-9c46-cb3d9dd3899d None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:46.421517 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 160/329] 10.222.0.79 () {56 vars in 1101 bytes} [Wed Aug 31 12:15:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:46.427642 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048ed4d8-922c-42ef-9c46-cb3d9dd3899d None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:46.531227 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:46.564128 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913a092d-a527-4f91-9b00-feb9b0703c91 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:46.587391 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:46.629256 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048ed4d8-922c-42ef-9c46-cb3d9dd3899d None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:46.635455 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a1197-bb38-4c12-9080-fa5cdcfd2d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:46.635455 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a1197-bb38-4c12-9080-fa5cdcfd2d84 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:46.635455 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a1197-bb38-4c12-9080-fa5cdcfd2d84 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:46.635455 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a1197-bb38-4c12-9080-fa5cdcfd2d84 None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:46.636061 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3a1197-bb38-4c12-9080-fa5cdcfd2d84 None admin] RBAC: Adding query filter params (name=member) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:15:46.636061 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3a1197-bb38-4c12-9080-fa5cdcfd2d84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:46.637280 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3a1197-bb38-4c12-9080-fa5cdcfd2d84 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:46.652024 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 170/330] 10.222.0.79 () {56 vars in 1101 bytes} [Wed Aug 31 12:15:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:46.661998 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a1197-bb38-4c12-9080-fa5cdcfd2d84 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:46.693125 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e1d928-ba14-4c01-b185-6b97464a4c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:46.694098 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e1d928-ba14-4c01-b185-6b97464a4c4f None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:46.694376 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e1d928-ba14-4c01-b185-6b97464a4c4f None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:46.694703 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e1d928-ba14-4c01-b185-6b97464a4c4f None admin] PATH_INFO: `/v3/users/90076e4e890d472fad8d9e63e58f0685` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:46.696952 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e1d928-ba14-4c01-b185-6b97464a4c4f None admin] RBAC: Authorizing `identity:get_user(user_id=90076e4e890d472fad8d9e63e58f0685)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:46.698677 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e1d928-ba14-4c01-b185-6b97464a4c4f None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:46.700910 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 161/331] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 12:15:46 2022] GET /identity/v3/users/90076e4e890d472fad8d9e63e58f0685 => generated 293 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:15:46.713412 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e1d928-ba14-4c01-b185-6b97464a4c4f None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:46.864566 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a1197-bb38-4c12-9080-fa5cdcfd2d84 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:46.924784 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e1d928-ba14-4c01-b185-6b97464a4c4f None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:46.933139 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047705c8-4369-42c6-84e0-82b38119ebd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:46.934508 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047705c8-4369-42c6-84e0-82b38119ebd1 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:46.935360 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047705c8-4369-42c6-84e0-82b38119ebd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:46.936026 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047705c8-4369-42c6-84e0-82b38119ebd1 None admin] PATH_INFO: `/v3/users/d8ef83bac0494f4091de1c6cdef0d63f` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:46.938399 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047705c8-4369-42c6-84e0-82b38119ebd1 None admin] RBAC: Authorizing `identity:get_user(user_id=d8ef83bac0494f4091de1c6cdef0d63f)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:46.941536 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047705c8-4369-42c6-84e0-82b38119ebd1 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:46.944907 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 171/332] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 12:15:46 2022] GET /identity/v3/users/d8ef83bac0494f4091de1c6cdef0d63f => generated 293 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:15:46.955972 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:46.958256 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047705c8-4369-42c6-84e0-82b38119ebd1 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:46.973853 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cbbf51-b49f-4502-9dba-f9e907a39c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:46.974432 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cbbf51-b49f-4502-9dba-f9e907a39c77 None admin] REQUEST_METHOD: `PUT` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:46.974718 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cbbf51-b49f-4502-9dba-f9e907a39c77 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:46.975038 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cbbf51-b49f-4502-9dba-f9e907a39c77 None admin] PATH_INFO: `/v3/system/users/90076e4e890d472fad8d9e63e58f0685/roles/6a7464b68efb4b3089ce4d0d8d03fdf3` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:46.976582 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cbbf51-b49f-4502-9dba-f9e907a39c77 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=90076e4e890d472fad8d9e63e58f0685, role_id=6a7464b68efb4b3089ce4d0d8d03fdf3)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:46.978592 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cbbf51-b49f-4502-9dba-f9e907a39c77 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:46.999407 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 162/333] 10.222.0.79 () {58 vars in 1334 bytes} [Wed Aug 31 12:15:46 2022] PUT /identity/v3/system/users/90076e4e890d472fad8d9e63e58f0685/roles/6a7464b68efb4b3089ce4d0d8d03fdf3 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:15:47.043578 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:47.185340 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047705c8-4369-42c6-84e0-82b38119ebd1 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:47.241007 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fc6621-9438-42ef-99b0-fff479f8b308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:47.241957 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc6621-9438-42ef-99b0-fff479f8b308 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:47.242345 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc6621-9438-42ef-99b0-fff479f8b308 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:47.243387 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc6621-9438-42ef-99b0-fff479f8b308 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:47.244712 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fc6621-9438-42ef-99b0-fff479f8b308 None admin] RBAC: Adding query filter params (role.id=b5cfd7a855a448359e9017f51d32b6fc, user.id=d8ef83bac0494f4091de1c6cdef0d63f, scope.system=all) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:15:47.245242 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fc6621-9438-42ef-99b0-fff479f8b308 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:47.247136 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fc6621-9438-42ef-99b0-fff479f8b308 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:47.269604 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 172/334] 10.222.0.79 () {56 vars in 1308 bytes} [Wed Aug 31 12:15:46 2022] GET /identity/v3/role_assignments?user.id=d8ef83bac0494f4091de1c6cdef0d63f&scope.system=all&role.id=b5cfd7a855a448359e9017f51d32b6fc => generated 510 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:49.489197 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed96cf-2d59-4ad9-b789-ab65d23e6430 None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:49.489750 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed96cf-2d59-4ad9-b789-ab65d23e6430 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:49.489750 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed96cf-2d59-4ad9-b789-ab65d23e6430 None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:49.491724 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 163/335] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:15:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:15:49.498527 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55edb4b9-5024-4aa9-a157-d4c7d5ded291 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:49.499480 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55edb4b9-5024-4aa9-a157-d4c7d5ded291 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:49.499957 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55edb4b9-5024-4aa9-a157-d4c7d5ded291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:49.530924 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-55edb4b9-5024-4aa9-a157-d4c7d5ded291 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:15:49.533188 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-55edb4b9-5024-4aa9-a157-d4c7d5ded291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:15:49.624735 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c25ebb8-2b24-4934-8898-dd7364bb5ac7 None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:49.625351 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c25ebb8-2b24-4934-8898-dd7364bb5ac7 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:49.625812 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c25ebb8-2b24-4934-8898-dd7364bb5ac7 None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:49.628057 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 164/336] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:15:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:15:49.637972 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8983e5c6-f65f-4c67-9a52-38b5d0a0d3a7 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:49.638900 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8983e5c6-f65f-4c67-9a52-38b5d0a0d3a7 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:49.639602 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8983e5c6-f65f-4c67-9a52-38b5d0a0d3a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:49.670473 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 173/337] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:15:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 12:15:49.685863 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-8983e5c6-f65f-4c67-9a52-38b5d0a0d3a7 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:15:49.687679 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-8983e5c6-f65f-4c67-9a52-38b5d0a0d3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:15:49.823198 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 165/338] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:15:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 12:15:50.166262 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca9c3e-2b3c-42b5-8da4-a78bae2b0134 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:50.166762 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca9c3e-2b3c-42b5-8da4-a78bae2b0134 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:50.167220 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca9c3e-2b3c-42b5-8da4-a78bae2b0134 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:50.168970 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 174/339] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:15:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:15:50.185834 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3422b20-4ab4-44c5-814c-b0a8a66ce88e None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:50.186232 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3422b20-4ab4-44c5-814c-b0a8a66ce88e None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:50.186617 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3422b20-4ab4-44c5-814c-b0a8a66ce88e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:50.225283 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-d3422b20-4ab4-44c5-814c-b0a8a66ce88e None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:15:50.227997 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-d3422b20-4ab4-44c5-814c-b0a8a66ce88e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:15:50.313919 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ca9c3e-2b3c-42b5-8da4-a78bae2b0134 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:50.385938 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 166/340] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:15:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:15:50.391230 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:50.515758 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ca9c3e-2b3c-42b5-8da4-a78bae2b0134 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:50.558598 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0f6dff-b544-4b86-9de0-e6f213cb2ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:50.559284 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f6dff-b544-4b86-9de0-e6f213cb2ffa None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:50.559557 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f6dff-b544-4b86-9de0-e6f213cb2ffa None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:50.559826 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f6dff-b544-4b86-9de0-e6f213cb2ffa None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:50.573770 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0f6dff-b544-4b86-9de0-e6f213cb2ffa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:15:50.578891 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-9e0f6dff-b544-4b86-9de0-e6f213cb2ffa None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 12:15:50.578891 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:15:50.578891 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:15:50.578891 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:15:50.578891 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:15:50.578891 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:15:50.578891 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:15:50.578891 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:15:50.578891 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:15:50.578891 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:15:50.578891 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:15:50.578891 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:15:50.578891 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:15:50.578891 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:15:50.578891 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:15:50.578891 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:15:50.579804 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:15:50.579804 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:15:50.579804 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:15:50.579804 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:15:50.579804 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:15:50.579804 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:15:50.579804 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:15:50.579804 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:15:50.579804 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:15:50.579804 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:15:50.579804 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:15:50.579804 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:15:50.579804 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:15:50.579804 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:15:50.579804 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:15:50.579804 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:15:50.580618 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:15:50.580618 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:15:50.580618 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:15:50.580618 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:15:50.580618 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:15:50.580618 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:15:50.580618 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:15:50.580618 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:15:50.580618 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:15:50.580618 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:15:50.580618 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 12:15:50.580618 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:15:50.580618 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 175/341] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 12:15:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:15:50.586916 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3422b20-4ab4-44c5-814c-b0a8a66ce88e None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:50.619904 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0f6dff-b544-4b86-9de0-e6f213cb2ffa None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:50.685521 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:50.791099 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:50.805561 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3422b20-4ab4-44c5-814c-b0a8a66ce88e None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:50.819940 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0f6dff-b544-4b86-9de0-e6f213cb2ffa None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:50.879467 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4455bdc2-1b10-463d-ab31-17d7b6cf48d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:50.880114 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4455bdc2-1b10-463d-ab31-17d7b6cf48d3 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:50.880389 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4455bdc2-1b10-463d-ab31-17d7b6cf48d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:50.880655 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4455bdc2-1b10-463d-ab31-17d7b6cf48d3 None admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:50.881339 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4455bdc2-1b10-463d-ab31-17d7b6cf48d3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:15:50.881639 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4455bdc2-1b10-463d-ab31-17d7b6cf48d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:50.883180 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4455bdc2-1b10-463d-ab31-17d7b6cf48d3 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:50.888860 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6560ca8-dabb-4d73-a70d-ccd3364e0b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:50.889598 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6560ca8-dabb-4d73-a70d-ccd3364e0b7c None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:50.889891 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6560ca8-dabb-4d73-a70d-ccd3364e0b7c None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:50.890160 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6560ca8-dabb-4d73-a70d-ccd3364e0b7c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:50.905222 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6560ca8-dabb-4d73-a70d-ccd3364e0b7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:15:50.907886 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 167/342] 10.222.0.79 () {56 vars in 1101 bytes} [Wed Aug 31 12:15:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:15:50.908993 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4455bdc2-1b10-463d-ab31-17d7b6cf48d3 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:50.911596 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-e6560ca8-dabb-4d73-a70d-ccd3364e0b7c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:15:50.911596 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:15:50.911596 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:15:50.911596 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:15:50.911596 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:15:50.911596 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:15:50.911596 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:15:50.911596 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:15:50.911596 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:15:50.911596 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:15:50.911596 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:15:50.911596 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:15:50.911596 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:15:50.911596 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:15:50.911596 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:15:50.911596 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:15:50.912693 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:15:50.912693 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:15:50.912693 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:15:50.912693 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:15:50.912693 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:15:50.912693 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:15:50.912693 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:15:50.912693 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:15:50.912693 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:15:50.912693 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:15:50.912693 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:15:50.912693 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:15:50.912693 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:15:50.912693 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:15:50.912693 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:15:50.912693 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:15:50.913488 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:15:50.913488 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:15:50.913488 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:15:50.913488 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:15:50.913488 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:15:50.913488 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:15:50.913488 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:15:50.913488 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:15:50.913488 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:15:50.913488 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:15:50.913488 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:15:50.913488 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:15:50.917223 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 176/343] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 12:15:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:15:50.922687 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6560ca8-dabb-4d73-a70d-ccd3364e0b7c None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:51.126674 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6560ca8-dabb-4d73-a70d-ccd3364e0b7c None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:51.138998 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4455bdc2-1b10-463d-ab31-17d7b6cf48d3 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:51.152906 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:51.194916 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b602c-9e13-433f-9964-6da8710477df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:51.195162 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d735e-9948-45b2-9099-79d00990bd06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:51.195594 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b602c-9e13-433f-9964-6da8710477df None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:51.195844 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d735e-9948-45b2-9099-79d00990bd06 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:51.195920 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b602c-9e13-433f-9964-6da8710477df None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:51.196047 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d735e-9948-45b2-9099-79d00990bd06 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:51.196169 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b602c-9e13-433f-9964-6da8710477df None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:51.196571 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d735e-9948-45b2-9099-79d00990bd06 None admin] PATH_INFO: `/v3/users/90076e4e890d472fad8d9e63e58f0685` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:51.198018 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616d735e-9948-45b2-9099-79d00990bd06 None admin] RBAC: Authorizing `identity:get_user(user_id=90076e4e890d472fad8d9e63e58f0685)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:51.199997 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616d735e-9948-45b2-9099-79d00990bd06 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:51.202202 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 177/344] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 12:15:50 2022] GET /identity/v3/users/90076e4e890d472fad8d9e63e58f0685 => generated 293 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:51.203222 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d735e-9948-45b2-9099-79d00990bd06 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:51.214375 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4b602c-9e13-433f-9964-6da8710477df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:15:51.221038 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-ce4b602c-9e13-433f-9964-6da8710477df None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 12:15:51.221038 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:15:51.221038 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:15:51.221038 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:15:51.221038 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:15:51.221038 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:15:51.221038 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:15:51.221038 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:15:51.221038 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:15:51.221038 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:15:51.221038 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:15:51.221038 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:15:51.221038 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:15:51.221038 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:15:51.221038 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:15:51.221038 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:15:51.222317 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:15:51.222317 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:15:51.222317 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:15:51.222317 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:15:51.222317 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:15:51.222317 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:15:51.222317 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:15:51.222317 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:15:51.222317 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:15:51.222317 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:15:51.222317 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:15:51.222317 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:15:51.222317 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:15:51.222317 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:15:51.222317 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:15:51.222317 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:15:51.223558 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:15:51.223558 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:15:51.223558 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:15:51.223558 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:15:51.223558 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:15:51.223558 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:15:51.223558 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:15:51.223558 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:15:51.223558 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:15:51.223558 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:15:51.223558 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 12:15:51.223558 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:15:51.223558 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 168/345] 10.222.0.79 () {56 vars in 1114 bytes} [Wed Aug 31 12:15:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:15:51.223558 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1255e525-a2c6-4c37-bbc9-4408453c7ab3 None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:51.225116 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1255e525-a2c6-4c37-bbc9-4408453c7ab3 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:51.225116 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1255e525-a2c6-4c37-bbc9-4408453c7ab3 None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:51.226379 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 169/346] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:15:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:15:51.226734 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1255e525-a2c6-4c37-bbc9-4408453c7ab3 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:51.245708 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:51.377342 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1255e525-a2c6-4c37-bbc9-4408453c7ab3 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:51.423027 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cf19e2-edd9-4f86-bbe3-34bc18fa2dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:51.423477 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf19e2-edd9-4f86-bbe3-34bc18fa2dc2 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:51.423762 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf19e2-edd9-4f86-bbe3-34bc18fa2dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:51.424035 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf19e2-edd9-4f86-bbe3-34bc18fa2dc2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:51.424778 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cf19e2-edd9-4f86-bbe3-34bc18fa2dc2 None admin] RBAC: Adding query filter params (role.id=6a7464b68efb4b3089ce4d0d8d03fdf3, user.id=90076e4e890d472fad8d9e63e58f0685, scope.system=all) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:15:51.425083 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cf19e2-edd9-4f86-bbe3-34bc18fa2dc2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:51.426588 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cf19e2-edd9-4f86-bbe3-34bc18fa2dc2 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:51.448495 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d735e-9948-45b2-9099-79d00990bd06 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:51.465630 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 170/347] 10.222.0.79 () {56 vars in 1308 bytes} [Wed Aug 31 12:15:51 2022] GET /identity/v3/role_assignments?user.id=90076e4e890d472fad8d9e63e58f0685&scope.system=all&role.id=6a7464b68efb4b3089ce4d0d8d03fdf3 => generated 510 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:51.466929 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cf19e2-edd9-4f86-bbe3-34bc18fa2dc2 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:51.503089 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:51.532861 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06564b37-fa28-4101-bbdf-3406db923dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:51.533890 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06564b37-fa28-4101-bbdf-3406db923dcc None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:51.534695 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06564b37-fa28-4101-bbdf-3406db923dcc None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:51.535609 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06564b37-fa28-4101-bbdf-3406db923dcc None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:51.537418 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06564b37-fa28-4101-bbdf-3406db923dcc None admin] RBAC: Adding query filter params (name=member) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:15:51.538248 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06564b37-fa28-4101-bbdf-3406db923dcc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:51.542444 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06564b37-fa28-4101-bbdf-3406db923dcc None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:51.560957 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 178/348] 10.222.0.79 () {56 vars in 1101 bytes} [Wed Aug 31 12:15:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:51.563733 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd928ca-21de-4b88-b647-e65de29615b4 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:51.564559 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd928ca-21de-4b88-b647-e65de29615b4 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:51.565349 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd928ca-21de-4b88-b647-e65de29615b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:51.598172 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-5dd928ca-21de-4b88-b647-e65de29615b4 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:15:51.604162 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-5dd928ca-21de-4b88-b647-e65de29615b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:15:51.660571 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cf19e2-edd9-4f86-bbe3-34bc18fa2dc2 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:51.699364 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 179/349] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:15:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:15:51.700596 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd928ca-21de-4b88-b647-e65de29615b4 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:51.710988 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:51.788739 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de289bda-516d-4916-af02-9f37f9503b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:51.790322 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de289bda-516d-4916-af02-9f37f9503b5b None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:51.790797 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de289bda-516d-4916-af02-9f37f9503b5b None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:51.793339 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de289bda-516d-4916-af02-9f37f9503b5b None admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:51.795007 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de289bda-516d-4916-af02-9f37f9503b5b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:15:51.795348 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de289bda-516d-4916-af02-9f37f9503b5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:51.798063 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de289bda-516d-4916-af02-9f37f9503b5b None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:51.826555 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 171/350] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 12:15:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:51.833031 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de289bda-516d-4916-af02-9f37f9503b5b None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:51.843328 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd928ca-21de-4b88-b647-e65de29615b4 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:51.890310 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ac2ba8-4fbf-433e-92e0-e7df6e224c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:51.891365 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac2ba8-4fbf-433e-92e0-e7df6e224c62 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:51.891851 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac2ba8-4fbf-433e-92e0-e7df6e224c62 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:51.892361 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac2ba8-4fbf-433e-92e0-e7df6e224c62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:52.007720 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ac2ba8-4fbf-433e-92e0-e7df6e224c62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:52.010785 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ac2ba8-4fbf-433e-92e0-e7df6e224c62 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:52.014892 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:52.037177 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de289bda-516d-4916-af02-9f37f9503b5b None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:52.039304 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:52.094201 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee80385-80c1-4b8e-a701-e7b28c596820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:52.094893 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee80385-80c1-4b8e-a701-e7b28c596820 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:52.095289 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee80385-80c1-4b8e-a701-e7b28c596820 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:52.095516 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee80385-80c1-4b8e-a701-e7b28c596820 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:52.146435 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 180/351] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 12:15:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:15:52.151001 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d25aa-4daf-46b8-a17f-c6a1631c2163 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:52.151610 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d25aa-4daf-46b8-a17f-c6a1631c2163 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:52.152116 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d25aa-4daf-46b8-a17f-c6a1631c2163 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:52.153818 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 181/352] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:15:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:15:52.160231 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a3dfe-a717-43b9-9cfc-d188f2058fdb None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:52.162016 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a3dfe-a717-43b9-9cfc-d188f2058fdb None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:52.162693 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a3dfe-a717-43b9-9cfc-d188f2058fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:52.197883 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-2d9a3dfe-a717-43b9-9cfc-d188f2058fdb None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:15:52.200515 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-2d9a3dfe-a717-43b9-9cfc-d188f2058fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:15:52.205372 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee80385-80c1-4b8e-a701-e7b28c596820 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:52.207578 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee80385-80c1-4b8e-a701-e7b28c596820 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:52.314306 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:52.329561 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 172/353] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 12:15:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:15:52.330532 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee80385-80c1-4b8e-a701-e7b28c596820 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:52.344894 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 182/354] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:15:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:15:52.346146 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9a3dfe-a717-43b9-9cfc-d188f2058fdb None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:52.390829 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:52.484581 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9a3dfe-a717-43b9-9cfc-d188f2058fdb None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:52.502286 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee80385-80c1-4b8e-a701-e7b28c596820 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:52.528089 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb82b34-76f9-472c-9985-d8a1e059f45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:52.528089 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb82b34-76f9-472c-9985-d8a1e059f45f None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:52.528089 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb82b34-76f9-472c-9985-d8a1e059f45f None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:52.528622 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb82b34-76f9-472c-9985-d8a1e059f45f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:52.542916 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb82b34-76f9-472c-9985-d8a1e059f45f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:15:52.548805 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-2cb82b34-76f9-472c-9985-d8a1e059f45f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:15:52.548805 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:15:52.548805 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:15:52.548805 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:15:52.548805 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:15:52.548805 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:15:52.548805 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:15:52.548805 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:15:52.548805 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:15:52.548805 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:15:52.548805 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:15:52.548805 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:15:52.548805 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:15:52.548805 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:15:52.548805 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:15:52.548805 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:15:52.549814 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:15:52.549814 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:15:52.549814 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:15:52.549814 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:15:52.549814 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:15:52.549814 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:15:52.549814 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:15:52.549814 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:15:52.549814 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:15:52.549814 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:15:52.549814 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:15:52.549814 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:15:52.549814 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:15:52.549814 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:15:52.549814 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:15:52.549814 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:15:52.550624 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:15:52.550624 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:15:52.550624 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:15:52.550624 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:15:52.550624 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:15:52.550624 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:15:52.550624 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:15:52.550624 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:15:52.550624 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:15:52.550624 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:15:52.550624 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:15:52.550624 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:15:52.550624 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 183/355] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 12:15:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:15:52.551811 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb82b34-76f9-472c-9985-d8a1e059f45f None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:52.567278 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1e6571-d94f-45c4-bf5b-ccc1f79df433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:52.568595 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1e6571-d94f-45c4-bf5b-ccc1f79df433 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:52.569041 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1e6571-d94f-45c4-bf5b-ccc1f79df433 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:52.569742 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1e6571-d94f-45c4-bf5b-ccc1f79df433 None admin] PATH_INFO: `/v3/projects/79222f00008144bba451b7a2da2da187` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:52.571753 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1e6571-d94f-45c4-bf5b-ccc1f79df433 None admin] RBAC: Authorizing `identity:get_project(project_id=79222f00008144bba451b7a2da2da187)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:52.574241 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1e6571-d94f-45c4-bf5b-ccc1f79df433 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:52.577148 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 173/356] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 12:15:52 2022] GET /identity/v3/projects/79222f00008144bba451b7a2da2da187 => generated 298 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:52.578231 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1e6571-d94f-45c4-bf5b-ccc1f79df433 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:52.669826 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:52.713797 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:52.727486 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb82b34-76f9-472c-9985-d8a1e059f45f None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:52.745085 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1e6571-d94f-45c4-bf5b-ccc1f79df433 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:52.776873 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f45702-ce18-4d63-acd4-f021908a087a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:52.777937 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f45702-ce18-4d63-acd4-f021908a087a None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:52.778398 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f45702-ce18-4d63-acd4-f021908a087a None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:52.778876 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f45702-ce18-4d63-acd4-f021908a087a None admin] PATH_INFO: `/v3/projects/79222f00008144bba451b7a2da2da187` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:52.780875 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f45702-ce18-4d63-acd4-f021908a087a None admin] RBAC: Authorizing `identity:get_project(project_id=79222f00008144bba451b7a2da2da187)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:52.783330 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f45702-ce18-4d63-acd4-f021908a087a None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:52.785377 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 184/357] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 12:15:52 2022] GET /identity/v3/projects/79222f00008144bba451b7a2da2da187 => generated 298 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:52.787884 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f45702-ce18-4d63-acd4-f021908a087a None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:52.793657 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d52149d-0f96-4f43-91c4-9b89a006e374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:52.794284 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d52149d-0f96-4f43-91c4-9b89a006e374 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:52.794563 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d52149d-0f96-4f43-91c4-9b89a006e374 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:52.794832 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d52149d-0f96-4f43-91c4-9b89a006e374 None admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:52.795536 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d52149d-0f96-4f43-91c4-9b89a006e374 None admin] RBAC: Adding query filter params (name=member) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:15:52.795840 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d52149d-0f96-4f43-91c4-9b89a006e374 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:52.797824 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d52149d-0f96-4f43-91c4-9b89a006e374 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:52.810106 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 174/358] 10.222.0.79 () {56 vars in 1101 bytes} [Wed Aug 31 12:15:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:52.811591 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d52149d-0f96-4f43-91c4-9b89a006e374 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:52.952232 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d52149d-0f96-4f43-91c4-9b89a006e374 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:52.968664 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f45702-ce18-4d63-acd4-f021908a087a None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:52.983911 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:53.011733 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c434a908-d40d-4b4c-b38a-4e09debd6823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:53.012398 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c434a908-d40d-4b4c-b38a-4e09debd6823 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:53.012681 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c434a908-d40d-4b4c-b38a-4e09debd6823 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:53.012960 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c434a908-d40d-4b4c-b38a-4e09debd6823 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:53.030166 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c434a908-d40d-4b4c-b38a-4e09debd6823 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:15:53.030815 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c64bd-d317-4ee7-aa9b-98dfa064028b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:53.031449 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c64bd-d317-4ee7-aa9b-98dfa064028b None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:53.033002 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c64bd-d317-4ee7-aa9b-98dfa064028b None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:53.033002 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c64bd-d317-4ee7-aa9b-98dfa064028b None admin] PATH_INFO: `/v3/groups/8436fda8c1784798ba5d9f700b4d0800` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:53.036968 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-c434a908-d40d-4b4c-b38a-4e09debd6823 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 12:15:53.036968 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:15:53.036968 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:15:53.036968 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:15:53.036968 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:15:53.036968 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:15:53.036968 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:15:53.036968 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:15:53.036968 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:15:53.036968 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:15:53.036968 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:15:53.036968 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:15:53.036968 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:15:53.036968 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:15:53.036968 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:15:53.036968 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:15:53.038090 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:15:53.038090 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:15:53.038090 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:15:53.038090 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:15:53.038090 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:15:53.038090 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:15:53.038090 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:15:53.038090 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:15:53.038090 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:15:53.038090 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:15:53.038090 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:15:53.038090 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:15:53.038090 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:15:53.038090 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:15:53.038090 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:15:53.038090 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:15:53.039709 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:15:53.039709 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:15:53.039709 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:15:53.039709 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:15:53.039709 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:15:53.039709 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:15:53.039709 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:15:53.039709 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:15:53.039709 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:15:53.039709 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:15:53.039709 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 12:15:53.039709 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:15:53.039709 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 175/359] 10.222.0.79 () {56 vars in 1114 bytes} [Wed Aug 31 12:15:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:15:53.040502 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947a85d5-13b4-4ec4-bba2-aba4a68c9386 None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:53.040764 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947a85d5-13b4-4ec4-bba2-aba4a68c9386 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:53.041019 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947a85d5-13b4-4ec4-bba2-aba4a68c9386 None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:53.042320 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 176/360] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:15:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:15:53.043106 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947a85d5-13b4-4ec4-bba2-aba4a68c9386 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:53.043506 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828c64bd-d317-4ee7-aa9b-98dfa064028b None admin] RBAC: Authorizing `identity:get_group(group_id=8436fda8c1784798ba5d9f700b4d0800)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:53.046503 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828c64bd-d317-4ee7-aa9b-98dfa064028b None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:53.048466 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 185/361] 10.222.0.79 () {56 vars in 1180 bytes} [Wed Aug 31 12:15:52 2022] GET /identity/v3/groups/8436fda8c1784798ba5d9f700b4d0800 => generated 226 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:53.049326 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c64bd-d317-4ee7-aa9b-98dfa064028b None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:53.089637 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:53.185595 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c64bd-d317-4ee7-aa9b-98dfa064028b None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:53.187935 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947a85d5-13b4-4ec4-bba2-aba4a68c9386 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:53.226746 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9318642a-7332-4315-9048-2f7b7a79d09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:53.228772 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9318642a-7332-4315-9048-2f7b7a79d09e None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:53.228886 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9318642a-7332-4315-9048-2f7b7a79d09e None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:53.229116 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9318642a-7332-4315-9048-2f7b7a79d09e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:53.235668 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbbd497-c02e-4a6f-834b-57993f300798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:53.236172 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbbd497-c02e-4a6f-834b-57993f300798 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:53.236593 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbbd497-c02e-4a6f-834b-57993f300798 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:53.236744 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbbd497-c02e-4a6f-834b-57993f300798 None admin] PATH_INFO: `/v3/groups/8436fda8c1784798ba5d9f700b4d0800` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:53.237847 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbbd497-c02e-4a6f-834b-57993f300798 None admin] RBAC: Authorizing `identity:get_group(group_id=8436fda8c1784798ba5d9f700b4d0800)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:53.239358 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbbd497-c02e-4a6f-834b-57993f300798 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:53.243610 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 177/362] 10.222.0.79 () {56 vars in 1180 bytes} [Wed Aug 31 12:15:53 2022] GET /identity/v3/groups/8436fda8c1784798ba5d9f700b4d0800 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:53.243610 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbbd497-c02e-4a6f-834b-57993f300798 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:53.305993 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:53.324858 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9318642a-7332-4315-9048-2f7b7a79d09e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:53.326481 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9318642a-7332-4315-9048-2f7b7a79d09e None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:53.365827 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:53.374374 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbbd497-c02e-4a6f-834b-57993f300798 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:53.414143 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33979aeb-7f83-4b6a-b6ed-925b0c1a8223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:53.415337 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33979aeb-7f83-4b6a-b6ed-925b0c1a8223 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:53.415617 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33979aeb-7f83-4b6a-b6ed-925b0c1a8223 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:53.415933 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33979aeb-7f83-4b6a-b6ed-925b0c1a8223 None admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:53.416561 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33979aeb-7f83-4b6a-b6ed-925b0c1a8223 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:15:53.418916 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33979aeb-7f83-4b6a-b6ed-925b0c1a8223 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:53.418916 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33979aeb-7f83-4b6a-b6ed-925b0c1a8223 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:53.427038 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 178/363] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 12:15:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:53.428583 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2202ef3b-9adf-4cf0-bfdb-31bdc31bf2ca None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:53.429082 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2202ef3b-9adf-4cf0-bfdb-31bdc31bf2ca None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:53.429597 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2202ef3b-9adf-4cf0-bfdb-31bdc31bf2ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:53.450098 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-2202ef3b-9adf-4cf0-bfdb-31bdc31bf2ca None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:15:53.451147 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-2202ef3b-9adf-4cf0-bfdb-31bdc31bf2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:15:53.478014 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 186/364] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 12:15:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:15:53.483965 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9318642a-7332-4315-9048-2f7b7a79d09e None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:53.531937 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 179/365] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:15:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:15:53.532589 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2202ef3b-9adf-4cf0-bfdb-31bdc31bf2ca None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:53.596515 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:53.623165 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9318642a-7332-4315-9048-2f7b7a79d09e None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:53.659959 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:53.672399 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3559eec6-1d56-4ce6-8140-e57753b3bd0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:53.673006 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559eec6-1d56-4ce6-8140-e57753b3bd0b None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:53.673290 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559eec6-1d56-4ce6-8140-e57753b3bd0b None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:53.673561 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559eec6-1d56-4ce6-8140-e57753b3bd0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:53.674299 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3559eec6-1d56-4ce6-8140-e57753b3bd0b None admin] RBAC: Adding query filter params (group.id=8436fda8c1784798ba5d9f700b4d0800, role.id=b5cfd7a855a448359e9017f51d32b6fc, scope.project.id=79222f00008144bba451b7a2da2da187) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:15:53.674606 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3559eec6-1d56-4ce6-8140-e57753b3bd0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:53.676395 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3559eec6-1d56-4ce6-8140-e57753b3bd0b None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:53.686892 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 187/366] 10.222.0.79 () {56 vars in 1376 bytes} [Wed Aug 31 12:15:53 2022] GET /identity/v3/role_assignments?group.id=8436fda8c1784798ba5d9f700b4d0800&scope.project.id=79222f00008144bba451b7a2da2da187&role.id=b5cfd7a855a448359e9017f51d32b6fc => generated 260 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:53.687582 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3559eec6-1d56-4ce6-8140-e57753b3bd0b None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:53.694337 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2202ef3b-9adf-4cf0-bfdb-31bdc31bf2ca None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:53.735711 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8ada35-6d25-45a6-b620-62d0e3d96cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:53.736712 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ada35-6d25-45a6-b620-62d0e3d96cc4 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:53.737186 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ada35-6d25-45a6-b620-62d0e3d96cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:53.737663 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ada35-6d25-45a6-b620-62d0e3d96cc4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:53.738594 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8ada35-6d25-45a6-b620-62d0e3d96cc4 None admin] RBAC: Adding query filter params (group.id=8436fda8c1784798ba5d9f700b4d0800, role.id=be23fee6ea264172b277f97af30cc689, scope.project.id=79222f00008144bba451b7a2da2da187) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:15:53.739484 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8ada35-6d25-45a6-b620-62d0e3d96cc4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:53.741256 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8ada35-6d25-45a6-b620-62d0e3d96cc4 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:53.749382 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 180/367] 10.222.0.79 () {56 vars in 1376 bytes} [Wed Aug 31 12:15:53 2022] GET /identity/v3/role_assignments?group.id=8436fda8c1784798ba5d9f700b4d0800&scope.project.id=79222f00008144bba451b7a2da2da187&role.id=be23fee6ea264172b277f97af30cc689 => generated 260 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:53.750589 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8ada35-6d25-45a6-b620-62d0e3d96cc4 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:53.839748 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3559eec6-1d56-4ce6-8140-e57753b3bd0b None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:53.877904 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8ada35-6d25-45a6-b620-62d0e3d96cc4 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:53.885723 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56565e6d-5e1b-4bd1-b87d-a1852f4b2aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:53.886366 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56565e6d-5e1b-4bd1-b87d-a1852f4b2aab None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:53.886647 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56565e6d-5e1b-4bd1-b87d-a1852f4b2aab None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:53.886949 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56565e6d-5e1b-4bd1-b87d-a1852f4b2aab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:53.899634 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:53.925468 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb9c7a-faa2-4e53-ba78-f9992d45eafe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:53.926604 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb9c7a-faa2-4e53-ba78-f9992d45eafe None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:53.927009 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb9c7a-faa2-4e53-ba78-f9992d45eafe None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:53.927287 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb9c7a-faa2-4e53-ba78-f9992d45eafe None admin] PATH_INFO: `/v3/projects/c28fc617d7054dbeb5fd1e39107959fc` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:53.931819 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cb9c7a-faa2-4e53-ba78-f9992d45eafe None admin] RBAC: Authorizing `identity:get_project(project_id=c28fc617d7054dbeb5fd1e39107959fc)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:53.933218 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cb9c7a-faa2-4e53-ba78-f9992d45eafe None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:53.935444 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 181/368] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 12:15:53 2022] GET /identity/v3/projects/c28fc617d7054dbeb5fd1e39107959fc => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:53.936599 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb9c7a-faa2-4e53-ba78-f9992d45eafe None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:53.975216 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:53.996245 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56565e6d-5e1b-4bd1-b87d-a1852f4b2aab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:53.997640 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56565e6d-5e1b-4bd1-b87d-a1852f4b2aab None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:54.087588 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb9c7a-faa2-4e53-ba78-f9992d45eafe None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:54.135374 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70f2912-b40d-4591-85ae-f207734b8dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:54.136040 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70f2912-b40d-4591-85ae-f207734b8dda None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:54.136434 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70f2912-b40d-4591-85ae-f207734b8dda None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:54.136711 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70f2912-b40d-4591-85ae-f207734b8dda None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:54.151367 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70f2912-b40d-4591-85ae-f207734b8dda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:15:54.153064 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 188/369] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 12:15:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:15:54.153954 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56565e6d-5e1b-4bd1-b87d-a1852f4b2aab None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:54.160912 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-d70f2912-b40d-4591-85ae-f207734b8dda None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:15:54.160912 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:15:54.160912 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:15:54.160912 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:15:54.160912 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:15:54.160912 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:15:54.160912 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:15:54.160912 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:15:54.160912 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:15:54.160912 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:15:54.160912 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:15:54.160912 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:15:54.160912 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:15:54.160912 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:15:54.160912 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:15:54.160912 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:15:54.161889 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:15:54.161889 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:15:54.161889 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:15:54.161889 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:15:54.161889 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:15:54.161889 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:15:54.161889 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:15:54.161889 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:15:54.161889 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:15:54.161889 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:15:54.161889 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:15:54.161889 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:15:54.161889 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:15:54.161889 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:15:54.161889 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:15:54.161889 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:15:54.162702 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:15:54.162702 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:15:54.162702 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:15:54.162702 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:15:54.162702 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:15:54.162702 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:15:54.162702 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:15:54.162702 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:15:54.162702 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:15:54.162702 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:15:54.162702 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:15:54.162702 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:15:54.162702 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 182/370] 10.222.0.79 () {56 vars in 1096 bytes} [Wed Aug 31 12:15:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:15:54.165907 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70f2912-b40d-4591-85ae-f207734b8dda None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:54.227655 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:54.283077 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:54.296595 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56565e6d-5e1b-4bd1-b87d-a1852f4b2aab None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:54.335688 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70f2912-b40d-4591-85ae-f207734b8dda None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:54.350928 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05af94e1-1734-4d00-a82b-2fa93cfdca02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:54.350928 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af94e1-1734-4d00-a82b-2fa93cfdca02 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:54.350928 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af94e1-1734-4d00-a82b-2fa93cfdca02 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:54.350928 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af94e1-1734-4d00-a82b-2fa93cfdca02 None admin] PATH_INFO: `/v3/groups/8436fda8c1784798ba5d9f700b4d0800` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:54.353538 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05af94e1-1734-4d00-a82b-2fa93cfdca02 None admin] RBAC: Authorizing `identity:get_group(group_id=8436fda8c1784798ba5d9f700b4d0800)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:54.355175 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05af94e1-1734-4d00-a82b-2fa93cfdca02 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:54.357689 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 189/371] 10.222.0.79 () {56 vars in 1180 bytes} [Wed Aug 31 12:15:54 2022] GET /identity/v3/groups/8436fda8c1784798ba5d9f700b4d0800 => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:54.360345 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05af94e1-1734-4d00-a82b-2fa93cfdca02 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:54.396583 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c5ce05-8350-4f97-ad21-64fe68ec6a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:54.397240 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c5ce05-8350-4f97-ad21-64fe68ec6a35 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:54.397523 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c5ce05-8350-4f97-ad21-64fe68ec6a35 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:54.397824 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c5ce05-8350-4f97-ad21-64fe68ec6a35 None admin] PATH_INFO: `/v3/projects/c28fc617d7054dbeb5fd1e39107959fc` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:54.405684 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c5ce05-8350-4f97-ad21-64fe68ec6a35 None admin] RBAC: Authorizing `identity:get_project(project_id=c28fc617d7054dbeb5fd1e39107959fc)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:54.407806 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c5ce05-8350-4f97-ad21-64fe68ec6a35 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:54.413412 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 183/372] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 12:15:54 2022] GET /identity/v3/projects/c28fc617d7054dbeb5fd1e39107959fc => generated 302 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:15:54.414643 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c5ce05-8350-4f97-ad21-64fe68ec6a35 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:54.511019 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05af94e1-1734-4d00-a82b-2fa93cfdca02 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:54.538087 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:54.542886 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c5ce05-8350-4f97-ad21-64fe68ec6a35 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:54.550688 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892001a0-f97a-47ae-8a21-a10af347f3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:54.551700 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892001a0-f97a-47ae-8a21-a10af347f3ec None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:54.552184 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892001a0-f97a-47ae-8a21-a10af347f3ec None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:54.552659 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892001a0-f97a-47ae-8a21-a10af347f3ec None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:54.553564 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892001a0-f97a-47ae-8a21-a10af347f3ec None admin] RBAC: Adding query filter params (name=admin) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:15:54.554067 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892001a0-f97a-47ae-8a21-a10af347f3ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:54.556314 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892001a0-f97a-47ae-8a21-a10af347f3ec None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:54.566055 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 190/373] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 12:15:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:54.567388 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892001a0-f97a-47ae-8a21-a10af347f3ec None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:54.584690 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716db903-ccdc-486d-b70b-f5dadc0eb3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:54.584690 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716db903-ccdc-486d-b70b-f5dadc0eb3a8 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:54.584690 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716db903-ccdc-486d-b70b-f5dadc0eb3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:54.585032 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716db903-ccdc-486d-b70b-f5dadc0eb3a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:54.586072 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716db903-ccdc-486d-b70b-f5dadc0eb3a8 None admin] RBAC: Adding query filter params (group.id=8436fda8c1784798ba5d9f700b4d0800, role.id=b5cfd7a855a448359e9017f51d32b6fc, scope.project.id=c28fc617d7054dbeb5fd1e39107959fc) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:15:54.587076 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716db903-ccdc-486d-b70b-f5dadc0eb3a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:54.588702 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716db903-ccdc-486d-b70b-f5dadc0eb3a8 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:54.595822 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 184/374] 10.222.0.79 () {56 vars in 1376 bytes} [Wed Aug 31 12:15:54 2022] GET /identity/v3/role_assignments?group.id=8436fda8c1784798ba5d9f700b4d0800&scope.project.id=c28fc617d7054dbeb5fd1e39107959fc&role.id=b5cfd7a855a448359e9017f51d32b6fc => generated 260 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:54.596691 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716db903-ccdc-486d-b70b-f5dadc0eb3a8 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:54.597907 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:54.694498 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892001a0-f97a-47ae-8a21-a10af347f3ec None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:54.747181 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716db903-ccdc-486d-b70b-f5dadc0eb3a8 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:54.749784 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accf98d7-6a2d-4007-a488-3224e5fb9efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:54.750824 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf98d7-6a2d-4007-a488-3224e5fb9efe None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:54.751369 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf98d7-6a2d-4007-a488-3224e5fb9efe None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:54.751912 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf98d7-6a2d-4007-a488-3224e5fb9efe None admin] PATH_INFO: `/v3/groups/8436fda8c1784798ba5d9f700b4d0800` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:54.753433 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accf98d7-6a2d-4007-a488-3224e5fb9efe None admin] RBAC: Authorizing `identity:get_group(group_id=8436fda8c1784798ba5d9f700b4d0800)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:54.755174 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accf98d7-6a2d-4007-a488-3224e5fb9efe None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:54.757041 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 191/375] 10.222.0.79 () {56 vars in 1180 bytes} [Wed Aug 31 12:15:54 2022] GET /identity/v3/groups/8436fda8c1784798ba5d9f700b4d0800 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:54.789948 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accf98d7-6a2d-4007-a488-3224e5fb9efe None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:54.818904 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c46754-03a5-466d-86d6-e86935b3c368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:54.818904 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c46754-03a5-466d-86d6-e86935b3c368 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:54.818904 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c46754-03a5-466d-86d6-e86935b3c368 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:54.818904 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c46754-03a5-466d-86d6-e86935b3c368 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:54.858203 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:54.911663 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c46754-03a5-466d-86d6-e86935b3c368 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:54.913741 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c46754-03a5-466d-86d6-e86935b3c368 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:55.017482 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:55.049120 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accf98d7-6a2d-4007-a488-3224e5fb9efe None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:55.077008 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 185/376] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 12:15:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:15:55.087191 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c46754-03a5-466d-86d6-e86935b3c368 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:55.124774 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44f5c30-1d80-4ca3-9e17-911c6d60e7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:55.125954 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f5c30-1d80-4ca3-9e17-911c6d60e7d3 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:55.126558 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f5c30-1d80-4ca3-9e17-911c6d60e7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:55.127181 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f5c30-1d80-4ca3-9e17-911c6d60e7d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:55.128566 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44f5c30-1d80-4ca3-9e17-911c6d60e7d3 None admin] RBAC: Adding query filter params (group.id=8436fda8c1784798ba5d9f700b4d0800, role.id=be23fee6ea264172b277f97af30cc689, scope.project.id=c28fc617d7054dbeb5fd1e39107959fc) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:15:55.129214 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44f5c30-1d80-4ca3-9e17-911c6d60e7d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:55.131965 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44f5c30-1d80-4ca3-9e17-911c6d60e7d3 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:55.142868 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 192/377] 10.222.0.79 () {56 vars in 1376 bytes} [Wed Aug 31 12:15:54 2022] GET /identity/v3/role_assignments?group.id=8436fda8c1784798ba5d9f700b4d0800&scope.project.id=c28fc617d7054dbeb5fd1e39107959fc&role.id=be23fee6ea264172b277f97af30cc689 => generated 260 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:55.232715 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:55.288496 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c46754-03a5-466d-86d6-e86935b3c368 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:55.348138 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189960b6-f20e-46a0-8a3b-dbfc62b9e365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:55.349122 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189960b6-f20e-46a0-8a3b-dbfc62b9e365 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:55.349602 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189960b6-f20e-46a0-8a3b-dbfc62b9e365 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:55.350079 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189960b6-f20e-46a0-8a3b-dbfc62b9e365 None admin] PATH_INFO: `/v3/projects/088123e0cad144f3a713fb6c4c75d880` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:55.353281 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189960b6-f20e-46a0-8a3b-dbfc62b9e365 None admin] RBAC: Authorizing `identity:get_project(project_id=088123e0cad144f3a713fb6c4c75d880)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:55.355587 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189960b6-f20e-46a0-8a3b-dbfc62b9e365 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:55.359267 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 186/378] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 12:15:55 2022] GET /identity/v3/projects/088123e0cad144f3a713fb6c4c75d880 => generated 344 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:15:55.368258 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44f5c30-1d80-4ca3-9e17-911c6d60e7d3 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:55.591407 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44f5c30-1d80-4ca3-9e17-911c6d60e7d3 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:55.642043 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c84da7-3bd2-4db2-98b8-5d19349f18a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:55.643101 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c84da7-3bd2-4db2-98b8-5d19349f18a2 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:55.643582 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c84da7-3bd2-4db2-98b8-5d19349f18a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:55.644052 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c84da7-3bd2-4db2-98b8-5d19349f18a2 None admin] PATH_INFO: `/v3/groups/23b53fa8a2604711911c6d6a5b83f567` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:55.651052 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c84da7-3bd2-4db2-98b8-5d19349f18a2 None admin] RBAC: Authorizing `identity:get_group(group_id=23b53fa8a2604711911c6d6a5b83f567)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:55.652818 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c84da7-3bd2-4db2-98b8-5d19349f18a2 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:55.655107 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 193/379] 10.222.0.79 () {56 vars in 1180 bytes} [Wed Aug 31 12:15:55 2022] GET /identity/v3/groups/23b53fa8a2604711911c6d6a5b83f567 => generated 229 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:55.665549 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189960b6-f20e-46a0-8a3b-dbfc62b9e365 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:55.921553 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189960b6-f20e-46a0-8a3b-dbfc62b9e365 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:55.967657 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:55.975975 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e33e613-068b-40c1-8d17-71d961b98fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:55.977594 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e33e613-068b-40c1-8d17-71d961b98fe1 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:55.978040 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e33e613-068b-40c1-8d17-71d961b98fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:55.978491 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e33e613-068b-40c1-8d17-71d961b98fe1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:55.979861 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e33e613-068b-40c1-8d17-71d961b98fe1 None admin] RBAC: Adding query filter params (group.id=23b53fa8a2604711911c6d6a5b83f567, role.id=a332ef951db949b0bad7019fbd28a1b9, scope.project.id=088123e0cad144f3a713fb6c4c75d880) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:15:55.980401 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e33e613-068b-40c1-8d17-71d961b98fe1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:55.983044 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e33e613-068b-40c1-8d17-71d961b98fe1 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:55.993792 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 187/380] 10.222.0.79 () {56 vars in 1376 bytes} [Wed Aug 31 12:15:55 2022] GET /identity/v3/role_assignments?group.id=23b53fa8a2604711911c6d6a5b83f567&scope.project.id=088123e0cad144f3a713fb6c4c75d880&role.id=a332ef951db949b0bad7019fbd28a1b9 => generated 260 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:57.072360 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a97f2d-5d09-4706-9c9c-f116874ef98f None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:57.073436 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a97f2d-5d09-4706-9c9c-f116874ef98f None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:57.073919 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a97f2d-5d09-4706-9c9c-f116874ef98f None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:57.075864 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 194/381] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:15:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:15:57.083512 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101cffb9-d9a6-47cf-90c9-3ac76bfb2291 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:57.084479 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101cffb9-d9a6-47cf-90c9-3ac76bfb2291 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:57.084969 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101cffb9-d9a6-47cf-90c9-3ac76bfb2291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:57.127194 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-101cffb9-d9a6-47cf-90c9-3ac76bfb2291 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:15:57.129713 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-101cffb9-d9a6-47cf-90c9-3ac76bfb2291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:15:57.194238 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc64b0-d1e5-4d0f-a11c-cdab0830fe48 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:57.194238 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc64b0-d1e5-4d0f-a11c-cdab0830fe48 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:57.194238 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc64b0-d1e5-4d0f-a11c-cdab0830fe48 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:57.194979 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 195/382] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:15:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:15:57.201478 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac67b8a0-3359-44cf-9369-92812b90e56c None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:57.202060 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac67b8a0-3359-44cf-9369-92812b90e56c None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:57.202532 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac67b8a0-3359-44cf-9369-92812b90e56c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:57.233079 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-ac67b8a0-3359-44cf-9369-92812b90e56c None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:15:57.234670 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-ac67b8a0-3359-44cf-9369-92812b90e56c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:15:57.266894 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:57.319010 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 188/383] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:15:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:15:57.438923 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 196/384] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:15:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 12:15:57.785441 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101cffb9-d9a6-47cf-90c9-3ac76bfb2291 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:57.901883 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac67b8a0-3359-44cf-9369-92812b90e56c None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:57.990333 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101cffb9-d9a6-47cf-90c9-3ac76bfb2291 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:58.053940 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:58.062960 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2757c3-dd52-4c02-8ff3-dbf7760db20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:58.067773 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2757c3-dd52-4c02-8ff3-dbf7760db20d None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:58.068236 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2757c3-dd52-4c02-8ff3-dbf7760db20d None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:58.068696 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2757c3-dd52-4c02-8ff3-dbf7760db20d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:58.094243 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2757c3-dd52-4c02-8ff3-dbf7760db20d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:15:58.106961 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-1c2757c3-dd52-4c02-8ff3-dbf7760db20d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:15:58.106961 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:15:58.106961 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:15:58.106961 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:15:58.106961 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:15:58.106961 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:15:58.106961 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:15:58.106961 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:15:58.106961 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:15:58.106961 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:15:58.106961 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:15:58.106961 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:15:58.106961 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:15:58.106961 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:15:58.106961 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:15:58.106961 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:15:58.108844 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:15:58.108844 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:15:58.108844 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:15:58.108844 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:15:58.108844 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:15:58.108844 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:15:58.108844 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:15:58.108844 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:15:58.108844 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:15:58.108844 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:15:58.108844 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:15:58.108844 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:15:58.108844 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:15:58.108844 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:15:58.108844 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:15:58.108844 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:15:58.110735 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:15:58.110735 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:15:58.110735 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:15:58.110735 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:15:58.110735 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:15:58.110735 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:15:58.110735 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:15:58.110735 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:15:58.110735 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:15:58.110735 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:15:58.110735 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:15:58.110735 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:15:58.114960 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 189/385] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 12:15:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:15:58.118472 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355c466-f2ef-49dc-bcb3-a674fb8cf948 None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:58.119610 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355c466-f2ef-49dc-bcb3-a674fb8cf948 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:58.120241 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355c466-f2ef-49dc-bcb3-a674fb8cf948 None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:58.129990 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 190/386] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:15:58 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:15:58.129990 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5355c466-f2ef-49dc-bcb3-a674fb8cf948 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:58.183584 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac67b8a0-3359-44cf-9369-92812b90e56c None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:58.260704 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988a878c-b068-4a49-82e1-0d70a89e1a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:58.262196 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a878c-b068-4a49-82e1-0d70a89e1a3b None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:58.263309 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a878c-b068-4a49-82e1-0d70a89e1a3b None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:58.265066 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a878c-b068-4a49-82e1-0d70a89e1a3b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:58.287960 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988a878c-b068-4a49-82e1-0d70a89e1a3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:15:58.295625 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-988a878c-b068-4a49-82e1-0d70a89e1a3b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 12:15:58.295625 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:15:58.295625 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:15:58.295625 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:15:58.295625 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:15:58.295625 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:15:58.295625 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:15:58.295625 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:15:58.295625 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:15:58.295625 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:15:58.295625 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:15:58.295625 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:15:58.295625 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:15:58.295625 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:15:58.295625 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:15:58.295625 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:15:58.297643 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:15:58.297643 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:15:58.297643 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:15:58.297643 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:15:58.297643 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:15:58.297643 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:15:58.297643 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:15:58.297643 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:15:58.297643 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:15:58.297643 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:15:58.297643 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:15:58.297643 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:15:58.297643 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:15:58.297643 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:15:58.297643 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:15:58.297643 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:15:58.299817 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:15:58.299817 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:15:58.299817 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:15:58.299817 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:15:58.299817 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:15:58.299817 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:15:58.299817 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:15:58.299817 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:15:58.299817 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:15:58.299817 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:15:58.299817 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 12:15:58.299817 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:15:58.307579 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 197/387] 10.222.0.79 () {56 vars in 1114 bytes} [Wed Aug 31 12:15:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 406 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:15:58.309850 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b36cbb-5a9f-4bf8-86a4-a772df2c3e8c None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:58.310394 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b36cbb-5a9f-4bf8-86a4-a772df2c3e8c None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:58.310955 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b36cbb-5a9f-4bf8-86a4-a772df2c3e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:58.334086 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:58.344612 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5355c466-f2ef-49dc-bcb3-a674fb8cf948 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:58.344864 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-31b36cbb-5a9f-4bf8-86a4-a772df2c3e8c None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:15:58.346975 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-31b36cbb-5a9f-4bf8-86a4-a772df2c3e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:15:58.422228 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f633c0-6df8-4132-9ff1-73d11adf6d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:58.424782 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f633c0-6df8-4132-9ff1-73d11adf6d85 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:58.425541 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f633c0-6df8-4132-9ff1-73d11adf6d85 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:58.426248 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f633c0-6df8-4132-9ff1-73d11adf6d85 None admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:58.427698 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f633c0-6df8-4132-9ff1-73d11adf6d85 None admin] RBAC: Adding query filter params (name=member) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:15:58.428450 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f633c0-6df8-4132-9ff1-73d11adf6d85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:58.431787 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f633c0-6df8-4132-9ff1-73d11adf6d85 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:58.456860 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 191/388] 10.222.0.79 () {56 vars in 1101 bytes} [Wed Aug 31 12:15:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:58.456860 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f633c0-6df8-4132-9ff1-73d11adf6d85 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:58.473104 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 198/389] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:15:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:15:58.474507 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e8eb2-c0ce-4458-b8ba-bcc5bbac1d4a None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:58.474795 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e8eb2-c0ce-4458-b8ba-bcc5bbac1d4a None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:58.475100 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e8eb2-c0ce-4458-b8ba-bcc5bbac1d4a None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:58.476673 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 199/390] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:15:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:15:58.481761 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4e8eb2-c0ce-4458-b8ba-bcc5bbac1d4a None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:58.543813 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:58.652237 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4e8eb2-c0ce-4458-b8ba-bcc5bbac1d4a None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:58.675539 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f633c0-6df8-4132-9ff1-73d11adf6d85 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:58.696125 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96b50de-aa88-4c4c-ae03-2333176b0350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:58.697217 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b50de-aa88-4c4c-ae03-2333176b0350 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:58.697217 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b50de-aa88-4c4c-ae03-2333176b0350 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:58.697607 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b50de-aa88-4c4c-ae03-2333176b0350 None admin] PATH_INFO: `/v3/groups/8436fda8c1784798ba5d9f700b4d0800` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:58.698729 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96b50de-aa88-4c4c-ae03-2333176b0350 None admin] RBAC: Authorizing `identity:get_group(group_id=8436fda8c1784798ba5d9f700b4d0800)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:58.700262 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96b50de-aa88-4c4c-ae03-2333176b0350 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:58.706651 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 200/391] 10.222.0.79 () {56 vars in 1180 bytes} [Wed Aug 31 12:15:58 2022] GET /identity/v3/groups/8436fda8c1784798ba5d9f700b4d0800 => generated 226 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:58.706651 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c5d4e-a150-4a25-949c-3a6e35ae2aab None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:58.706651 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c5d4e-a150-4a25-949c-3a6e35ae2aab None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:58.706651 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c5d4e-a150-4a25-949c-3a6e35ae2aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:58.717329 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:58.730496 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-d85c5d4e-a150-4a25-949c-3a6e35ae2aab None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:15:58.731947 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-d85c5d4e-a150-4a25-949c-3a6e35ae2aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:15:58.756732 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54bb45a-3f1d-4880-be66-0a7fa13c484a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:58.757360 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54bb45a-3f1d-4880-be66-0a7fa13c484a None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:58.757633 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54bb45a-3f1d-4880-be66-0a7fa13c484a None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:58.758611 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54bb45a-3f1d-4880-be66-0a7fa13c484a None admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:58.759291 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54bb45a-3f1d-4880-be66-0a7fa13c484a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:15:58.759705 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54bb45a-3f1d-4880-be66-0a7fa13c484a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:58.761100 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54bb45a-3f1d-4880-be66-0a7fa13c484a None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:58.770955 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 192/392] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 12:15:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:58.776497 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54bb45a-3f1d-4880-be66-0a7fa13c484a None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:58.832938 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 201/393] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:15:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:15:58.839884 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85c5d4e-a150-4a25-949c-3a6e35ae2aab None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:58.924509 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54bb45a-3f1d-4880-be66-0a7fa13c484a None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:58.939415 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:58.974291 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41675cfe-e961-4a62-be5f-b512716a3beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:58.975337 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41675cfe-e961-4a62-be5f-b512716a3beb None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:58.975799 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41675cfe-e961-4a62-be5f-b512716a3beb None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:58.976264 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41675cfe-e961-4a62-be5f-b512716a3beb None admin] PATH_INFO: `/v3/projects/79222f00008144bba451b7a2da2da187` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:58.978479 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41675cfe-e961-4a62-be5f-b512716a3beb None admin] RBAC: Authorizing `identity:get_project(project_id=79222f00008144bba451b7a2da2da187)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:58.981046 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41675cfe-e961-4a62-be5f-b512716a3beb None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:58.989044 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 193/394] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 12:15:58 2022] GET /identity/v3/projects/79222f00008144bba451b7a2da2da187 => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:58.989044 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0637b2d-5aa2-4884-b20b-69989e6085f5 None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:58.989044 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0637b2d-5aa2-4884-b20b-69989e6085f5 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:58.989044 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0637b2d-5aa2-4884-b20b-69989e6085f5 None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:58.989044 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 194/395] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:15:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:15:58.990909 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0637b2d-5aa2-4884-b20b-69989e6085f5 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:59.009821 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85c5d4e-a150-4a25-949c-3a6e35ae2aab None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:59.060058 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769e5287-4b86-46ad-a69c-33d8f8c802e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:59.061273 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e5287-4b86-46ad-a69c-33d8f8c802e6 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:59.061858 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e5287-4b86-46ad-a69c-33d8f8c802e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:59.062439 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e5287-4b86-46ad-a69c-33d8f8c802e6 None admin] PATH_INFO: `/v3/groups/8436fda8c1784798ba5d9f700b4d0800` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:59.064764 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769e5287-4b86-46ad-a69c-33d8f8c802e6 None admin] RBAC: Authorizing `identity:get_group(group_id=8436fda8c1784798ba5d9f700b4d0800)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:59.067869 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769e5287-4b86-46ad-a69c-33d8f8c802e6 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:59.077488 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 202/396] 10.222.0.79 () {56 vars in 1180 bytes} [Wed Aug 31 12:15:58 2022] GET /identity/v3/groups/8436fda8c1784798ba5d9f700b4d0800 => generated 226 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:59.077488 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769e5287-4b86-46ad-a69c-33d8f8c802e6 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:59.079375 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:59.176676 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0637b2d-5aa2-4884-b20b-69989e6085f5 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:59.215999 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769e5287-4b86-46ad-a69c-33d8f8c802e6 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:59.217964 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5f7d3e-fa6a-412c-a583-f5053a99f00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:59.218631 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f7d3e-fa6a-412c-a583-f5053a99f00f None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:59.218943 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f7d3e-fa6a-412c-a583-f5053a99f00f None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:59.219212 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f7d3e-fa6a-412c-a583-f5053a99f00f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:59.235711 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5f7d3e-fa6a-412c-a583-f5053a99f00f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:15:59.245571 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-7e5f7d3e-fa6a-412c-a583-f5053a99f00f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:15:59.245571 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:15:59.245571 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:15:59.245571 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:15:59.245571 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:15:59.245571 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:15:59.245571 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:15:59.245571 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:15:59.245571 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:15:59.245571 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:15:59.245571 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:15:59.245571 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:15:59.245571 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:15:59.245571 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:15:59.245571 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:15:59.245571 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:15:59.246887 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:15:59.246887 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:15:59.246887 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:15:59.246887 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:15:59.246887 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:15:59.246887 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:15:59.246887 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:15:59.246887 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:15:59.246887 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:15:59.246887 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:15:59.246887 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:15:59.246887 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:15:59.246887 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:15:59.246887 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:15:59.246887 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:15:59.246887 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:15:59.248372 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:15:59.248372 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:15:59.248372 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:15:59.248372 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:15:59.248372 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:15:59.248372 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:15:59.248372 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:15:59.248372 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:15:59.248372 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:15:59.248372 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:15:59.248372 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:15:59.248372 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:15:59.248372 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 195/397] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 12:15:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:15:59.249712 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0bfd09-3f3b-434c-83da-20d91ac92070 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:59.249712 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0bfd09-3f3b-434c-83da-20d91ac92070 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:59.249712 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0bfd09-3f3b-434c-83da-20d91ac92070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:59.261779 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342b2361-935d-444c-88b0-38978679b580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:59.262473 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b2361-935d-444c-88b0-38978679b580 None admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:59.262753 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b2361-935d-444c-88b0-38978679b580 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:59.263058 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b2361-935d-444c-88b0-38978679b580 None admin] PATH_INFO: `/v3/projects/79222f00008144bba451b7a2da2da187/groups/8436fda8c1784798ba5d9f700b4d0800/roles/b5cfd7a855a448359e9017f51d32b6fc` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:59.265166 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342b2361-935d-444c-88b0-38978679b580 None admin] RBAC: Authorizing `identity:create_grant(project_id=79222f00008144bba451b7a2da2da187, group_id=8436fda8c1784798ba5d9f700b4d0800, role_id=b5cfd7a855a448359e9017f51d32b6fc)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:59.266635 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342b2361-935d-444c-88b0-38978679b580 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:59.280331 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-9b0bfd09-3f3b-434c-83da-20d91ac92070 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:15:59.282377 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-9b0bfd09-3f3b-434c-83da-20d91ac92070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:15:59.282569 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 203/398] 10.222.0.79 () {58 vars in 1442 bytes} [Wed Aug 31 12:15:59 2022] PUT /identity/v3/projects/79222f00008144bba451b7a2da2da187/groups/8436fda8c1784798ba5d9f700b4d0800/roles/b5cfd7a855a448359e9017f51d32b6fc => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:15:59.283316 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342b2361-935d-444c-88b0-38978679b580 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:59.346562 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:59.403143 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:59.425221 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 196/399] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:15:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:15:59.432697 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0bfd09-3f3b-434c-83da-20d91ac92070 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:59.463825 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342b2361-935d-444c-88b0-38978679b580 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:59.519645 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724fbe4e-71ec-4160-978e-fab6f2299efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:59.520972 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724fbe4e-71ec-4160-978e-fab6f2299efc None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:59.521451 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724fbe4e-71ec-4160-978e-fab6f2299efc None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:59.522470 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724fbe4e-71ec-4160-978e-fab6f2299efc None admin] PATH_INFO: `/v3/projects/79222f00008144bba451b7a2da2da187` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:59.524383 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724fbe4e-71ec-4160-978e-fab6f2299efc None admin] RBAC: Authorizing `identity:get_project(project_id=79222f00008144bba451b7a2da2da187)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:59.527147 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724fbe4e-71ec-4160-978e-fab6f2299efc None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:59.530277 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 204/400] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 12:15:59 2022] GET /identity/v3/projects/79222f00008144bba451b7a2da2da187 => generated 298 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:59.531397 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724fbe4e-71ec-4160-978e-fab6f2299efc None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:59.607955 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0bfd09-3f3b-434c-83da-20d91ac92070 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:59.675273 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523652de-7589-4c4d-a2d5-05a516d4d75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:59.676583 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523652de-7589-4c4d-a2d5-05a516d4d75c None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:59.677058 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523652de-7589-4c4d-a2d5-05a516d4d75c None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:59.677603 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523652de-7589-4c4d-a2d5-05a516d4d75c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:59.699066 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523652de-7589-4c4d-a2d5-05a516d4d75c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:15:59.704355 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724fbe4e-71ec-4160-978e-fab6f2299efc None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:59.708477 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-523652de-7589-4c4d-a2d5-05a516d4d75c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 12:15:59.708477 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:15:59.708477 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:15:59.708477 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:15:59.708477 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:15:59.708477 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:15:59.708477 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:15:59.708477 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:15:59.708477 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:15:59.708477 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:15:59.708477 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:15:59.708477 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:15:59.708477 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:15:59.708477 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:15:59.708477 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:15:59.708477 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:15:59.709632 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:15:59.709632 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:15:59.709632 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:15:59.709632 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:15:59.709632 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:15:59.709632 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:15:59.709632 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:15:59.709632 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:15:59.709632 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:15:59.709632 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:15:59.709632 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:15:59.709632 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:15:59.709632 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:15:59.709632 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:15:59.709632 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:15:59.709632 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:15:59.710981 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:15:59.710981 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:15:59.710981 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:15:59.710981 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:15:59.710981 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:15:59.710981 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:15:59.710981 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:15:59.710981 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:15:59.710981 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:15:59.710981 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:15:59.710981 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 12:15:59.710981 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:15:59.719393 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 197/401] 10.222.0.79 () {56 vars in 1114 bytes} [Wed Aug 31 12:15:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:15:59.720967 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523652de-7589-4c4d-a2d5-05a516d4d75c None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:59.753750 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:59.766793 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c5809-4b9f-47fa-b232-fec9605ef9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:59.768076 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c5809-4b9f-47fa-b232-fec9605ef9fa None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:59.768726 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c5809-4b9f-47fa-b232-fec9605ef9fa None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:59.769336 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c5809-4b9f-47fa-b232-fec9605ef9fa None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:59.770845 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615c5809-4b9f-47fa-b232-fec9605ef9fa None admin] RBAC: Adding query filter params (name=member) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:15:59.771495 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615c5809-4b9f-47fa-b232-fec9605ef9fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:59.772436 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:59.774988 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615c5809-4b9f-47fa-b232-fec9605ef9fa None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:59.790758 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 205/402] 10.222.0.79 () {56 vars in 1101 bytes} [Wed Aug 31 12:15:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:15:59.793030 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c5809-4b9f-47fa-b232-fec9605ef9fa None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:15:59.888848 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523652de-7589-4c4d-a2d5-05a516d4d75c None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:59.947219 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f198855f-169e-4cb5-822c-cd42d03a6284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:15:59.948904 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f198855f-169e-4cb5-822c-cd42d03a6284 None admin] REQUEST_METHOD: `PUT` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:15:59.949536 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f198855f-169e-4cb5-822c-cd42d03a6284 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:15:59.950222 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f198855f-169e-4cb5-822c-cd42d03a6284 None admin] PATH_INFO: `/v3/projects/79222f00008144bba451b7a2da2da187/groups/8436fda8c1784798ba5d9f700b4d0800/roles/be23fee6ea264172b277f97af30cc689` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:15:59.954682 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f198855f-169e-4cb5-822c-cd42d03a6284 None admin] RBAC: Authorizing `identity:create_grant(project_id=79222f00008144bba451b7a2da2da187, group_id=8436fda8c1784798ba5d9f700b4d0800, role_id=be23fee6ea264172b277f97af30cc689)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:15:59.956603 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f198855f-169e-4cb5-822c-cd42d03a6284 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:15:59.972404 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c5809-4b9f-47fa-b232-fec9605ef9fa None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:15:59.974408 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 198/403] 10.222.0.79 () {58 vars in 1442 bytes} [Wed Aug 31 12:15:59 2022] PUT /identity/v3/projects/79222f00008144bba451b7a2da2da187/groups/8436fda8c1784798ba5d9f700b4d0800/roles/be23fee6ea264172b277f97af30cc689 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:15:59.975655 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f198855f-169e-4cb5-822c-cd42d03a6284 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:00.047237 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d542a84a-9536-45b9-9a90-4688ef1c4411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:00.048039 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d542a84a-9536-45b9-9a90-4688ef1c4411 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:00.048512 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d542a84a-9536-45b9-9a90-4688ef1c4411 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:00.049002 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d542a84a-9536-45b9-9a90-4688ef1c4411 None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:00.050252 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d542a84a-9536-45b9-9a90-4688ef1c4411 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:00.050796 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d542a84a-9536-45b9-9a90-4688ef1c4411 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:00.053680 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d542a84a-9536-45b9-9a90-4688ef1c4411 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:00.073319 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 206/404] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 12:15:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:00.075013 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d542a84a-9536-45b9-9a90-4688ef1c4411 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:00.123616 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f198855f-169e-4cb5-822c-cd42d03a6284 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:00.127347 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:00.168532 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b873f6f-0ee7-4f2e-9f8a-167d2337a30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:00.169505 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b873f6f-0ee7-4f2e-9f8a-167d2337a30f None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:00.169943 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b873f6f-0ee7-4f2e-9f8a-167d2337a30f None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:00.170400 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b873f6f-0ee7-4f2e-9f8a-167d2337a30f None admin] PATH_INFO: `/v3/groups/8436fda8c1784798ba5d9f700b4d0800` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:00.172167 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b873f6f-0ee7-4f2e-9f8a-167d2337a30f None admin] RBAC: Authorizing `identity:get_group(group_id=8436fda8c1784798ba5d9f700b4d0800)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:00.174266 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b873f6f-0ee7-4f2e-9f8a-167d2337a30f None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:00.182919 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 199/405] 10.222.0.79 () {56 vars in 1180 bytes} [Wed Aug 31 12:15:59 2022] GET /identity/v3/groups/8436fda8c1784798ba5d9f700b4d0800 => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:00.184309 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b873f6f-0ee7-4f2e-9f8a-167d2337a30f None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:00.196473 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:00.283611 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d542a84a-9536-45b9-9a90-4688ef1c4411 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:00.337072 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5031c466-b343-468f-bd3d-ebb4be015b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:00.337731 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031c466-b343-468f-bd3d-ebb4be015b40 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:00.338126 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031c466-b343-468f-bd3d-ebb4be015b40 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:00.338397 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031c466-b343-468f-bd3d-ebb4be015b40 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:00.350017 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b873f6f-0ee7-4f2e-9f8a-167d2337a30f None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:00.370963 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5031c466-b343-468f-bd3d-ebb4be015b40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:16:00.383943 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-5031c466-b343-468f-bd3d-ebb4be015b40 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:16:00.383943 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:00.383943 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:00.383943 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:00.383943 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:00.383943 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:00.383943 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:00.383943 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:00.383943 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:00.383943 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:00.383943 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:00.383943 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:00.383943 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:16:00.383943 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:16:00.383943 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:16:00.383943 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:16:00.385818 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:16:00.385818 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:16:00.385818 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:16:00.385818 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:16:00.385818 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:00.385818 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:00.385818 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:00.385818 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:00.385818 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:00.385818 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:00.385818 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:00.385818 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:00.385818 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:00.385818 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:00.385818 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:00.385818 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:00.387375 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:00.387375 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:00.387375 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:00.387375 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:00.387375 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:16:00.387375 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:16:00.387375 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:16:00.387375 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:16:00.387375 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:16:00.387375 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:16:00.387375 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:16:00.387375 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:16:00.389821 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 207/406] 10.222.0.79 () {56 vars in 1096 bytes} [Wed Aug 31 12:16:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:00.390408 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5031c466-b343-468f-bd3d-ebb4be015b40 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:00.404565 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8680c775-9e44-4038-9eb9-7b203889e846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:00.405644 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8680c775-9e44-4038-9eb9-7b203889e846 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:00.406122 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8680c775-9e44-4038-9eb9-7b203889e846 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:00.406586 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8680c775-9e44-4038-9eb9-7b203889e846 None admin] PATH_INFO: `/v3/groups/8436fda8c1784798ba5d9f700b4d0800` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:00.408609 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8680c775-9e44-4038-9eb9-7b203889e846 None admin] RBAC: Authorizing `identity:get_group(group_id=8436fda8c1784798ba5d9f700b4d0800)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:00.411330 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8680c775-9e44-4038-9eb9-7b203889e846 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:00.414666 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 200/407] 10.222.0.79 () {56 vars in 1180 bytes} [Wed Aug 31 12:16:00 2022] GET /identity/v3/groups/8436fda8c1784798ba5d9f700b4d0800 => generated 226 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:00.420586 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8680c775-9e44-4038-9eb9-7b203889e846 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:00.462672 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:00.631233 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8680c775-9e44-4038-9eb9-7b203889e846 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:00.631897 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5031c466-b343-468f-bd3d-ebb4be015b40 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:00.663518 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:00.707114 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da29d1a-3920-4012-8ac8-5d975574810e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:00.707632 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2083ba-bed4-4557-83b8-fda3c1f8f6cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:00.708733 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2083ba-bed4-4557-83b8-fda3c1f8f6cd None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:00.709181 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da29d1a-3920-4012-8ac8-5d975574810e None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:00.709340 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2083ba-bed4-4557-83b8-fda3c1f8f6cd None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:00.709690 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2083ba-bed4-4557-83b8-fda3c1f8f6cd None admin] PATH_INFO: `/v3/projects/c28fc617d7054dbeb5fd1e39107959fc` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:00.710424 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da29d1a-3920-4012-8ac8-5d975574810e None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:00.711471 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da29d1a-3920-4012-8ac8-5d975574810e None admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:00.712003 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2083ba-bed4-4557-83b8-fda3c1f8f6cd None admin] RBAC: Authorizing `identity:get_project(project_id=c28fc617d7054dbeb5fd1e39107959fc)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:00.713222 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da29d1a-3920-4012-8ac8-5d975574810e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:00.714097 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da29d1a-3920-4012-8ac8-5d975574810e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:00.714880 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2083ba-bed4-4557-83b8-fda3c1f8f6cd None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:00.717281 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da29d1a-3920-4012-8ac8-5d975574810e None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:00.717972 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 208/408] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 12:16:00 2022] GET /identity/v3/projects/c28fc617d7054dbeb5fd1e39107959fc => generated 302 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:00.724425 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2083ba-bed4-4557-83b8-fda3c1f8f6cd None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:00.740938 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 201/409] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 12:16:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:00.744106 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da29d1a-3920-4012-8ac8-5d975574810e None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:00.895498 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:00.900253 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2083ba-bed4-4557-83b8-fda3c1f8f6cd None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:00.910134 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da29d1a-3920-4012-8ac8-5d975574810e None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:00.950171 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1129d54c-2816-48f8-b2ce-f9317efea0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:00.950885 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1129d54c-2816-48f8-b2ce-f9317efea0a1 None admin] REQUEST_METHOD: `PUT` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:00.951189 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1129d54c-2816-48f8-b2ce-f9317efea0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:00.951467 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1129d54c-2816-48f8-b2ce-f9317efea0a1 None admin] PATH_INFO: `/v3/projects/c28fc617d7054dbeb5fd1e39107959fc/groups/8436fda8c1784798ba5d9f700b4d0800/roles/b5cfd7a855a448359e9017f51d32b6fc` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:00.953598 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1129d54c-2816-48f8-b2ce-f9317efea0a1 None admin] RBAC: Authorizing `identity:create_grant(project_id=c28fc617d7054dbeb5fd1e39107959fc, group_id=8436fda8c1784798ba5d9f700b4d0800, role_id=b5cfd7a855a448359e9017f51d32b6fc)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:00.955118 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1129d54c-2816-48f8-b2ce-f9317efea0a1 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:00.972550 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35c0743-eb70-4c91-af76-58ebaadc49db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:00.974830 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c0743-eb70-4c91-af76-58ebaadc49db None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:00.975580 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c0743-eb70-4c91-af76-58ebaadc49db None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:00.976287 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c0743-eb70-4c91-af76-58ebaadc49db None admin] PATH_INFO: `/v3/projects/c28fc617d7054dbeb5fd1e39107959fc` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:00.978821 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 202/410] 10.222.0.79 () {58 vars in 1442 bytes} [Wed Aug 31 12:16:00 2022] PUT /identity/v3/projects/c28fc617d7054dbeb5fd1e39107959fc/groups/8436fda8c1784798ba5d9f700b4d0800/roles/b5cfd7a855a448359e9017f51d32b6fc => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:16:00.979376 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35c0743-eb70-4c91-af76-58ebaadc49db None admin] RBAC: Authorizing `identity:get_project(project_id=c28fc617d7054dbeb5fd1e39107959fc)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:00.979927 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1129d54c-2816-48f8-b2ce-f9317efea0a1 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:00.983067 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35c0743-eb70-4c91-af76-58ebaadc49db None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:00.995695 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 209/411] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 12:16:00 2022] GET /identity/v3/projects/c28fc617d7054dbeb5fd1e39107959fc => generated 302 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:00.999338 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35c0743-eb70-4c91-af76-58ebaadc49db None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:01.111711 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:01.163064 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1129d54c-2816-48f8-b2ce-f9317efea0a1 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:01.171765 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35c0743-eb70-4c91-af76-58ebaadc49db None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:01.213706 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4848f16d-2c2b-4b0c-93bb-2cb9b4be40c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:01.214392 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848f16d-2c2b-4b0c-93bb-2cb9b4be40c0 None admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:01.214675 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848f16d-2c2b-4b0c-93bb-2cb9b4be40c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:01.214979 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848f16d-2c2b-4b0c-93bb-2cb9b4be40c0 None admin] PATH_INFO: `/v3/projects/c28fc617d7054dbeb5fd1e39107959fc/groups/8436fda8c1784798ba5d9f700b4d0800/roles/be23fee6ea264172b277f97af30cc689` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:01.217264 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4848f16d-2c2b-4b0c-93bb-2cb9b4be40c0 None admin] RBAC: Authorizing `identity:create_grant(project_id=c28fc617d7054dbeb5fd1e39107959fc, group_id=8436fda8c1784798ba5d9f700b4d0800, role_id=be23fee6ea264172b277f97af30cc689)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:01.219230 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4848f16d-2c2b-4b0c-93bb-2cb9b4be40c0 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:01.241298 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a04ccc-7960-4347-b002-a731c2026c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:01.242063 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a04ccc-7960-4347-b002-a731c2026c2a None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:01.244386 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a04ccc-7960-4347-b002-a731c2026c2a None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:01.244386 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a04ccc-7960-4347-b002-a731c2026c2a None admin] PATH_INFO: `/v3/groups/23b53fa8a2604711911c6d6a5b83f567` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:01.245441 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 210/412] 10.222.0.79 () {58 vars in 1442 bytes} [Wed Aug 31 12:16:00 2022] PUT /identity/v3/projects/c28fc617d7054dbeb5fd1e39107959fc/groups/8436fda8c1784798ba5d9f700b4d0800/roles/be23fee6ea264172b277f97af30cc689 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:16:01.247692 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a04ccc-7960-4347-b002-a731c2026c2a None admin] RBAC: Authorizing `identity:get_group(group_id=23b53fa8a2604711911c6d6a5b83f567)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:01.249233 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a04ccc-7960-4347-b002-a731c2026c2a None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:01.251287 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 203/413] 10.222.0.79 () {56 vars in 1180 bytes} [Wed Aug 31 12:16:00 2022] GET /identity/v3/groups/23b53fa8a2604711911c6d6a5b83f567 => generated 229 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:01.261382 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4848f16d-2c2b-4b0c-93bb-2cb9b4be40c0 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:01.403732 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c82d22-aba7-4d35-b68e-51de6d63c6e5 None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:01.403732 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c82d22-aba7-4d35-b68e-51de6d63c6e5 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:01.403732 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c82d22-aba7-4d35-b68e-51de6d63c6e5 None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:01.405351 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 204/414] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:16:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:16:01.411097 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3504b7b-6f06-4bf6-8292-c0f09ad5fef8 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:01.411394 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3504b7b-6f06-4bf6-8292-c0f09ad5fef8 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:01.411657 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3504b7b-6f06-4bf6-8292-c0f09ad5fef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:01.422389 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4848f16d-2c2b-4b0c-93bb-2cb9b4be40c0 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:01.435997 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-d3504b7b-6f06-4bf6-8292-c0f09ad5fef8 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:01.437238 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-d3504b7b-6f06-4bf6-8292-c0f09ad5fef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:01.438586 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:01.476015 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:01.477221 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acac9575-b0a8-4327-944b-ef16c178ba77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:01.477990 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac9575-b0a8-4327-944b-ef16c178ba77 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:01.478366 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac9575-b0a8-4327-944b-ef16c178ba77 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:01.478737 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac9575-b0a8-4327-944b-ef16c178ba77 None admin] PATH_INFO: `/v3/projects/088123e0cad144f3a713fb6c4c75d880` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:01.480082 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acac9575-b0a8-4327-944b-ef16c178ba77 None admin] RBAC: Authorizing `identity:get_project(project_id=088123e0cad144f3a713fb6c4c75d880)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:01.481643 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acac9575-b0a8-4327-944b-ef16c178ba77 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:01.485186 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 211/415] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 12:16:01 2022] GET /identity/v3/projects/088123e0cad144f3a713fb6c4c75d880 => generated 344 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:01.495978 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acac9575-b0a8-4327-944b-ef16c178ba77 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:01.527734 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 205/416] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:16:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 12:16:01.692184 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acac9575-b0a8-4327-944b-ef16c178ba77 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:01.772067 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5ad8c9-74a2-4635-a13f-071e31a04373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:01.773143 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ad8c9-74a2-4635-a13f-071e31a04373 None admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:01.773676 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ad8c9-74a2-4635-a13f-071e31a04373 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:01.774667 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ad8c9-74a2-4635-a13f-071e31a04373 None admin] PATH_INFO: `/v3/projects/088123e0cad144f3a713fb6c4c75d880/groups/23b53fa8a2604711911c6d6a5b83f567/roles/a332ef951db949b0bad7019fbd28a1b9` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:01.778543 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5ad8c9-74a2-4635-a13f-071e31a04373 None admin] RBAC: Authorizing `identity:create_grant(project_id=088123e0cad144f3a713fb6c4c75d880, group_id=23b53fa8a2604711911c6d6a5b83f567, role_id=a332ef951db949b0bad7019fbd28a1b9)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:01.781536 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5ad8c9-74a2-4635-a13f-071e31a04373 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:01.811937 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 212/417] 10.222.0.79 () {58 vars in 1442 bytes} [Wed Aug 31 12:16:01 2022] PUT /identity/v3/projects/088123e0cad144f3a713fb6c4c75d880/groups/23b53fa8a2604711911c6d6a5b83f567/roles/a332ef951db949b0bad7019fbd28a1b9 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:16:01.983699 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3504b7b-6f06-4bf6-8292-c0f09ad5fef8 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:02.110985 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3504b7b-6f06-4bf6-8292-c0f09ad5fef8 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:02.172300 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971cde67-65c4-403a-8512-8352e2ae094e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:02.172961 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971cde67-65c4-403a-8512-8352e2ae094e None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:02.173242 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971cde67-65c4-403a-8512-8352e2ae094e None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:02.173520 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971cde67-65c4-403a-8512-8352e2ae094e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:02.189623 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971cde67-65c4-403a-8512-8352e2ae094e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:16:02.194639 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-971cde67-65c4-403a-8512-8352e2ae094e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:16:02.194639 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:02.194639 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:02.194639 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:02.194639 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:02.194639 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:02.194639 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:02.194639 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:02.194639 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:02.194639 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:02.194639 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:02.194639 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:02.194639 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:16:02.194639 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:16:02.194639 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:16:02.194639 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:16:02.196427 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:16:02.196427 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:16:02.196427 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:16:02.196427 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:16:02.196427 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:02.196427 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:02.196427 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:02.196427 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:02.196427 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:02.196427 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:02.196427 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:02.196427 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:02.196427 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:02.196427 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:02.196427 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:02.196427 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:02.197362 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:02.197362 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:02.197362 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:02.197362 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:02.197362 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:16:02.197362 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:16:02.197362 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:16:02.197362 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:16:02.197362 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:16:02.197362 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:16:02.197362 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:16:02.197362 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:16:02.198814 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 206/418] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 12:16:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:02.207127 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5ad8c9-74a2-4635-a13f-071e31a04373 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:02.296747 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:02.490244 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5ad8c9-74a2-4635-a13f-071e31a04373 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:02.556047 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a34ec2c-ce34-424e-9b3f-d73ff811c976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:02.556047 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a34ec2c-ce34-424e-9b3f-d73ff811c976 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:02.556421 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a34ec2c-ce34-424e-9b3f-d73ff811c976 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:02.556421 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a34ec2c-ce34-424e-9b3f-d73ff811c976 None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:02.562893 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a34ec2c-ce34-424e-9b3f-d73ff811c976 None admin] RBAC: Adding query filter params (name=member) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:02.562893 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a34ec2c-ce34-424e-9b3f-d73ff811c976 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:02.562893 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a34ec2c-ce34-424e-9b3f-d73ff811c976 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:02.572064 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 213/419] 10.222.0.79 () {56 vars in 1101 bytes} [Wed Aug 31 12:16:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:02.580227 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971cde67-65c4-403a-8512-8352e2ae094e None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:02.609106 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:02.784675 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971cde67-65c4-403a-8512-8352e2ae094e None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:02.849061 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c654dbf1-5b09-407a-b8b9-0b84b01219bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:02.850040 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c654dbf1-5b09-407a-b8b9-0b84b01219bf None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:02.850528 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c654dbf1-5b09-407a-b8b9-0b84b01219bf None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:02.851049 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c654dbf1-5b09-407a-b8b9-0b84b01219bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:02.982411 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c654dbf1-5b09-407a-b8b9-0b84b01219bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:02.985276 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c654dbf1-5b09-407a-b8b9-0b84b01219bf None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:02.991363 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:03.172832 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2540e58b-b74f-4e30-82c9-9fa0b22f12f1 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:03.173594 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2540e58b-b74f-4e30-82c9-9fa0b22f12f1 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:03.174083 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2540e58b-b74f-4e30-82c9-9fa0b22f12f1 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:03.178120 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 214/420] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:16:03 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:16:03.179241 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 207/421] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 12:16:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 600 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:16:03.192295 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2540e58b-b74f-4e30-82c9-9fa0b22f12f1 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:03.196991 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc902ec-10a1-4457-8381-00d8c2587b8e None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:03.197329 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc902ec-10a1-4457-8381-00d8c2587b8e None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:03.197573 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc902ec-10a1-4457-8381-00d8c2587b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:03.231932 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-2fc902ec-10a1-4457-8381-00d8c2587b8e None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:03.233163 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-2fc902ec-10a1-4457-8381-00d8c2587b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:03.396313 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 208/422] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:16:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 12:16:03.455260 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:03.466135 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2540e58b-b74f-4e30-82c9-9fa0b22f12f1 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:03.542409 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13abb44d-fb57-4f59-aed1-6d470a2d9943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:03.543508 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13abb44d-fb57-4f59-aed1-6d470a2d9943 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:03.544006 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13abb44d-fb57-4f59-aed1-6d470a2d9943 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:03.544498 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13abb44d-fb57-4f59-aed1-6d470a2d9943 None admin] PATH_INFO: `/v3/projects/79222f00008144bba451b7a2da2da187` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:03.549916 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13abb44d-fb57-4f59-aed1-6d470a2d9943 None admin] RBAC: Authorizing `identity:get_project(project_id=79222f00008144bba451b7a2da2da187)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:03.552290 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13abb44d-fb57-4f59-aed1-6d470a2d9943 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:03.558074 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 215/423] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 12:16:03 2022] GET /identity/v3/projects/79222f00008144bba451b7a2da2da187 => generated 298 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:03.566721 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc902ec-10a1-4457-8381-00d8c2587b8e None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:03.639879 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:03.730575 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc902ec-10a1-4457-8381-00d8c2587b8e None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:03.774459 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c80e260-6e6a-4ce8-933c-ad69c5e25918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:03.775448 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c80e260-6e6a-4ce8-933c-ad69c5e25918 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:03.775941 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c80e260-6e6a-4ce8-933c-ad69c5e25918 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:03.776428 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c80e260-6e6a-4ce8-933c-ad69c5e25918 None admin] PATH_INFO: `/v3/groups/8436fda8c1784798ba5d9f700b4d0800` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:03.778528 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c80e260-6e6a-4ce8-933c-ad69c5e25918 None admin] RBAC: Authorizing `identity:get_group(group_id=8436fda8c1784798ba5d9f700b4d0800)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:03.781289 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c80e260-6e6a-4ce8-933c-ad69c5e25918 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:03.784323 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 209/424] 10.222.0.79 () {56 vars in 1180 bytes} [Wed Aug 31 12:16:03 2022] GET /identity/v3/groups/8436fda8c1784798ba5d9f700b4d0800 => generated 226 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:03.794401 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13abb44d-fb57-4f59-aed1-6d470a2d9943 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:03.957413 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c80e260-6e6a-4ce8-933c-ad69c5e25918 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:03.981817 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13abb44d-fb57-4f59-aed1-6d470a2d9943 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:04.074955 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5690b92-5ddd-4c55-b177-0c4c99f23879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:04.075558 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5690b92-5ddd-4c55-b177-0c4c99f23879 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:04.075845 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5690b92-5ddd-4c55-b177-0c4c99f23879 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:04.076123 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5690b92-5ddd-4c55-b177-0c4c99f23879 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:04.076868 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5690b92-5ddd-4c55-b177-0c4c99f23879 None admin] RBAC: Adding query filter params (group.id=8436fda8c1784798ba5d9f700b4d0800, role.id=b5cfd7a855a448359e9017f51d32b6fc, scope.project.id=79222f00008144bba451b7a2da2da187) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:04.077178 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5690b92-5ddd-4c55-b177-0c4c99f23879 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:04.078664 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5690b92-5ddd-4c55-b177-0c4c99f23879 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:04.097482 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 216/425] 10.222.0.79 () {56 vars in 1376 bytes} [Wed Aug 31 12:16:03 2022] GET /identity/v3/role_assignments?group.id=8436fda8c1784798ba5d9f700b4d0800&scope.project.id=79222f00008144bba451b7a2da2da187&role.id=b5cfd7a855a448359e9017f51d32b6fc => generated 611 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:04.215213 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:04.221319 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c80e260-6e6a-4ce8-933c-ad69c5e25918 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:04.289986 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553de012-797d-4ac7-82f2-24350d0c5d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:04.290918 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553de012-797d-4ac7-82f2-24350d0c5d8c None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:04.291216 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553de012-797d-4ac7-82f2-24350d0c5d8c None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:04.291497 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553de012-797d-4ac7-82f2-24350d0c5d8c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:04.314390 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553de012-797d-4ac7-82f2-24350d0c5d8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:16:04.319706 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-553de012-797d-4ac7-82f2-24350d0c5d8c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 12:16:04.319706 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:04.319706 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:04.319706 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:04.319706 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:04.319706 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:04.319706 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:04.319706 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:04.319706 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:04.319706 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:04.319706 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:04.319706 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:04.319706 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:16:04.319706 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:16:04.319706 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:16:04.319706 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:16:04.321345 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:16:04.321345 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:16:04.321345 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:16:04.321345 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:16:04.321345 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:04.321345 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:04.321345 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:04.321345 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:04.321345 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:04.321345 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:04.321345 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:04.321345 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:04.321345 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:04.321345 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:04.321345 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:04.321345 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:04.322408 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:04.322408 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:04.322408 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:04.322408 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:04.322408 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:16:04.322408 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:16:04.322408 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:16:04.322408 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:16:04.322408 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:16:04.322408 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:16:04.322408 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 12:16:04.322408 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:16:04.322408 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 210/426] 10.222.0.79 () {56 vars in 1114 bytes} [Wed Aug 31 12:16:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:04.331028 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4045f50b-48cb-44c1-a943-246b7204308a None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:04.331322 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4045f50b-48cb-44c1-a943-246b7204308a None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:04.331598 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4045f50b-48cb-44c1-a943-246b7204308a None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:04.333342 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 217/427] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:16:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:16:04.334464 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553de012-797d-4ac7-82f2-24350d0c5d8c None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:04.340335 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af89d5-ed08-41d6-8555-37b345c0acff None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:04.340613 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af89d5-ed08-41d6-8555-37b345c0acff None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:04.340887 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af89d5-ed08-41d6-8555-37b345c0acff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:04.376266 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-43af89d5-ed08-41d6-8555-37b345c0acff None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:04.377500 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-43af89d5-ed08-41d6-8555-37b345c0acff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:04.430725 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:04.512887 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 218/428] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:16:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 12:16:04.539026 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553de012-797d-4ac7-82f2-24350d0c5d8c None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:04.600496 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a432a44-7ab4-4acc-bba5-7f36b545fdfd None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:04.601108 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a432a44-7ab4-4acc-bba5-7f36b545fdfd None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:04.601108 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a432a44-7ab4-4acc-bba5-7f36b545fdfd None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:04.603478 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d883332c-6ce1-4bbf-b6d3-19c79bbeb9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:04.604598 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d883332c-6ce1-4bbf-b6d3-19c79bbeb9b3 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:04.605100 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d883332c-6ce1-4bbf-b6d3-19c79bbeb9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:04.605727 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d883332c-6ce1-4bbf-b6d3-19c79bbeb9b3 None admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:04.606881 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d883332c-6ce1-4bbf-b6d3-19c79bbeb9b3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:04.607018 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 219/429] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:16:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:16:04.607644 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d883332c-6ce1-4bbf-b6d3-19c79bbeb9b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:04.608391 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6369c4e-f5d0-4800-8a0a-f932fe077cef None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:04.608746 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6369c4e-f5d0-4800-8a0a-f932fe077cef None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:04.609087 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6369c4e-f5d0-4800-8a0a-f932fe077cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:04.610297 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d883332c-6ce1-4bbf-b6d3-19c79bbeb9b3 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:04.620764 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 211/430] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 12:16:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:04.626329 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d883332c-6ce1-4bbf-b6d3-19c79bbeb9b3 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:04.647515 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-e6369c4e-f5d0-4800-8a0a-f932fe077cef None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:04.648875 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-e6369c4e-f5d0-4800-8a0a-f932fe077cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:04.685744 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:04.744188 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 220/431] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:16:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 12:16:04.752861 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6aaa91-70a0-4422-93b5-7dcc043f2705 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:04.753279 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6aaa91-70a0-4422-93b5-7dcc043f2705 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:04.753649 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6aaa91-70a0-4422-93b5-7dcc043f2705 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:04.755681 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 221/432] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:16:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:16:04.764482 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad63db-3b88-42ea-a422-c209f077cff4 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:04.764984 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad63db-3b88-42ea-a422-c209f077cff4 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:04.765466 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad63db-3b88-42ea-a422-c209f077cff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:04.803399 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-31ad63db-3b88-42ea-a422-c209f077cff4 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:04.804629 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-31ad63db-3b88-42ea-a422-c209f077cff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:04.823936 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d883332c-6ce1-4bbf-b6d3-19c79bbeb9b3 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:04.873622 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c2467-c850-4b25-ab40-70be94fd68b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:04.874901 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c2467-c850-4b25-ab40-70be94fd68b3 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:04.875556 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c2467-c850-4b25-ab40-70be94fd68b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:04.876304 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c2467-c850-4b25-ab40-70be94fd68b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:04.896681 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 222/433] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:16:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:16:04.897672 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ad63db-3b88-42ea-a422-c209f077cff4 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:04.938020 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:04.984879 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00c2467-c850-4b25-ab40-70be94fd68b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:04.986357 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00c2467-c850-4b25-ab40-70be94fd68b3 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:05.012539 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:05.071332 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ad63db-3b88-42ea-a422-c209f077cff4 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:05.115522 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d174fdff-f212-4794-8c8b-5c9d568d4d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:05.116172 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d174fdff-f212-4794-8c8b-5c9d568d4d07 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:05.116448 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d174fdff-f212-4794-8c8b-5c9d568d4d07 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:05.116717 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d174fdff-f212-4794-8c8b-5c9d568d4d07 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:05.123952 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 212/434] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 12:16:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 12:16:05.123952 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c2467-c850-4b25-ab40-70be94fd68b3 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:05.139418 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d174fdff-f212-4794-8c8b-5c9d568d4d07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:16:05.144409 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-d174fdff-f212-4794-8c8b-5c9d568d4d07 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:16:05.144409 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:05.144409 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:05.144409 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:05.144409 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:05.144409 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:05.144409 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:05.144409 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:05.144409 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:05.144409 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:05.144409 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:05.144409 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:05.144409 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:16:05.144409 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:16:05.144409 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:16:05.144409 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:16:05.146045 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:16:05.146045 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:16:05.146045 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:16:05.146045 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:16:05.146045 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:05.146045 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:05.146045 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:05.146045 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:05.146045 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:05.146045 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:05.146045 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:05.146045 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:05.146045 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:05.146045 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:05.146045 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:05.146045 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:05.147742 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:05.147742 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:05.147742 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:05.147742 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:05.147742 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:16:05.147742 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:16:05.147742 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:16:05.147742 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:16:05.147742 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:16:05.147742 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:16:05.147742 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:16:05.147742 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:16:05.147742 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 223/435] 10.222.0.79 () {56 vars in 1096 bytes} [Wed Aug 31 12:16:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:05.147742 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d174fdff-f212-4794-8c8b-5c9d568d4d07 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:05.247444 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:05.266070 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c2467-c850-4b25-ab40-70be94fd68b3 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:05.271578 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d174fdff-f212-4794-8c8b-5c9d568d4d07 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:05.291648 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:05.304474 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7723df5d-5698-46c0-a705-c2a27511d56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:05.305693 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723df5d-5698-46c0-a705-c2a27511d56a None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:05.305988 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723df5d-5698-46c0-a705-c2a27511d56a None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:05.306252 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723df5d-5698-46c0-a705-c2a27511d56a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:05.317456 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7723df5d-5698-46c0-a705-c2a27511d56a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:16:05.317950 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe5906a-3dd0-48a3-a733-7c40dff35aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:05.318589 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe5906a-3dd0-48a3-a733-7c40dff35aec None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:05.318900 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe5906a-3dd0-48a3-a733-7c40dff35aec None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:05.319165 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe5906a-3dd0-48a3-a733-7c40dff35aec None admin] PATH_INFO: `/v3/projects/79222f00008144bba451b7a2da2da187` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:05.320362 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe5906a-3dd0-48a3-a733-7c40dff35aec None admin] RBAC: Authorizing `identity:get_project(project_id=79222f00008144bba451b7a2da2da187)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:05.321951 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe5906a-3dd0-48a3-a733-7c40dff35aec None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:05.322532 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-7723df5d-5698-46c0-a705-c2a27511d56a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 12:16:05.322532 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:05.322532 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:05.322532 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:05.322532 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:05.322532 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:05.322532 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:05.322532 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:05.322532 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:05.322532 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:05.322532 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:05.322532 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:05.322532 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:16:05.322532 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:16:05.322532 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:16:05.322532 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:16:05.323440 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:16:05.323440 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:16:05.323440 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:16:05.323440 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:16:05.323440 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:05.323440 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:05.323440 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:05.323440 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:05.323440 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:05.323440 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:05.323440 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:05.323440 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:05.323440 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:05.323440 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:05.323440 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:05.323440 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:05.324237 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:05.324237 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:05.324237 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:05.324237 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:05.324237 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:16:05.324237 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:16:05.324237 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:16:05.324237 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:16:05.324237 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:16:05.324237 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:16:05.324237 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 12:16:05.324237 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:16:05.325410 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 224/436] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 12:16:05 2022] GET /identity/v3/projects/79222f00008144bba451b7a2da2da187 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:05.325494 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 213/437] 10.222.0.79 () {56 vars in 1114 bytes} [Wed Aug 31 12:16:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:05.325591 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe5906a-3dd0-48a3-a733-7c40dff35aec None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:05.325819 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7723df5d-5698-46c0-a705-c2a27511d56a None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:05.442251 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7723df5d-5698-46c0-a705-c2a27511d56a None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:05.461765 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe5906a-3dd0-48a3-a733-7c40dff35aec None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:05.491992 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836670a4-9e86-4fce-a30f-d189a5660fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:05.493696 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836670a4-9e86-4fce-a30f-d189a5660fd8 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:05.494145 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836670a4-9e86-4fce-a30f-d189a5660fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:05.494570 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836670a4-9e86-4fce-a30f-d189a5660fd8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:05.510804 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836670a4-9e86-4fce-a30f-d189a5660fd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:16:05.515617 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca10fe-e6d0-4814-aa94-a20a2729e36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:05.516566 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca10fe-e6d0-4814-aa94-a20a2729e36d None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:05.517023 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca10fe-e6d0-4814-aa94-a20a2729e36d None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:05.517469 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca10fe-e6d0-4814-aa94-a20a2729e36d None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:05.518529 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ca10fe-e6d0-4814-aa94-a20a2729e36d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:05.519053 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ca10fe-e6d0-4814-aa94-a20a2729e36d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:05.520007 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-836670a4-9e86-4fce-a30f-d189a5660fd8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:16:05.520007 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:05.520007 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:05.520007 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:05.520007 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:05.520007 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:05.520007 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:05.520007 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:05.520007 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:05.520007 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:05.520007 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:05.520007 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:05.520007 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:16:05.520007 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:16:05.520007 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:16:05.520007 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:16:05.520905 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:16:05.520905 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:16:05.520905 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:16:05.520905 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:16:05.520905 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:05.520905 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:05.520905 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:05.520905 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:05.520905 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:05.520905 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:05.520905 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:05.520905 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:05.520905 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:05.520905 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:05.520905 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:05.520905 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:05.521704 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:05.521704 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:05.521704 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:05.521704 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:05.521704 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:16:05.521704 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:16:05.521704 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:16:05.521704 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:16:05.521704 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:16:05.521704 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:16:05.521704 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:16:05.521704 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:16:05.522417 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ca10fe-e6d0-4814-aa94-a20a2729e36d None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:05.522486 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 214/438] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 12:16:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:05.523166 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836670a4-9e86-4fce-a30f-d189a5660fd8 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:05.535760 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 225/439] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 12:16:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:05.537159 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca10fe-e6d0-4814-aa94-a20a2729e36d None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:05.560506 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:05.584372 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:05.659205 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836670a4-9e86-4fce-a30f-d189a5660fd8 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:05.667201 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca10fe-e6d0-4814-aa94-a20a2729e36d None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:05.700161 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047b3824-1df9-4c9e-8618-bd3e425cf73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:05.701111 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047b3824-1df9-4c9e-8618-bd3e425cf73c None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:05.701485 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047b3824-1df9-4c9e-8618-bd3e425cf73c None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:05.701858 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047b3824-1df9-4c9e-8618-bd3e425cf73c None admin] PATH_INFO: `/v3/groups/8436fda8c1784798ba5d9f700b4d0800` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:05.703054 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047b3824-1df9-4c9e-8618-bd3e425cf73c None admin] RBAC: Authorizing `identity:get_group(group_id=8436fda8c1784798ba5d9f700b4d0800)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:05.704579 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047b3824-1df9-4c9e-8618-bd3e425cf73c None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:05.706155 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 215/440] 10.222.0.79 () {56 vars in 1180 bytes} [Wed Aug 31 12:16:05 2022] GET /identity/v3/groups/8436fda8c1784798ba5d9f700b4d0800 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:05.706949 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047b3824-1df9-4c9e-8618-bd3e425cf73c None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:05.709051 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ce029c-eacb-4c5e-9376-5932482d5fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:05.710960 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce029c-eacb-4c5e-9376-5932482d5fb3 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:05.712060 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce029c-eacb-4c5e-9376-5932482d5fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:05.712350 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce029c-eacb-4c5e-9376-5932482d5fb3 None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:05.712987 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ce029c-eacb-4c5e-9376-5932482d5fb3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:05.713339 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ce029c-eacb-4c5e-9376-5932482d5fb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:05.715904 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ce029c-eacb-4c5e-9376-5932482d5fb3 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:05.726184 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 226/441] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 12:16:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:05.727506 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ce029c-eacb-4c5e-9376-5932482d5fb3 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:05.811985 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:05.824520 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047b3824-1df9-4c9e-8618-bd3e425cf73c None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:05.836830 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:05.845471 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ce029c-eacb-4c5e-9376-5932482d5fb3 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:05.864102 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b27ad75-25c3-485c-8df3-1ab13083a76f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:05.864728 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b27ad75-25c3-485c-8df3-1ab13083a76f None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:05.865011 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b27ad75-25c3-485c-8df3-1ab13083a76f None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:05.865282 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b27ad75-25c3-485c-8df3-1ab13083a76f None admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:05.865951 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b27ad75-25c3-485c-8df3-1ab13083a76f None admin] RBAC: Adding query filter params (name=member) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:05.866251 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b27ad75-25c3-485c-8df3-1ab13083a76f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:05.867866 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b27ad75-25c3-485c-8df3-1ab13083a76f None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:05.876771 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 216/442] 10.222.0.79 () {56 vars in 1101 bytes} [Wed Aug 31 12:16:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:05.877444 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b27ad75-25c3-485c-8df3-1ab13083a76f None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:05.890972 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383ee6aa-d901-451d-b677-fae25f41df03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:05.891605 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383ee6aa-d901-451d-b677-fae25f41df03 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:05.891890 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383ee6aa-d901-451d-b677-fae25f41df03 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:05.892154 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383ee6aa-d901-451d-b677-fae25f41df03 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:05.967470 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383ee6aa-d901-451d-b677-fae25f41df03 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:05.969309 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383ee6aa-d901-451d-b677-fae25f41df03 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:05.993924 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b27ad75-25c3-485c-8df3-1ab13083a76f None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:06.033659 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7132a90-8bdd-4c3c-ba48-aef2e96aa622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:06.034288 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7132a90-8bdd-4c3c-ba48-aef2e96aa622 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:06.034566 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7132a90-8bdd-4c3c-ba48-aef2e96aa622 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:06.034914 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7132a90-8bdd-4c3c-ba48-aef2e96aa622 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:06.035647 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7132a90-8bdd-4c3c-ba48-aef2e96aa622 None admin] RBAC: Adding query filter params (group.id=8436fda8c1784798ba5d9f700b4d0800, role.id=be23fee6ea264172b277f97af30cc689, scope.project.id=79222f00008144bba451b7a2da2da187) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:06.035953 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7132a90-8bdd-4c3c-ba48-aef2e96aa622 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:06.037428 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7132a90-8bdd-4c3c-ba48-aef2e96aa622 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:06.044142 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 217/443] 10.222.0.79 () {56 vars in 1376 bytes} [Wed Aug 31 12:16:05 2022] GET /identity/v3/role_assignments?group.id=8436fda8c1784798ba5d9f700b4d0800&scope.project.id=79222f00008144bba451b7a2da2da187&role.id=be23fee6ea264172b277f97af30cc689 => generated 611 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:06.044966 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7132a90-8bdd-4c3c-ba48-aef2e96aa622 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:06.060640 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:06.092696 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:06.096803 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 227/444] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 12:16:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:16:06.097940 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383ee6aa-d901-451d-b677-fae25f41df03 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:06.182825 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7132a90-8bdd-4c3c-ba48-aef2e96aa622 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:06.224557 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b0597a-e355-49ac-ae4c-fdab1197f047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:06.225102 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b0597a-e355-49ac-ae4c-fdab1197f047 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:06.225386 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b0597a-e355-49ac-ae4c-fdab1197f047 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:06.225661 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b0597a-e355-49ac-ae4c-fdab1197f047 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:06.247315 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383ee6aa-d901-451d-b677-fae25f41df03 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:06.307845 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19834e7-d43a-4bd5-8ea0-034ad144c317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:06.308512 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19834e7-d43a-4bd5-8ea0-034ad144c317 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:06.308789 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19834e7-d43a-4bd5-8ea0-034ad144c317 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:06.309055 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19834e7-d43a-4bd5-8ea0-034ad144c317 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:06.321213 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b0597a-e355-49ac-ae4c-fdab1197f047 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:06.324726 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b0597a-e355-49ac-ae4c-fdab1197f047 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:06.371578 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:06.379665 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:06.409279 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19834e7-d43a-4bd5-8ea0-034ad144c317 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:06.411088 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19834e7-d43a-4bd5-8ea0-034ad144c317 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:06.494395 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 218/445] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 12:16:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:16:06.495662 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b0597a-e355-49ac-ae4c-fdab1197f047 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:06.545140 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 228/446] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 12:16:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:16:06.545998 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19834e7-d43a-4bd5-8ea0-034ad144c317 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:06.620226 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b0597a-e355-49ac-ae4c-fdab1197f047 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:06.631992 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:06.658016 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ae6bc5-ccd4-42b9-9098-94f59a112904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:06.658657 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae6bc5-ccd4-42b9-9098-94f59a112904 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:06.658969 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae6bc5-ccd4-42b9-9098-94f59a112904 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:06.659249 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae6bc5-ccd4-42b9-9098-94f59a112904 None admin] PATH_INFO: `/v3/projects/088123e0cad144f3a713fb6c4c75d880` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:06.660407 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ae6bc5-ccd4-42b9-9098-94f59a112904 None admin] RBAC: Authorizing `identity:get_project(project_id=088123e0cad144f3a713fb6c4c75d880)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:06.661879 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ae6bc5-ccd4-42b9-9098-94f59a112904 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:06.663429 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19834e7-d43a-4bd5-8ea0-034ad144c317 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:06.663571 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 219/447] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 12:16:06 2022] GET /identity/v3/projects/088123e0cad144f3a713fb6c4c75d880 => generated 344 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:06.664709 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ae6bc5-ccd4-42b9-9098-94f59a112904 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:06.670582 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:06.715316 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb0db43-8e4e-498e-9a9e-b1f691857b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:06.716254 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb0db43-8e4e-498e-9a9e-b1f691857b94 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:06.716254 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb0db43-8e4e-498e-9a9e-b1f691857b94 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:06.716473 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb0db43-8e4e-498e-9a9e-b1f691857b94 None admin] PATH_INFO: `/v3/projects/c28fc617d7054dbeb5fd1e39107959fc` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:06.717612 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb0db43-8e4e-498e-9a9e-b1f691857b94 None admin] RBAC: Authorizing `identity:get_project(project_id=c28fc617d7054dbeb5fd1e39107959fc)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:06.719096 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb0db43-8e4e-498e-9a9e-b1f691857b94 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:06.721093 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 229/448] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 12:16:06 2022] GET /identity/v3/projects/c28fc617d7054dbeb5fd1e39107959fc => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:06.721955 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb0db43-8e4e-498e-9a9e-b1f691857b94 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:06.784765 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ae6bc5-ccd4-42b9-9098-94f59a112904 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:06.830312 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e9bdcf-8b8c-47e6-b721-88deb0e0a250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:06.830980 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9bdcf-8b8c-47e6-b721-88deb0e0a250 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:06.831336 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9bdcf-8b8c-47e6-b721-88deb0e0a250 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:06.831640 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9bdcf-8b8c-47e6-b721-88deb0e0a250 None admin] PATH_INFO: `/v3/projects/c28fc617d7054dbeb5fd1e39107959fc` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:06.832925 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e9bdcf-8b8c-47e6-b721-88deb0e0a250 None admin] RBAC: Authorizing `identity:get_project(project_id=c28fc617d7054dbeb5fd1e39107959fc)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:06.834685 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e9bdcf-8b8c-47e6-b721-88deb0e0a250 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:06.837410 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 220/449] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 12:16:06 2022] GET /identity/v3/projects/c28fc617d7054dbeb5fd1e39107959fc => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:06.838209 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e9bdcf-8b8c-47e6-b721-88deb0e0a250 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:06.846031 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb0db43-8e4e-498e-9a9e-b1f691857b94 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:06.890229 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6543ebe-99b6-4da3-bd87-d4f74ea3ce44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:06.891256 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6543ebe-99b6-4da3-bd87-d4f74ea3ce44 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:06.891710 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6543ebe-99b6-4da3-bd87-d4f74ea3ce44 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:06.892165 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6543ebe-99b6-4da3-bd87-d4f74ea3ce44 None admin] PATH_INFO: `/v3/groups/23b53fa8a2604711911c6d6a5b83f567` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:06.893986 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6543ebe-99b6-4da3-bd87-d4f74ea3ce44 None admin] RBAC: Authorizing `identity:get_group(group_id=23b53fa8a2604711911c6d6a5b83f567)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:06.896447 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6543ebe-99b6-4da3-bd87-d4f74ea3ce44 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:06.899729 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 230/450] 10.222.0.79 () {56 vars in 1180 bytes} [Wed Aug 31 12:16:06 2022] GET /identity/v3/groups/23b53fa8a2604711911c6d6a5b83f567 => generated 229 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:06.901339 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6543ebe-99b6-4da3-bd87-d4f74ea3ce44 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:06.916830 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:06.932900 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:06.969329 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e9bdcf-8b8c-47e6-b721-88deb0e0a250 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:07.011028 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e29fcbf-c517-4fb9-ab73-afc39532fb1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:07.011768 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e29fcbf-c517-4fb9-ab73-afc39532fb1c None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:07.012187 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e29fcbf-c517-4fb9-ab73-afc39532fb1c None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:07.012466 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e29fcbf-c517-4fb9-ab73-afc39532fb1c None admin] PATH_INFO: `/v3/groups/8436fda8c1784798ba5d9f700b4d0800` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:07.013764 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e29fcbf-c517-4fb9-ab73-afc39532fb1c None admin] RBAC: Authorizing `identity:get_group(group_id=8436fda8c1784798ba5d9f700b4d0800)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:07.015843 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e29fcbf-c517-4fb9-ab73-afc39532fb1c None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:07.016388 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6543ebe-99b6-4da3-bd87-d4f74ea3ce44 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:07.017446 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 221/451] 10.222.0.79 () {56 vars in 1180 bytes} [Wed Aug 31 12:16:06 2022] GET /identity/v3/groups/8436fda8c1784798ba5d9f700b4d0800 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:07.018219 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e29fcbf-c517-4fb9-ab73-afc39532fb1c None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:07.058657 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab64478d-3f13-4e2a-be9f-8de70b1b20b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:07.059649 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab64478d-3f13-4e2a-be9f-8de70b1b20b1 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:07.060139 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab64478d-3f13-4e2a-be9f-8de70b1b20b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:07.060621 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab64478d-3f13-4e2a-be9f-8de70b1b20b1 None admin] PATH_INFO: `/v3/groups/8436fda8c1784798ba5d9f700b4d0800` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:07.062586 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab64478d-3f13-4e2a-be9f-8de70b1b20b1 None admin] RBAC: Authorizing `identity:get_group(group_id=8436fda8c1784798ba5d9f700b4d0800)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:07.065106 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab64478d-3f13-4e2a-be9f-8de70b1b20b1 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:07.068112 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 231/452] 10.222.0.79 () {56 vars in 1180 bytes} [Wed Aug 31 12:16:06 2022] GET /identity/v3/groups/8436fda8c1784798ba5d9f700b4d0800 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:07.069349 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab64478d-3f13-4e2a-be9f-8de70b1b20b1 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:07.141228 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e29fcbf-c517-4fb9-ab73-afc39532fb1c None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:07.165685 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:07.189083 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e8001d-b2d4-4cef-a1fc-c7902d8a7811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:07.189709 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e8001d-b2d4-4cef-a1fc-c7902d8a7811 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:07.190011 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e8001d-b2d4-4cef-a1fc-c7902d8a7811 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:07.190252 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e8001d-b2d4-4cef-a1fc-c7902d8a7811 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:07.191031 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e8001d-b2d4-4cef-a1fc-c7902d8a7811 None admin] RBAC: Adding query filter params (group.id=23b53fa8a2604711911c6d6a5b83f567, role.id=a332ef951db949b0bad7019fbd28a1b9, scope.project.id=088123e0cad144f3a713fb6c4c75d880) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:07.191339 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e8001d-b2d4-4cef-a1fc-c7902d8a7811 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:07.192823 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e8001d-b2d4-4cef-a1fc-c7902d8a7811 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:07.193423 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab64478d-3f13-4e2a-be9f-8de70b1b20b1 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:07.200828 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 222/453] 10.222.0.79 () {56 vars in 1376 bytes} [Wed Aug 31 12:16:07 2022] GET /identity/v3/role_assignments?group.id=23b53fa8a2604711911c6d6a5b83f567&scope.project.id=088123e0cad144f3a713fb6c4c75d880&role.id=a332ef951db949b0bad7019fbd28a1b9 => generated 611 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:07.201706 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e8001d-b2d4-4cef-a1fc-c7902d8a7811 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:07.208822 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:07.248814 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b611d-fdbf-4675-a459-f6c37c084b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:07.249449 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b611d-fdbf-4675-a459-f6c37c084b32 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:07.249726 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b611d-fdbf-4675-a459-f6c37c084b32 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:07.250155 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b611d-fdbf-4675-a459-f6c37c084b32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:07.250968 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35b611d-fdbf-4675-a459-f6c37c084b32 None admin] RBAC: Adding query filter params (group.id=8436fda8c1784798ba5d9f700b4d0800, role.id=be23fee6ea264172b277f97af30cc689, scope.project.id=c28fc617d7054dbeb5fd1e39107959fc) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:07.251288 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35b611d-fdbf-4675-a459-f6c37c084b32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:07.252833 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35b611d-fdbf-4675-a459-f6c37c084b32 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:07.261904 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 232/454] 10.222.0.79 () {56 vars in 1376 bytes} [Wed Aug 31 12:16:07 2022] GET /identity/v3/role_assignments?group.id=8436fda8c1784798ba5d9f700b4d0800&scope.project.id=c28fc617d7054dbeb5fd1e39107959fc&role.id=be23fee6ea264172b277f97af30cc689 => generated 611 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:07.382442 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e8001d-b2d4-4cef-a1fc-c7902d8a7811 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:07.442372 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f7cf04-b6bd-4b8c-91d8-238e20e80de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:07.442372 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f7cf04-b6bd-4b8c-91d8-238e20e80de9 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:07.442372 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f7cf04-b6bd-4b8c-91d8-238e20e80de9 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:07.442817 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f7cf04-b6bd-4b8c-91d8-238e20e80de9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:07.443371 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f7cf04-b6bd-4b8c-91d8-238e20e80de9 None admin] RBAC: Adding query filter params (group.id=8436fda8c1784798ba5d9f700b4d0800, role.id=b5cfd7a855a448359e9017f51d32b6fc, scope.project.id=c28fc617d7054dbeb5fd1e39107959fc) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:07.443614 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f7cf04-b6bd-4b8c-91d8-238e20e80de9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:07.445050 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f7cf04-b6bd-4b8c-91d8-238e20e80de9 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:07.453045 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 223/455] 10.222.0.79 () {56 vars in 1376 bytes} [Wed Aug 31 12:16:07 2022] GET /identity/v3/role_assignments?group.id=8436fda8c1784798ba5d9f700b4d0800&scope.project.id=c28fc617d7054dbeb5fd1e39107959fc&role.id=b5cfd7a855a448359e9017f51d32b6fc => generated 611 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:10.283054 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a274b54-5d74-49db-813b-011b66ff581a None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:10.284184 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a274b54-5d74-49db-813b-011b66ff581a None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:10.284696 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a274b54-5d74-49db-813b-011b66ff581a None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:10.286652 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 233/456] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:16:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:16:10.293112 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc2ebee-4939-4a3d-a3a2-9a1f57f81c02 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:10.294071 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc2ebee-4939-4a3d-a3a2-9a1f57f81c02 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:10.294557 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc2ebee-4939-4a3d-a3a2-9a1f57f81c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:10.315699 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-5dc2ebee-4939-4a3d-a3a2-9a1f57f81c02 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:10.317260 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-5dc2ebee-4939-4a3d-a3a2-9a1f57f81c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:10.418929 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:10.425075 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 224/457] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:16:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:16:10.744908 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd73e8c-63cb-440a-a086-7225e43dda8b None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:10.745299 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd73e8c-63cb-440a-a086-7225e43dda8b None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:10.745780 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd73e8c-63cb-440a-a086-7225e43dda8b None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:10.748582 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 234/458] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:16:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:16:10.757624 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d32b32-c705-41d4-bbfa-e583604cc614 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:10.759153 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d32b32-c705-41d4-bbfa-e583604cc614 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:10.760165 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d32b32-c705-41d4-bbfa-e583604cc614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:10.798666 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-e2d32b32-c705-41d4-bbfa-e583604cc614 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:10.801293 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-e2d32b32-c705-41d4-bbfa-e583604cc614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:10.931120 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd73e8c-63cb-440a-a086-7225e43dda8b None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:10.945310 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 225/459] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:16:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:16:11.135183 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd73e8c-63cb-440a-a086-7225e43dda8b None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:11.199921 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af07b572-6936-4761-9e6f-7b6b76f56f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:11.201548 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07b572-6936-4761-9e6f-7b6b76f56f6d None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:11.202322 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07b572-6936-4761-9e6f-7b6b76f56f6d None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:11.203119 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07b572-6936-4761-9e6f-7b6b76f56f6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:11.225226 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af07b572-6936-4761-9e6f-7b6b76f56f6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:11.229277 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af07b572-6936-4761-9e6f-7b6b76f56f6d None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:11.235071 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:11.274032 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-af07b572-6936-4761-9e6f-7b6b76f56f6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:11.274032 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:11.274032 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:11.274032 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:11.274032 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:11.274032 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:11.274032 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:11.274032 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:11.274032 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:11.274032 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:11.274032 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:11.274032 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:11.274032 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:16:11.274032 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:16:11.274032 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:16:11.274032 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:16:11.275894 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:11.275894 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:11.275894 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:11.275894 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:11.275894 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:11.275894 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:11.275894 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:11.275894 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:11.275894 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:11.275894 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:11.275894 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:11.275894 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:11.275894 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:11.275894 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:11.275894 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:11.275894 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:11.275894 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:16:11.277697 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:16:11.277697 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:11.277697 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:16:11.285502 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 235/460] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:16:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:16:11.291822 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d32b32-c705-41d4-bbfa-e583604cc614 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:11.576305 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d32b32-c705-41d4-bbfa-e583604cc614 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:11.656281 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:11.674279 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33386a62-0e71-4b87-a51c-90bcf1566a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:11.675387 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33386a62-0e71-4b87-a51c-90bcf1566a6b None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:11.675808 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33386a62-0e71-4b87-a51c-90bcf1566a6b None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:11.676229 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33386a62-0e71-4b87-a51c-90bcf1566a6b None admin] PATH_INFO: `/v3/domains` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:11.677228 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33386a62-0e71-4b87-a51c-90bcf1566a6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:11.677677 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33386a62-0e71-4b87-a51c-90bcf1566a6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:11.680810 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33386a62-0e71-4b87-a51c-90bcf1566a6b None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:11.704507 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 226/461] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 12:16:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 413 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:11.711813 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af07b572-6936-4761-9e6f-7b6b76f56f6d None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:11.794109 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33386a62-0e71-4b87-a51c-90bcf1566a6b None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:12.033501 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af07b572-6936-4761-9e6f-7b6b76f56f6d None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:12.074278 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33386a62-0e71-4b87-a51c-90bcf1566a6b None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:12.133663 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf26c2-c4b6-493a-9390-02d65f453327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:12.135436 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf26c2-c4b6-493a-9390-02d65f453327 None admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:12.136282 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf26c2-c4b6-493a-9390-02d65f453327 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:12.137157 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf26c2-c4b6-493a-9390-02d65f453327 None admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:12.138880 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecf26c2-c4b6-493a-9390-02d65f453327 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:12.142253 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecf26c2-c4b6-493a-9390-02d65f453327 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:12.152069 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd18a08-95e2-4319-9f41-84fad2eec959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:12.152069 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd18a08-95e2-4319-9f41-84fad2eec959 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:12.152497 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd18a08-95e2-4319-9f41-84fad2eec959 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:12.152640 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd18a08-95e2-4319-9f41-84fad2eec959 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:12.175483 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd18a08-95e2-4319-9f41-84fad2eec959 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:12.177004 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd18a08-95e2-4319-9f41-84fad2eec959 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:12.203442 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 236/462] 10.222.0.79 () {60 vars in 1132 bytes} [Wed Aug 31 12:16:11 2022] POST /identity/v3/users => generated 246 bytes in 487 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:16:12.206561 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eda7c8-72d3-427f-8588-1a1ae574f4fc None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:12.207529 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eda7c8-72d3-427f-8588-1a1ae574f4fc None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:12.208379 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eda7c8-72d3-427f-8588-1a1ae574f4fc None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:12.217426 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-ecd18a08-95e2-4319-9f41-84fad2eec959 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:12.217426 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:12.217426 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:12.217426 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:12.217426 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:12.217426 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:12.217426 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:12.217426 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:12.217426 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:12.217426 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:12.217426 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:12.217426 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:12.217426 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:16:12.217426 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:16:12.217426 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:16:12.217426 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:16:12.219258 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:12.219258 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:12.219258 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:12.219258 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:12.219258 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:12.219258 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:12.219258 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:12.219258 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:12.219258 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:12.219258 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:12.219258 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:12.219258 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:12.219258 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:12.219258 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:12.219258 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:12.219258 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:12.219258 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:16:12.221672 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:16:12.221672 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:12.221672 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:16:12.221672 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 227/463] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:16:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 424 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:12.224330 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 237/464] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:16:12 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:16:12.227308 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b8f5e-35f7-4bf9-af36-9a91a2b89bad None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:12.229000 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b8f5e-35f7-4bf9-af36-9a91a2b89bad None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:12.229325 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eda7c8-72d3-427f-8588-1a1ae574f4fc None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:12.235804 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b8f5e-35f7-4bf9-af36-9a91a2b89bad None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:12.241569 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 228/465] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:16:12 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:16:12.244719 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f889542a-eb2a-4a84-a1ab-238406a68f69 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:12.245658 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f889542a-eb2a-4a84-a1ab-238406a68f69 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:12.246420 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f889542a-eb2a-4a84-a1ab-238406a68f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:12.288148 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-f889542a-eb2a-4a84-a1ab-238406a68f69 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:12.291443 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-f889542a-eb2a-4a84-a1ab-238406a68f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:12.384203 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:12.393540 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:12.462627 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 229/466] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:16:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:16:12.466076 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc8f2b-9a71-41b9-af96-15530d2e8ae9 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:12.466532 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc8f2b-9a71-41b9-af96-15530d2e8ae9 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:12.467057 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc8f2b-9a71-41b9-af96-15530d2e8ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:12.476151 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eda7c8-72d3-427f-8588-1a1ae574f4fc None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:12.510178 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-96fc8f2b-9a71-41b9-af96-15530d2e8ae9 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:12.511714 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-96fc8f2b-9a71-41b9-af96-15530d2e8ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:12.532027 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e51214-6446-4f3b-80b4-4aa74e5f9a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:12.532992 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e51214-6446-4f3b-80b4-4aa74e5f9a66 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:12.533487 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e51214-6446-4f3b-80b4-4aa74e5f9a66 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:12.533966 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e51214-6446-4f3b-80b4-4aa74e5f9a66 None admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:12.535169 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e51214-6446-4f3b-80b4-4aa74e5f9a66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:12.535701 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e51214-6446-4f3b-80b4-4aa74e5f9a66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:12.538325 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e51214-6446-4f3b-80b4-4aa74e5f9a66 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:12.562252 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 238/467] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 12:16:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:12.571093 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e51214-6446-4f3b-80b4-4aa74e5f9a66 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:12.630891 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 230/468] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:16:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:16:12.749735 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e51214-6446-4f3b-80b4-4aa74e5f9a66 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:12.776605 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:12.832148 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee8dac0-0849-4431-8f9e-0f8b3d64f452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:12.832948 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee8dac0-0849-4431-8f9e-0f8b3d64f452 None admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:12.833354 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee8dac0-0849-4431-8f9e-0f8b3d64f452 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:12.833758 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee8dac0-0849-4431-8f9e-0f8b3d64f452 None admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:12.834759 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee8dac0-0849-4431-8f9e-0f8b3d64f452 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:12.838590 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee8dac0-0849-4431-8f9e-0f8b3d64f452 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:12.872472 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 239/469] 10.222.0.79 () {60 vars in 1132 bytes} [Wed Aug 31 12:16:12 2022] POST /identity/v3/users => generated 248 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:16:12.931002 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f6be3-2c48-4b9f-9f6b-72b1bda5e5b0 None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:12.931499 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f6be3-2c48-4b9f-9f6b-72b1bda5e5b0 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:12.931971 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f6be3-2c48-4b9f-9f6b-72b1bda5e5b0 None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:12.934904 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 231/470] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:16:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:16:12.946288 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fcf804-ebf9-46a0-8dcc-5702e2fd1705 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:12.947008 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fcf804-ebf9-46a0-8dcc-5702e2fd1705 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:12.947499 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fcf804-ebf9-46a0-8dcc-5702e2fd1705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:12.964762 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83f6be3-2c48-4b9f-9f6b-72b1bda5e5b0 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:12.995569 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-e9fcf804-ebf9-46a0-8dcc-5702e2fd1705 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:12.997372 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-e9fcf804-ebf9-46a0-8dcc-5702e2fd1705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:13.097173 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:13.104187 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83f6be3-2c48-4b9f-9f6b-72b1bda5e5b0 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:13.104386 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 240/471] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:16:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:16:13.105073 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fcf804-ebf9-46a0-8dcc-5702e2fd1705 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:13.170948 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f72d6a-f2f2-474f-b391-f7808a750e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:13.171606 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f72d6a-f2f2-474f-b391-f7808a750e2d None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:13.171882 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f72d6a-f2f2-474f-b391-f7808a750e2d None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:13.172149 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f72d6a-f2f2-474f-b391-f7808a750e2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:13.185848 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f72d6a-f2f2-474f-b391-f7808a750e2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:13.187535 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f72d6a-f2f2-474f-b391-f7808a750e2d None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:13.205231 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-77f72d6a-f2f2-474f-b391-f7808a750e2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:13.205231 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:13.205231 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:13.205231 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:13.205231 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:13.205231 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:13.205231 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:13.205231 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:13.205231 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:13.205231 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:13.205231 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:13.205231 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:13.205231 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:16:13.205231 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:16:13.205231 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:16:13.205231 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:16:13.206241 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:13.206241 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:13.206241 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:13.206241 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:13.206241 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:13.206241 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:13.206241 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:13.206241 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:13.206241 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:13.206241 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:13.206241 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:13.206241 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:13.206241 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:13.206241 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:13.206241 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:13.206241 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:13.206241 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:16:13.207145 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:16:13.207145 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:13.207145 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:16:13.207145 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 232/472] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:16:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:13.213517 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f72d6a-f2f2-474f-b391-f7808a750e2d None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:13.238350 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:13.252854 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fcf804-ebf9-46a0-8dcc-5702e2fd1705 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:13.328743 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a4edb4-01e3-4371-b072-f14144267272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:13.329389 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a4edb4-01e3-4371-b072-f14144267272 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:13.329665 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a4edb4-01e3-4371-b072-f14144267272 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:13.329933 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a4edb4-01e3-4371-b072-f14144267272 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:13.354917 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a4edb4-01e3-4371-b072-f14144267272 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:13.356385 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a4edb4-01e3-4371-b072-f14144267272 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:13.385572 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-13a4edb4-01e3-4371-b072-f14144267272 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:13.385572 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:13.385572 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:13.385572 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:13.385572 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:13.385572 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:13.385572 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:13.385572 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:13.385572 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:13.385572 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:13.385572 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:13.385572 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:13.385572 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:16:13.385572 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:16:13.385572 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:16:13.385572 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:16:13.387031 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:13.387031 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:13.387031 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:13.387031 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:13.387031 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:13.387031 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:13.387031 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:13.387031 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:13.387031 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:13.387031 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:13.387031 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:13.387031 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:13.387031 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:13.387031 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:13.387031 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:13.387031 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:13.387031 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:16:13.387909 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:16:13.387909 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:13.387909 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:16:13.396898 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 241/473] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:16:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:13.405574 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a4edb4-01e3-4371-b072-f14144267272 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:13.428464 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f72d6a-f2f2-474f-b391-f7808a750e2d None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:13.491849 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a590a51-a741-4fad-a073-7b64efd2d9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:13.493333 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a590a51-a741-4fad-a073-7b64efd2d9bc None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:13.493787 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a590a51-a741-4fad-a073-7b64efd2d9bc None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:13.494119 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a590a51-a741-4fad-a073-7b64efd2d9bc None admin] PATH_INFO: `/v3/domains` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:13.494994 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a590a51-a741-4fad-a073-7b64efd2d9bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:13.495305 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a590a51-a741-4fad-a073-7b64efd2d9bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:13.497158 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a590a51-a741-4fad-a073-7b64efd2d9bc None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:13.518816 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 233/474] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 12:16:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:16:13.519992 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a590a51-a741-4fad-a073-7b64efd2d9bc None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:13.541870 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:13.570353 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a4edb4-01e3-4371-b072-f14144267272 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:13.618887 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eb81eb-bfae-4947-bf63-1811270ff925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:13.619926 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb81eb-bfae-4947-bf63-1811270ff925 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:13.620205 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb81eb-bfae-4947-bf63-1811270ff925 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:13.620560 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb81eb-bfae-4947-bf63-1811270ff925 None admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:13.621543 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eb81eb-bfae-4947-bf63-1811270ff925 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:13.622887 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eb81eb-bfae-4947-bf63-1811270ff925 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:13.624755 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eb81eb-bfae-4947-bf63-1811270ff925 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:13.642341 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 242/475] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 12:16:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:16:13.643234 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eb81eb-bfae-4947-bf63-1811270ff925 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:13.655009 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:13.671201 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a590a51-a741-4fad-a073-7b64efd2d9bc None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:13.709634 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396d97ff-6741-4da2-9197-6a402fb3d260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:13.710309 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396d97ff-6741-4da2-9197-6a402fb3d260 None admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:13.710590 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396d97ff-6741-4da2-9197-6a402fb3d260 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:13.711307 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396d97ff-6741-4da2-9197-6a402fb3d260 None admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:13.711996 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396d97ff-6741-4da2-9197-6a402fb3d260 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:13.713399 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396d97ff-6741-4da2-9197-6a402fb3d260 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:13.721819 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.sql.core [None req-396d97ff-6741-4da2-9197-6a402fb3d260 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 31 12:16:13.721819 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 31 12:16:13.721819 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [parameters: {'id': '1e698cb5b3a34613a5891db8e06a0f5b', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 31 12:16:13.721819 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81495) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 31 12:16:13.742155 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-396d97ff-6741-4da2-9197-6a402fb3d260 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 31 12:16:13.742155 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:13.742155 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 12:16:13.742155 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 12:16:13.742155 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 12:16:13.742155 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 12:16:13.742155 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 12:16:13.742155 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 12:16:13.742155 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 12:16:13.742155 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application conn.query(q) Aug 31 12:16:13.742155 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 12:16:13.742155 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 12:16:13.742155 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 12:16:13.742155 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application result.read() Aug 31 12:16:13.742155 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 12:16:13.744784 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 12:16:13.744784 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 12:16:13.744784 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 12:16:13.744784 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 12:16:13.744784 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 12:16:13.744784 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 12:16:13.744784 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 12:16:13.744784 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 31 12:16:13.744784 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:16:13.744784 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 31 12:16:13.744784 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:16:13.744784 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:13.744784 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 31 12:16:13.744784 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 31 12:16:13.744784 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 31 12:16:13.744784 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return ref.to_dict() Aug 31 12:16:13.744784 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 12:16:13.744784 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application next(self.gen) Aug 31 12:16:13.747024 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 31 12:16:13.747024 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application yield resource Aug 31 12:16:13.747024 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 12:16:13.747024 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application next(self.gen) Aug 31 12:16:13.747024 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 31 12:16:13.747024 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application self.session.rollback() Aug 31 12:16:13.747024 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 12:16:13.747024 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application self.force_reraise() Aug 31 12:16:13.747024 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 12:16:13.747024 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise self.value Aug 31 12:16:13.747024 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 31 12:16:13.747024 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 31 12:16:13.747024 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 31 12:16:13.747024 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application session.commit() Aug 31 12:16:13.747024 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 31 12:16:13.747024 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 31 12:16:13.747024 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 31 12:16:13.749127 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application self._prepare_impl() Aug 31 12:16:13.749127 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 31 12:16:13.749127 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application self.session.flush() Aug 31 12:16:13.749127 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 31 12:16:13.749127 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application self._flush(objects) Aug 31 12:16:13.749127 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 31 12:16:13.749127 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 31 12:16:13.749127 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 31 12:16:13.749127 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application compat.raise_( Aug 31 12:16:13.749127 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 12:16:13.749127 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception Aug 31 12:16:13.749127 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 31 12:16:13.749127 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application flush_context.execute() Aug 31 12:16:13.749127 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 31 12:16:13.749127 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rec.execute(self) Aug 31 12:16:13.749127 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 31 12:16:13.749127 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 31 12:16:13.760233 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 31 12:16:13.760233 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 31 12:16:13.760233 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 31 12:16:13.760233 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 31 12:16:13.760233 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 31 12:16:13.760233 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 31 12:16:13.760233 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 31 12:16:13.760233 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 31 12:16:13.760233 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 31 12:16:13.760233 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 31 12:16:13.760233 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 31 12:16:13.760233 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 31 12:16:13.760233 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 31 12:16:13.760233 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 31 12:16:13.760233 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 12:16:13.760233 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception Aug 31 12:16:13.762197 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 12:16:13.762197 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 12:16:13.762197 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 12:16:13.762197 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 12:16:13.762197 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 12:16:13.762197 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 12:16:13.762197 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 12:16:13.762197 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application conn.query(q) Aug 31 12:16:13.762197 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 12:16:13.762197 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 12:16:13.762197 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 12:16:13.762197 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application result.read() Aug 31 12:16:13.762197 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 12:16:13.762197 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 12:16:13.762197 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 12:16:13.762197 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 12:16:13.764858 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 12:16:13.764858 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 12:16:13.764858 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 12:16:13.764858 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 12:16:13.764858 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 31 12:16:13.764858 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 31 12:16:13.764858 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [parameters: {'id': '1e698cb5b3a34613a5891db8e06a0f5b', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 31 12:16:13.764858 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 31 12:16:13.764858 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:16:13.764858 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:16:13.764858 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:16:13.764858 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:13.764858 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:13.764858 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:13.764858 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:13.764858 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:13.769216 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:13.769216 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:13.769216 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:13.769216 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:13.769216 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:13.769216 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:13.769216 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 31 12:16:13.769216 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 31 12:16:13.769216 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:13.769216 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:13.769216 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 31 12:16:13.769216 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 31 12:16:13.769216 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 31 12:16:13.769216 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 31 12:16:13.769216 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 31 12:16:13.769216 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:16:13.772583 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 234/476] 10.222.0.79 () {60 vars in 1131 bytes} [Wed Aug 31 12:16:13 2022] POST /identity/v3/roles => generated 144 bytes in 225 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:13.772583 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396d97ff-6741-4da2-9197-6a402fb3d260 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:13.787492 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eb81eb-bfae-4947-bf63-1811270ff925 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:13.830379 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd72a93-38a5-44d1-9589-f5b5e6868ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:13.831446 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd72a93-38a5-44d1-9589-f5b5e6868ef4 None admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:13.831929 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd72a93-38a5-44d1-9589-f5b5e6868ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:13.832418 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd72a93-38a5-44d1-9589-f5b5e6868ef4 None admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:13.833276 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd72a93-38a5-44d1-9589-f5b5e6868ef4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:13.835003 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd72a93-38a5-44d1-9589-f5b5e6868ef4 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:13.844095 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:13.868456 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 243/477] 10.222.0.79 () {60 vars in 1132 bytes} [Wed Aug 31 12:16:13 2022] POST /identity/v3/users => generated 248 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:16:13.869963 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd72a93-38a5-44d1-9589-f5b5e6868ef4 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:13.891483 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396d97ff-6741-4da2-9197-6a402fb3d260 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:13.957628 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:13.973708 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1d0566-5ae7-4b1a-98e6-4032af090590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:13.974798 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d0566-5ae7-4b1a-98e6-4032af090590 None admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:13.975439 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d0566-5ae7-4b1a-98e6-4032af090590 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:13.975935 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d0566-5ae7-4b1a-98e6-4032af090590 None admin] PATH_INFO: `/v3/users` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:13.977200 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1d0566-5ae7-4b1a-98e6-4032af090590 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:13.980630 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1d0566-5ae7-4b1a-98e6-4032af090590 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:14.010601 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd72a93-38a5-44d1-9589-f5b5e6868ef4 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:14.017145 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 235/478] 10.222.0.79 () {60 vars in 1132 bytes} [Wed Aug 31 12:16:13 2022] POST /identity/v3/users => generated 249 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:16:14.079951 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2d215c-c116-461d-9c9d-fa5d7270e9f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:14.081061 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d215c-c116-461d-9c9d-fa5d7270e9f6 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:14.081606 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d215c-c116-461d-9c9d-fa5d7270e9f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:14.082093 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d215c-c116-461d-9c9d-fa5d7270e9f6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:14.100873 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2d215c-c116-461d-9c9d-fa5d7270e9f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:16:14.108598 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-eb2d215c-c116-461d-9c9d-fa5d7270e9f6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 12:16:14.108598 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:14.108598 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:14.108598 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:14.108598 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:14.108598 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:14.108598 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:14.108598 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:14.108598 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:14.108598 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:14.108598 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:14.108598 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:14.108598 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:16:14.108598 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:16:14.108598 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:16:14.108598 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:16:14.109670 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:16:14.109670 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:16:14.109670 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:16:14.109670 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:16:14.109670 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:14.109670 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:14.109670 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:14.109670 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:14.109670 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:14.109670 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:14.109670 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:14.109670 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:14.109670 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:14.109670 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:14.109670 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:14.109670 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:14.111120 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:14.111120 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:14.111120 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:14.111120 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:14.111120 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:16:14.111120 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:16:14.111120 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:16:14.111120 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:16:14.111120 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:16:14.111120 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:16:14.111120 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 12:16:14.111120 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:16:14.114624 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 244/479] 10.222.0.79 () {56 vars in 1114 bytes} [Wed Aug 31 12:16:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:14.122022 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1d0566-5ae7-4b1a-98e6-4032af090590 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:14.251718 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1d0566-5ae7-4b1a-98e6-4032af090590 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:14.292109 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:14.298789 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332632b0-4916-497d-8339-b854d57e1bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:14.299941 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332632b0-4916-497d-8339-b854d57e1bc6 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:14.300946 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332632b0-4916-497d-8339-b854d57e1bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:14.301221 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332632b0-4916-497d-8339-b854d57e1bc6 None admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:14.301959 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332632b0-4916-497d-8339-b854d57e1bc6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:14.302639 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332632b0-4916-497d-8339-b854d57e1bc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:14.304340 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332632b0-4916-497d-8339-b854d57e1bc6 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:14.315377 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 236/480] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 12:16:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:15.164944 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2015f72-6d70-4b61-a817-8ba1a5770cdd None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:15.166288 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2015f72-6d70-4b61-a817-8ba1a5770cdd None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:15.166782 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2015f72-6d70-4b61-a817-8ba1a5770cdd None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:15.168805 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 245/481] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:16:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:16:15.174732 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4573cae8-79b7-4a8d-9260-248d9a4d2e00 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:15.175677 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4573cae8-79b7-4a8d-9260-248d9a4d2e00 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:15.176225 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4573cae8-79b7-4a8d-9260-248d9a4d2e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:15.197083 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-4573cae8-79b7-4a8d-9260-248d9a4d2e00 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:15.198758 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-4573cae8-79b7-4a8d-9260-248d9a4d2e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:15.208929 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e8a26-fe2c-485e-b795-da20c2e6db20 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:15.209241 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e8a26-fe2c-485e-b795-da20c2e6db20 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:15.209486 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e8a26-fe2c-485e-b795-da20c2e6db20 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:15.211698 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 246/482] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:16:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:16:15.229995 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d814067-e06d-4cc8-a669-f6f2bb73d902 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:15.230548 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d814067-e06d-4cc8-a669-f6f2bb73d902 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:15.230797 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d814067-e06d-4cc8-a669-f6f2bb73d902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:15.272619 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-2d814067-e06d-4cc8-a669-f6f2bb73d902 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:15.278286 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-2d814067-e06d-4cc8-a669-f6f2bb73d902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:15.345575 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 237/483] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:16:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:16:15.430112 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 247/484] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:16:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:16:15.652412 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4573cae8-79b7-4a8d-9260-248d9a4d2e00 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:15.792629 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4573cae8-79b7-4a8d-9260-248d9a4d2e00 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:15.829737 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:15.861729 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37a4b28-0746-4a84-a75c-811114d96776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:15.862875 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37a4b28-0746-4a84-a75c-811114d96776 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:15.863392 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37a4b28-0746-4a84-a75c-811114d96776 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:15.863864 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37a4b28-0746-4a84-a75c-811114d96776 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:15.892512 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37a4b28-0746-4a84-a75c-811114d96776 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:16:15.902734 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-c37a4b28-0746-4a84-a75c-811114d96776 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:16:15.902734 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:15.902734 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:15.902734 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:15.902734 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:15.902734 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:15.902734 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:15.902734 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:15.902734 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:15.902734 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:15.902734 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:15.902734 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:15.902734 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:16:15.902734 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:16:15.902734 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:16:15.902734 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:16:15.904503 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:16:15.904503 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:16:15.904503 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:16:15.904503 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:16:15.904503 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:15.904503 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:15.904503 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:15.904503 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:15.904503 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:15.904503 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:15.904503 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:15.904503 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:15.904503 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:15.904503 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:15.904503 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:15.904503 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:15.906109 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:15.906109 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:15.906109 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:15.906109 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:15.906109 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:16:15.906109 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:16:15.906109 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:16:15.906109 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:16:15.906109 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:16:15.906109 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:16:15.906109 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:16:15.906109 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:16:15.906109 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 238/485] 10.222.0.79 () {56 vars in 1102 bytes} [Wed Aug 31 12:16:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:15.915505 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d814067-e06d-4cc8-a669-f6f2bb73d902 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:16.021146 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37a4b28-0746-4a84-a75c-811114d96776 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:16.071364 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:16.197712 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d814067-e06d-4cc8-a669-f6f2bb73d902 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:16.225934 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37a4b28-0746-4a84-a75c-811114d96776 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:16.274490 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9052a9-551d-4427-8ff8-c1293675dee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:16.275286 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9052a9-551d-4427-8ff8-c1293675dee4 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:16.275573 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9052a9-551d-4427-8ff8-c1293675dee4 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:16.275966 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9052a9-551d-4427-8ff8-c1293675dee4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:16.290174 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9052a9-551d-4427-8ff8-c1293675dee4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:16:16.291657 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65082e10-8d7b-40c4-b8f5-5b9f357512fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:16.292342 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65082e10-8d7b-40c4-b8f5-5b9f357512fc None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:16.292585 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65082e10-8d7b-40c4-b8f5-5b9f357512fc None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:16.292845 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65082e10-8d7b-40c4-b8f5-5b9f357512fc None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:16.293537 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65082e10-8d7b-40c4-b8f5-5b9f357512fc None admin] RBAC: Adding query filter params (name=service) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:16.293835 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65082e10-8d7b-40c4-b8f5-5b9f357512fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:16.295253 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65082e10-8d7b-40c4-b8f5-5b9f357512fc None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:16.295667 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-ed9052a9-551d-4427-8ff8-c1293675dee4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:16:16.295667 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:16.295667 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:16.295667 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:16.295667 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:16.295667 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:16.295667 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:16.295667 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:16.295667 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:16.295667 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:16.295667 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:16.295667 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:16.295667 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:16:16.295667 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:16:16.295667 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:16:16.295667 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:16:16.297369 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:16:16.297369 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:16:16.297369 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:16:16.297369 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:16:16.297369 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:16.297369 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:16.297369 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:16.297369 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:16.297369 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:16.297369 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:16.297369 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:16.297369 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:16.297369 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:16.297369 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:16.297369 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:16.297369 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:16.299801 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:16.299801 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:16.299801 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:16.299801 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:16.299801 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:16:16.299801 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:16:16.299801 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:16:16.299801 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:16:16.299801 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:16:16.299801 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:16:16.299801 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:16:16.299801 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:16:16.299801 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 239/486] 10.222.0.79 () {56 vars in 1102 bytes} [Wed Aug 31 12:16:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:16.306990 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9052a9-551d-4427-8ff8-c1293675dee4 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:16.321935 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 248/487] 10.222.0.79 () {56 vars in 1103 bytes} [Wed Aug 31 12:16:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 408 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:16.329379 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65082e10-8d7b-40c4-b8f5-5b9f357512fc None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:16.403187 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:16.459258 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9052a9-551d-4427-8ff8-c1293675dee4 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:16.515259 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa37a20e-9d59-4706-a386-c369ebd398c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:16.515896 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37a20e-9d59-4706-a386-c369ebd398c4 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:16.516177 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37a20e-9d59-4706-a386-c369ebd398c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:16.516497 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37a20e-9d59-4706-a386-c369ebd398c4 None admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:16.517276 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa37a20e-9d59-4706-a386-c369ebd398c4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:16.517581 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa37a20e-9d59-4706-a386-c369ebd398c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:16.519322 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa37a20e-9d59-4706-a386-c369ebd398c4 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:16.531428 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 240/488] 10.222.0.79 () {56 vars in 1103 bytes} [Wed Aug 31 12:16:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:16.537316 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa37a20e-9d59-4706-a386-c369ebd398c4 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:16.621274 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65082e10-8d7b-40c4-b8f5-5b9f357512fc None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:16.663415 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:16.700892 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b102ee-fa8d-4ada-981f-88ccedffa5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:16.701550 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b102ee-fa8d-4ada-981f-88ccedffa5d8 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:16.701829 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b102ee-fa8d-4ada-981f-88ccedffa5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:16.702097 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b102ee-fa8d-4ada-981f-88ccedffa5d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:16.724728 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa37a20e-9d59-4706-a386-c369ebd398c4 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:16.725666 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b102ee-fa8d-4ada-981f-88ccedffa5d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:16.727925 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b102ee-fa8d-4ada-981f-88ccedffa5d8 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:16.735588 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:16.759994 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-28b102ee-fa8d-4ada-981f-88ccedffa5d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:16.759994 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:16.759994 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:16.759994 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:16.759994 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:16.759994 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:16.759994 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:16.759994 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:16.759994 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:16.759994 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:16.759994 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:16.759994 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:16.759994 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:16:16.759994 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:16:16.759994 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:16:16.759994 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:16:16.760979 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:16.760979 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:16.760979 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:16.760979 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:16.760979 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:16.760979 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:16.760979 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:16.760979 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:16.760979 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:16.760979 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:16.760979 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:16.760979 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:16.760979 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:16.760979 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:16.760979 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:16.760979 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:16.760979 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:16:16.761857 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:16:16.761857 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:16.761857 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:16:16.761857 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 249/489] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:16:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 432 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:16.777565 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b102ee-fa8d-4ada-981f-88ccedffa5d8 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:16.789207 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0633690c-500e-4878-9f45-56c2692413df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:16.790649 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0633690c-500e-4878-9f45-56c2692413df None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:16.791220 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0633690c-500e-4878-9f45-56c2692413df None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:16.791700 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0633690c-500e-4878-9f45-56c2692413df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:16.806218 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0633690c-500e-4878-9f45-56c2692413df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:16.807798 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0633690c-500e-4878-9f45-56c2692413df None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:16.832182 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-0633690c-500e-4878-9f45-56c2692413df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:16.832182 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:16.832182 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:16.832182 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:16.832182 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:16.832182 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:16.832182 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:16.832182 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:16.832182 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:16.832182 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:16.832182 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:16.832182 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:16.832182 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:16:16.832182 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:16:16.832182 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:16:16.832182 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:16:16.834331 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:16.834331 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:16.834331 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:16.834331 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:16.834331 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:16.834331 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:16.834331 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:16.834331 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:16.834331 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:16.834331 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:16.834331 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:16.834331 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:16.834331 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:16.834331 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:16.834331 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:16.834331 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:16.834331 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:16:16.837989 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:16:16.837989 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:16.837989 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:16:16.842895 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 241/490] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:16:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:16.845020 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0633690c-500e-4878-9f45-56c2692413df None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:17.000237 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b102ee-fa8d-4ada-981f-88ccedffa5d8 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:17.016355 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0633690c-500e-4878-9f45-56c2692413df None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:17.056660 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdd0b62-f6cf-4d56-bbb3-78e8140206ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:17.057139 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a0f3c2-cb4c-467a-b1a1-6dc642fbe3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:17.058039 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd0b62-f6cf-4d56-bbb3-78e8140206ab None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:17.058177 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0f3c2-cb4c-467a-b1a1-6dc642fbe3b8 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:17.058177 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0f3c2-cb4c-467a-b1a1-6dc642fbe3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:17.058332 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd0b62-f6cf-4d56-bbb3-78e8140206ab None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:17.058405 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0f3c2-cb4c-467a-b1a1-6dc642fbe3b8 None admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:17.058680 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd0b62-f6cf-4d56-bbb3-78e8140206ab None admin] PATH_INFO: `/v3/domains` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:17.058976 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a0f3c2-cb4c-467a-b1a1-6dc642fbe3b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:17.059278 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a0f3c2-cb4c-467a-b1a1-6dc642fbe3b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:17.059921 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdd0b62-f6cf-4d56-bbb3-78e8140206ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:17.060480 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdd0b62-f6cf-4d56-bbb3-78e8140206ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:17.060658 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a0f3c2-cb4c-467a-b1a1-6dc642fbe3b8 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:17.064004 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdd0b62-f6cf-4d56-bbb3-78e8140206ab None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:17.081333 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 250/491] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 12:16:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:16:17.081333 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c448914-22d5-479f-9770-9b205336215f None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:17.081333 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c448914-22d5-479f-9770-9b205336215f None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:17.081333 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c448914-22d5-479f-9770-9b205336215f None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:17.081333 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 251/492] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:16:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:16:17.081333 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db0a8dc-e5fc-4746-8738-0a30e0ab6c5b None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:17.081333 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db0a8dc-e5fc-4746-8738-0a30e0ab6c5b None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:17.081887 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db0a8dc-e5fc-4746-8738-0a30e0ab6c5b None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:17.081887 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 252/493] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:16:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:16:17.087563 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db0a8dc-e5fc-4746-8738-0a30e0ab6c5b None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:17.096835 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 242/494] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 12:16:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:17.098206 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35234ed2-ad20-4b2a-bd07-d95897a2bce7 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:17.098578 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35234ed2-ad20-4b2a-bd07-d95897a2bce7 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:17.098881 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35234ed2-ad20-4b2a-bd07-d95897a2bce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:17.119066 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-35234ed2-ad20-4b2a-bd07-d95897a2bce7 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:17.120562 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-35234ed2-ad20-4b2a-bd07-d95897a2bce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:17.140425 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:17.146706 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:17.212440 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 243/495] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:16:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:16:17.213711 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd3412-77e2-48ef-bbfc-a3da148de4b1 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:17.213996 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd3412-77e2-48ef-bbfc-a3da148de4b1 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:17.214263 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd3412-77e2-48ef-bbfc-a3da148de4b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:17.233644 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-5bcd3412-77e2-48ef-bbfc-a3da148de4b1 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:17.234843 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-5bcd3412-77e2-48ef-bbfc-a3da148de4b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:17.241242 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db0a8dc-e5fc-4746-8738-0a30e0ab6c5b None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:17.288304 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0583d03b-e48d-476e-87f0-02d5ca56ea81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:17.289478 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0583d03b-e48d-476e-87f0-02d5ca56ea81 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:17.289750 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0583d03b-e48d-476e-87f0-02d5ca56ea81 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:17.290141 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0583d03b-e48d-476e-87f0-02d5ca56ea81 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:17.302372 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0583d03b-e48d-476e-87f0-02d5ca56ea81 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:17.303759 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0583d03b-e48d-476e-87f0-02d5ca56ea81 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:17.321144 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-0583d03b-e48d-476e-87f0-02d5ca56ea81 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 12:16:17.321144 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:17.321144 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:17.321144 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:17.321144 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:17.321144 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:17.321144 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:17.321144 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:17.321144 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:17.321144 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:17.321144 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:17.321144 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:17.321144 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:16:17.321144 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:16:17.321144 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:16:17.321144 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:16:17.322358 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:17.322358 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:17.322358 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:16:17.322358 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:16:17.322358 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:16:17.322358 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:16:17.322358 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:17.322358 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:17.322358 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:17.322358 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:17.322358 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:17.322358 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:17.322358 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:17.322358 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:17.322358 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:17.322358 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:17.322358 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:17.322358 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:17.323804 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:17.323804 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:17.323804 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:16:17.323804 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:16:17.323804 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:16:17.323804 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:16:17.323804 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:16:17.323804 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:16:17.323804 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 12:16:17.323804 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:16:17.323804 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 253/496] 10.222.0.79 () {56 vars in 1093 bytes} [Wed Aug 31 12:16:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:17.323804 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0583d03b-e48d-476e-87f0-02d5ca56ea81 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:17.329072 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 244/497] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:16:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:16:17.330094 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb0217-4a5e-4bef-a65f-de498e46d714 None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:17.330392 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb0217-4a5e-4bef-a65f-de498e46d714 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:17.330672 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb0217-4a5e-4bef-a65f-de498e46d714 None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:17.332126 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 245/498] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:16:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:16:17.332784 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdb0217-4a5e-4bef-a65f-de498e46d714 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:17.466901 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:17.472240 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:17.489700 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0583d03b-e48d-476e-87f0-02d5ca56ea81 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:17.495438 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdb0217-4a5e-4bef-a65f-de498e46d714 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:17.535451 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92890c93-e2df-4c4b-a397-0d2c5a0b89b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:17.535451 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92890c93-e2df-4c4b-a397-0d2c5a0b89b9 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:17.535778 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92890c93-e2df-4c4b-a397-0d2c5a0b89b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:17.536069 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92890c93-e2df-4c4b-a397-0d2c5a0b89b9 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:17.538278 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ef1b44-cf1d-4ae5-b26c-90e7bee9cab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:17.539664 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef1b44-cf1d-4ae5-b26c-90e7bee9cab8 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:17.540062 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef1b44-cf1d-4ae5-b26c-90e7bee9cab8 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:17.540513 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef1b44-cf1d-4ae5-b26c-90e7bee9cab8 None admin] PATH_INFO: `/v3/users` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:17.541453 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ef1b44-cf1d-4ae5-b26c-90e7bee9cab8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:17.541902 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ef1b44-cf1d-4ae5-b26c-90e7bee9cab8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:17.543456 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ef1b44-cf1d-4ae5-b26c-90e7bee9cab8 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:17.548545 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92890c93-e2df-4c4b-a397-0d2c5a0b89b9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:17.551642 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92890c93-e2df-4c4b-a397-0d2c5a0b89b9 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:17.569445 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-92890c93-e2df-4c4b-a397-0d2c5a0b89b9 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 31 12:16:17.569445 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:17.569445 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:17.569445 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:17.569445 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:17.569445 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:17.569445 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:17.569445 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:17.569445 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:17.569445 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:17.569445 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:17.569445 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:17.569445 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:16:17.569445 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:16:17.569445 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:16:17.569445 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:16:17.570480 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:17.570480 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:17.570480 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:16:17.570480 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:16:17.570480 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:16:17.570480 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:16:17.570480 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:17.570480 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:17.570480 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:17.570480 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:17.570480 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:17.570480 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:17.570480 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:17.570480 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:17.570480 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:17.570480 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:17.570480 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:17.570480 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:17.577176 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:17.577176 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:17.577176 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:16:17.577176 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:16:17.577176 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:16:17.577176 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:16:17.577176 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:16:17.577176 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:16:17.577176 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 31 12:16:17.577176 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:16:17.577176 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 254/499] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 12:16:17 2022] GET /identity/v3/users/glance => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:17.577176 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b72e6-a9a4-4903-bb88-49951b14b2da None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:17.577176 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b72e6-a9a4-4903-bb88-49951b14b2da None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:17.578340 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b72e6-a9a4-4903-bb88-49951b14b2da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:17.600923 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 246/500] 10.222.0.79 () {56 vars in 1133 bytes} [Wed Aug 31 12:16:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:17.600923 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ef1b44-cf1d-4ae5-b26c-90e7bee9cab8 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:17.603551 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-ab4b72e6-a9a4-4903-bb88-49951b14b2da None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:17.604962 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-ab4b72e6-a9a4-4903-bb88-49951b14b2da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:17.686053 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 255/501] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:16:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:16:17.687252 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4b72e6-a9a4-4903-bb88-49951b14b2da None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:17.732302 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ef1b44-cf1d-4ae5-b26c-90e7bee9cab8 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:17.774705 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:17.775413 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f82dad-7d96-4f1a-858c-0e20ae1b0a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:17.776064 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f82dad-7d96-4f1a-858c-0e20ae1b0a3a None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:17.776340 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f82dad-7d96-4f1a-858c-0e20ae1b0a3a None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:17.776717 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f82dad-7d96-4f1a-858c-0e20ae1b0a3a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:17.780231 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:17.791890 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f82dad-7d96-4f1a-858c-0e20ae1b0a3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:16:17.797706 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-79f82dad-7d96-4f1a-858c-0e20ae1b0a3a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:16:17.797706 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:17.797706 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:17.797706 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:17.797706 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:17.797706 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:17.797706 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:17.797706 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:17.797706 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:17.797706 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:17.797706 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:17.797706 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:17.797706 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:16:17.797706 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:16:17.797706 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:16:17.797706 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:16:17.798763 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:16:17.798763 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:16:17.798763 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:16:17.798763 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:16:17.798763 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:17.798763 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:17.798763 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:17.798763 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:17.798763 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:17.798763 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:17.798763 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:17.798763 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:17.798763 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:17.798763 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:17.798763 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:17.798763 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:17.799779 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:17.799779 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:17.799779 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:17.799779 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:17.799779 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:16:17.799779 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:16:17.799779 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:16:17.799779 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:16:17.799779 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:16:17.799779 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:16:17.799779 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:16:17.799779 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:16:17.799779 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 247/502] 10.222.0.79 () {56 vars in 1102 bytes} [Wed Aug 31 12:16:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:17.800583 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f82dad-7d96-4f1a-858c-0e20ae1b0a3a None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:17.805235 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4b72e6-a9a4-4903-bb88-49951b14b2da None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:17.849487 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc6c35-0fa0-41c3-acf6-90f9f7e25ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:17.850657 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc6c35-0fa0-41c3-acf6-90f9f7e25ed8 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:17.851168 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc6c35-0fa0-41c3-acf6-90f9f7e25ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:17.852365 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc6c35-0fa0-41c3-acf6-90f9f7e25ed8 None admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:17.853653 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fc6c35-0fa0-41c3-acf6-90f9f7e25ed8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:17.854201 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fc6c35-0fa0-41c3-acf6-90f9f7e25ed8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:17.855871 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fc6c35-0fa0-41c3-acf6-90f9f7e25ed8 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:17.914963 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 256/503] 10.222.0.79 () {56 vars in 1137 bytes} [Wed Aug 31 12:16:17 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:17.916377 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc6c35-0fa0-41c3-acf6-90f9f7e25ed8 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:17.974272 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f82dad-7d96-4f1a-858c-0e20ae1b0a3a None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:18.033862 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c125ad2-3b4a-4def-b479-8b5adb624aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:18.034819 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c125ad2-3b4a-4def-b479-8b5adb624aa4 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:18.035300 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c125ad2-3b4a-4def-b479-8b5adb624aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:18.035739 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c125ad2-3b4a-4def-b479-8b5adb624aa4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:18.079607 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc6c35-0fa0-41c3-acf6-90f9f7e25ed8 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:18.117858 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9976293-7cb0-466f-a616-5685656390e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:18.118512 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9976293-7cb0-466f-a616-5685656390e8 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:18.118784 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9976293-7cb0-466f-a616-5685656390e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:18.119084 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9976293-7cb0-466f-a616-5685656390e8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:18.122114 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:18.127110 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:18.131621 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9976293-7cb0-466f-a616-5685656390e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:16:18.136682 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-d9976293-7cb0-466f-a616-5685656390e8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:16:18.136682 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:18.136682 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:18.136682 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:18.136682 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:18.136682 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:18.136682 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:18.136682 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:18.136682 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:18.136682 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:18.136682 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:18.136682 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:18.136682 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:16:18.136682 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:16:18.136682 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:16:18.136682 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:16:18.138010 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:16:18.138010 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:16:18.138010 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:16:18.138010 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:16:18.138010 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:18.138010 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:18.138010 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:18.138010 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:18.138010 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:18.138010 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:18.138010 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:18.138010 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:18.138010 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:18.138010 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:18.138010 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:18.138010 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:18.139150 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:18.139150 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:18.139150 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:18.139150 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:18.139150 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:16:18.139150 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:16:18.139150 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:16:18.139150 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:16:18.139150 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:16:18.139150 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:16:18.139150 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:16:18.139150 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:16:18.139150 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 257/504] 10.222.0.79 () {56 vars in 1102 bytes} [Wed Aug 31 12:16:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:18.139150 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9976293-7cb0-466f-a616-5685656390e8 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:18.139987 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c125ad2-3b4a-4def-b479-8b5adb624aa4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:18.141667 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c125ad2-3b4a-4def-b479-8b5adb624aa4 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:18.274701 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 248/505] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 12:16:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:16:18.275764 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c125ad2-3b4a-4def-b479-8b5adb624aa4 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:18.284584 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9976293-7cb0-466f-a616-5685656390e8 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:18.345118 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06300009-e9c5-4742-9dbe-81b48c5324c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:18.346084 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06300009-e9c5-4742-9dbe-81b48c5324c1 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:18.347276 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06300009-e9c5-4742-9dbe-81b48c5324c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:18.347791 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06300009-e9c5-4742-9dbe-81b48c5324c1 None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:18.349106 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06300009-e9c5-4742-9dbe-81b48c5324c1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:18.349655 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06300009-e9c5-4742-9dbe-81b48c5324c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:18.352926 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06300009-e9c5-4742-9dbe-81b48c5324c1 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:18.369207 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 258/506] 10.222.0.79 () {56 vars in 1103 bytes} [Wed Aug 31 12:16:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:18.370834 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06300009-e9c5-4742-9dbe-81b48c5324c1 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:18.396253 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:18.403794 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c125ad2-3b4a-4def-b479-8b5adb624aa4 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:18.444485 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0925d3ac-3621-46b8-96f4-6e5a4d7b278f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:18.446217 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0925d3ac-3621-46b8-96f4-6e5a4d7b278f None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:18.446495 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0925d3ac-3621-46b8-96f4-6e5a4d7b278f None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:18.447002 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0925d3ac-3621-46b8-96f4-6e5a4d7b278f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:18.457752 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:18.527564 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06300009-e9c5-4742-9dbe-81b48c5324c1 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:18.536045 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0925d3ac-3621-46b8-96f4-6e5a4d7b278f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:18.537545 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0925d3ac-3621-46b8-96f4-6e5a4d7b278f None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:18.583465 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3161971-f310-4d56-bda4-913de7c2b021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:18.584420 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3161971-f310-4d56-bda4-913de7c2b021 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:18.584845 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3161971-f310-4d56-bda4-913de7c2b021 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:18.585273 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3161971-f310-4d56-bda4-913de7c2b021 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:18.599912 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3161971-f310-4d56-bda4-913de7c2b021 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:18.601345 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3161971-f310-4d56-bda4-913de7c2b021 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:18.618232 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-c3161971-f310-4d56-bda4-913de7c2b021 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:18.618232 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:18.618232 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:18.618232 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:18.618232 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:18.618232 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:18.618232 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:18.618232 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:18.618232 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:18.618232 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:18.618232 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:18.618232 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:18.618232 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:16:18.618232 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:16:18.618232 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:16:18.618232 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:16:18.620403 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:18.620403 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:18.620403 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:18.620403 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:18.620403 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:18.620403 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:18.620403 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:18.620403 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:18.620403 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:18.620403 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:18.620403 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:18.620403 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:18.620403 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:18.620403 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:18.620403 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:18.620403 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:18.620403 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:16:18.622510 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:16:18.622510 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:18.622510 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:16:18.622510 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 259/507] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:16:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:18.622510 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3161971-f310-4d56-bda4-913de7c2b021 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:18.660684 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:18.670759 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 249/508] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 12:16:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:16:18.672766 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0925d3ac-3621-46b8-96f4-6e5a4d7b278f None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:18.781105 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3161971-f310-4d56-bda4-913de7c2b021 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:18.799921 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:18.831252 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0925d3ac-3621-46b8-96f4-6e5a4d7b278f None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:18.838593 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a3ce4d-d9e2-4ae1-aeca-8ce1ce3b23fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:18.839340 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3ce4d-d9e2-4ae1-aeca-8ce1ce3b23fc None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:18.839681 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3ce4d-d9e2-4ae1-aeca-8ce1ce3b23fc None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:18.840013 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3ce4d-d9e2-4ae1-aeca-8ce1ce3b23fc None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:18.840770 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a3ce4d-d9e2-4ae1-aeca-8ce1ce3b23fc None admin] RBAC: Adding query filter params (name=service) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:18.841145 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a3ce4d-d9e2-4ae1-aeca-8ce1ce3b23fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:18.842662 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a3ce4d-d9e2-4ae1-aeca-8ce1ce3b23fc None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:18.854189 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 260/509] 10.222.0.79 () {56 vars in 1103 bytes} [Wed Aug 31 12:16:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:18.855018 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a3ce4d-d9e2-4ae1-aeca-8ce1ce3b23fc None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:18.885266 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e608fe1-5ac4-443b-b0c2-319c8531aa2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:18.886528 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e608fe1-5ac4-443b-b0c2-319c8531aa2b None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:18.887012 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e608fe1-5ac4-443b-b0c2-319c8531aa2b None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:18.887463 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e608fe1-5ac4-443b-b0c2-319c8531aa2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:18.900330 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e608fe1-5ac4-443b-b0c2-319c8531aa2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:18.902561 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e608fe1-5ac4-443b-b0c2-319c8531aa2b None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:18.927237 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-3e608fe1-5ac4-443b-b0c2-319c8531aa2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:18.927237 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:18.927237 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:18.927237 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:18.927237 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:18.927237 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:18.927237 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:18.927237 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:18.927237 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:18.927237 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:18.927237 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:18.927237 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:18.927237 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:16:18.927237 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:16:18.927237 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:16:18.927237 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:16:18.929102 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:18.929102 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:18.929102 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:18.929102 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:18.929102 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:18.929102 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:18.929102 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:18.929102 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:18.929102 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:18.929102 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:18.929102 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:18.929102 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:18.929102 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:18.929102 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:18.929102 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:18.929102 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:18.929102 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:16:18.930765 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:16:18.930765 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:18.930765 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:16:18.930765 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 250/510] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:16:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:18.931227 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e608fe1-5ac4-443b-b0c2-319c8531aa2b None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:18.994122 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a3ce4d-d9e2-4ae1-aeca-8ce1ce3b23fc None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:18.997715 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:19.047296 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d185e15f-52fb-43a6-93f1-777c7b30c748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:19.048355 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d185e15f-52fb-43a6-93f1-777c7b30c748 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:19.048798 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d185e15f-52fb-43a6-93f1-777c7b30c748 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:19.049273 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d185e15f-52fb-43a6-93f1-777c7b30c748 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:19.054125 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e608fe1-5ac4-443b-b0c2-319c8531aa2b None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:19.069272 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d185e15f-52fb-43a6-93f1-777c7b30c748 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:19.072540 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d185e15f-52fb-43a6-93f1-777c7b30c748 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:19.093283 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da57a356-c1af-40f6-9c34-87d9f7b6b63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:19.093912 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57a356-c1af-40f6-9c34-87d9f7b6b63d None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:19.094189 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57a356-c1af-40f6-9c34-87d9f7b6b63d None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:19.094454 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57a356-c1af-40f6-9c34-87d9f7b6b63d None admin] PATH_INFO: `/v3/domains` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:19.095139 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da57a356-c1af-40f6-9c34-87d9f7b6b63d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:19.095436 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da57a356-c1af-40f6-9c34-87d9f7b6b63d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:19.097070 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da57a356-c1af-40f6-9c34-87d9f7b6b63d None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:19.103709 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-d185e15f-52fb-43a6-93f1-777c7b30c748 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:19.103709 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:19.103709 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:19.103709 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:19.103709 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:19.103709 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:19.103709 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:19.103709 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:19.103709 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:19.103709 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:19.103709 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:19.103709 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:19.103709 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:16:19.103709 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:16:19.103709 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:16:19.103709 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:16:19.110918 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:19.110918 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:19.110918 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:19.110918 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:19.110918 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:19.110918 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:19.110918 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:19.110918 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:19.110918 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:19.110918 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:19.110918 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:19.110918 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:19.110918 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:19.110918 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:19.110918 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:19.110918 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:19.110918 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:16:19.112141 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:16:19.112141 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:19.112141 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:16:19.112141 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 261/511] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:16:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:19.112141 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d185e15f-52fb-43a6-93f1-777c7b30c748 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:19.118651 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 251/512] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 12:16:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:19.119565 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da57a356-c1af-40f6-9c34-87d9f7b6b63d None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:19.149917 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:19.249856 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d185e15f-52fb-43a6-93f1-777c7b30c748 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:19.251733 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da57a356-c1af-40f6-9c34-87d9f7b6b63d None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:19.263311 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:19.291399 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1809092d-f9ed-47b3-a081-bd4810310073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:19.292146 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809092d-f9ed-47b3-a081-bd4810310073 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:19.292282 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809092d-f9ed-47b3-a081-bd4810310073 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:19.292550 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809092d-f9ed-47b3-a081-bd4810310073 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:19.295918 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa190197-1dc2-4bc9-bb71-8217fa9f3f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:19.296831 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa190197-1dc2-4bc9-bb71-8217fa9f3f32 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:19.297197 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa190197-1dc2-4bc9-bb71-8217fa9f3f32 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:19.297567 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa190197-1dc2-4bc9-bb71-8217fa9f3f32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:19.306013 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1809092d-f9ed-47b3-a081-bd4810310073 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:19.309060 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1809092d-f9ed-47b3-a081-bd4810310073 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:19.311267 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa190197-1dc2-4bc9-bb71-8217fa9f3f32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:19.312842 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa190197-1dc2-4bc9-bb71-8217fa9f3f32 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:19.328860 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-fa190197-1dc2-4bc9-bb71-8217fa9f3f32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:19.328860 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:19.328860 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:19.328860 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:19.328860 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:19.328860 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:19.328860 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:19.328860 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:19.328860 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:19.328860 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:19.328860 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:19.328860 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:19.328860 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:16:19.328860 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:16:19.328860 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:16:19.328860 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:16:19.330325 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:19.330325 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:19.330325 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:19.330325 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:19.330325 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:19.330325 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:19.330325 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:19.330325 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:19.330325 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:19.330325 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:19.330325 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:19.330325 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:19.330325 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:19.330325 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:19.330325 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:19.330325 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:19.330325 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:16:19.332435 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:16:19.332435 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:19.332435 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:16:19.332435 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 252/513] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:16:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:19.332435 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa190197-1dc2-4bc9-bb71-8217fa9f3f32 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:19.336923 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-1809092d-f9ed-47b3-a081-bd4810310073 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:19.336923 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:19.336923 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:19.336923 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:19.336923 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:19.336923 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:19.336923 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:19.336923 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:19.336923 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:19.336923 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:19.336923 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:19.336923 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:19.336923 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:16:19.336923 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:16:19.336923 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:16:19.336923 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:16:19.338978 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:19.338978 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:19.338978 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:19.338978 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:19.338978 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:19.338978 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:19.338978 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:19.338978 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:19.338978 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:19.338978 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:19.338978 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:19.338978 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:19.338978 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:19.338978 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:19.338978 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:19.338978 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:19.338978 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:16:19.339974 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:16:19.339974 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:19.339974 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:16:19.339974 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 262/514] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:16:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:19.340618 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1809092d-f9ed-47b3-a081-bd4810310073 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:19.465973 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa190197-1dc2-4bc9-bb71-8217fa9f3f32 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:19.468822 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:19.506235 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1809092d-f9ed-47b3-a081-bd4810310073 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:19.517972 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800e1382-b001-49df-b88d-73226ca3d71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:19.518588 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e1382-b001-49df-b88d-73226ca3d71a None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:19.518906 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e1382-b001-49df-b88d-73226ca3d71a None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:19.519166 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e1382-b001-49df-b88d-73226ca3d71a None admin] PATH_INFO: `/v3/domains` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:19.519827 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800e1382-b001-49df-b88d-73226ca3d71a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:19.520129 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800e1382-b001-49df-b88d-73226ca3d71a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:19.521554 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800e1382-b001-49df-b88d-73226ca3d71a None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:19.547832 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 253/515] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 12:16:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:19.547832 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800e1382-b001-49df-b88d-73226ca3d71a None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:19.548205 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38608f39-2fd7-4840-9856-ccc5cd91c977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:19.548205 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38608f39-2fd7-4840-9856-ccc5cd91c977 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:19.548205 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38608f39-2fd7-4840-9856-ccc5cd91c977 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:19.548548 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38608f39-2fd7-4840-9856-ccc5cd91c977 None admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:19.548962 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38608f39-2fd7-4840-9856-ccc5cd91c977 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:19.549266 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38608f39-2fd7-4840-9856-ccc5cd91c977 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:19.550676 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38608f39-2fd7-4840-9856-ccc5cd91c977 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:19.563272 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 263/516] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 12:16:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:19.564137 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38608f39-2fd7-4840-9856-ccc5cd91c977 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:19.580730 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:19.697406 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800e1382-b001-49df-b88d-73226ca3d71a None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:19.719097 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38608f39-2fd7-4840-9856-ccc5cd91c977 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:19.751697 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2031884e-a80d-4569-a76e-7410aa2891d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:19.752458 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2031884e-a80d-4569-a76e-7410aa2891d2 None admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:19.752929 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2031884e-a80d-4569-a76e-7410aa2891d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:19.753395 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2031884e-a80d-4569-a76e-7410aa2891d2 None admin] PATH_INFO: `/v3/users` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:19.754334 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2031884e-a80d-4569-a76e-7410aa2891d2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:19.756324 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2031884e-a80d-4569-a76e-7410aa2891d2 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:19.772299 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7275958-1f7d-4fa1-beea-3fb6e8dfad74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:19.773466 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7275958-1f7d-4fa1-beea-3fb6e8dfad74 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:19.773863 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7275958-1f7d-4fa1-beea-3fb6e8dfad74 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:19.774238 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7275958-1f7d-4fa1-beea-3fb6e8dfad74 None admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:19.775158 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7275958-1f7d-4fa1-beea-3fb6e8dfad74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:19.775659 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7275958-1f7d-4fa1-beea-3fb6e8dfad74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:19.778013 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7275958-1f7d-4fa1-beea-3fb6e8dfad74 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:19.782221 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:19.784800 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 254/517] 10.222.0.79 () {60 vars in 1132 bytes} [Wed Aug 31 12:16:19 2022] POST /identity/v3/users => generated 247 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:16:19.786164 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2031884e-a80d-4569-a76e-7410aa2891d2 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:19.798333 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 264/518] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 12:16:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:19.799471 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7275958-1f7d-4fa1-beea-3fb6e8dfad74 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:19.929168 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:19.972532 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2031884e-a80d-4569-a76e-7410aa2891d2 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:19.973868 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7275958-1f7d-4fa1-beea-3fb6e8dfad74 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:20.021511 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593082cb-3c71-465f-a367-5b5934288381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:20.022145 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593082cb-3c71-465f-a367-5b5934288381 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:20.022472 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593082cb-3c71-465f-a367-5b5934288381 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:20.022743 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593082cb-3c71-465f-a367-5b5934288381 None admin] PATH_INFO: `/v3/domains` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:20.023993 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593082cb-3c71-465f-a367-5b5934288381 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:20.024702 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593082cb-3c71-465f-a367-5b5934288381 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:20.025823 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593082cb-3c71-465f-a367-5b5934288381 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:20.029259 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2030251d-18aa-46d0-be6f-09cc276b17b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:20.030221 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2030251d-18aa-46d0-be6f-09cc276b17b4 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:20.030756 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2030251d-18aa-46d0-be6f-09cc276b17b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:20.031599 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2030251d-18aa-46d0-be6f-09cc276b17b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:20.041145 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 255/519] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 12:16:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:20.041869 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2030251d-18aa-46d0-be6f-09cc276b17b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:20.042580 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593082cb-3c71-465f-a367-5b5934288381 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:20.043494 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2030251d-18aa-46d0-be6f-09cc276b17b4 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:20.059863 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-2030251d-18aa-46d0-be6f-09cc276b17b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:16:20.059863 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:20.059863 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:20.059863 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:20.059863 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:20.059863 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:20.059863 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:20.059863 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:20.059863 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:20.059863 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:20.059863 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:20.059863 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:20.059863 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:16:20.059863 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:16:20.059863 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:16:20.061502 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:16:20.061502 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:20.061502 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:20.061502 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:20.061502 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:20.061502 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:20.061502 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:20.061502 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:20.061502 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:20.061502 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:20.061502 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:20.061502 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:20.061502 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:20.061502 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:20.061502 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:20.061502 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:20.061502 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:20.063169 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:16:20.063169 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:16:20.063169 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:16:20.063169 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:16:20.063169 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:16:20.063169 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:16:20.063169 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:16:20.063169 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:16:20.063169 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 265/520] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 12:16:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:20.064069 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2030251d-18aa-46d0-be6f-09cc276b17b4 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:20.149518 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:20.183692 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593082cb-3c71-465f-a367-5b5934288381 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:20.227208 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2030251d-18aa-46d0-be6f-09cc276b17b4 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:20.233449 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf464a-745d-4dff-86ab-5a21f61faecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:20.234364 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf464a-745d-4dff-86ab-5a21f61faecb None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:20.234831 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf464a-745d-4dff-86ab-5a21f61faecb None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:20.235267 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf464a-745d-4dff-86ab-5a21f61faecb None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:20.239210 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:20.249666 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaf464a-745d-4dff-86ab-5a21f61faecb None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:20.253000 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaf464a-745d-4dff-86ab-5a21f61faecb None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:20.271339 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da637d-9b08-48ad-b352-16774ba22ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:20.271980 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da637d-9b08-48ad-b352-16774ba22ec1 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:20.272262 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da637d-9b08-48ad-b352-16774ba22ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:20.272535 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da637d-9b08-48ad-b352-16774ba22ec1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:20.282038 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4da637d-9b08-48ad-b352-16774ba22ec1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:20.283551 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4da637d-9b08-48ad-b352-16774ba22ec1 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:20.287125 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-daaf464a-745d-4dff-86ab-5a21f61faecb None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 12:16:20.287125 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:20.287125 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:20.287125 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:20.287125 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:20.287125 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:20.287125 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:20.287125 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:20.287125 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:20.287125 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:20.287125 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:20.287125 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:20.287125 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:16:20.287125 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:16:20.287125 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:16:20.287125 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:16:20.289784 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:20.289784 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:20.289784 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:16:20.289784 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:16:20.289784 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:16:20.289784 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:16:20.289784 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:20.289784 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:20.289784 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:20.289784 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:20.289784 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:20.289784 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:20.289784 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:20.289784 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:20.289784 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:20.289784 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:20.289784 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:20.289784 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:20.292810 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:20.292810 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:20.292810 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:16:20.292810 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:16:20.292810 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:16:20.292810 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:16:20.292810 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:16:20.292810 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:16:20.292810 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 12:16:20.292810 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:16:20.292810 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 256/521] 10.222.0.79 () {56 vars in 1102 bytes} [Wed Aug 31 12:16:20 2022] GET /identity/v3/users/neutron => generated 85 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:20.292810 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf464a-745d-4dff-86ab-5a21f61faecb None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:20.305595 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-b4da637d-9b08-48ad-b352-16774ba22ec1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 12:16:20.305595 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:20.305595 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:20.305595 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:20.305595 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:20.305595 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:20.305595 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:20.305595 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:20.305595 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:20.305595 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:20.305595 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:20.305595 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:20.305595 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:16:20.305595 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:16:20.305595 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:16:20.305595 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:16:20.307715 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:20.307715 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:20.307715 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:16:20.307715 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:16:20.307715 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:16:20.307715 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:16:20.307715 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:20.307715 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:20.307715 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:20.307715 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:20.307715 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:20.307715 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:20.307715 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:20.307715 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:20.307715 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:20.307715 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:20.307715 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:20.307715 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:20.309549 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:20.309549 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:20.309549 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:16:20.309549 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:16:20.309549 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:16:20.309549 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:16:20.309549 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:16:20.309549 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:16:20.309549 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 12:16:20.309549 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:16:20.311517 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 266/522] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 12:16:20 2022] GET /identity/v3/users/cinder => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:20.313276 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da637d-9b08-48ad-b352-16774ba22ec1 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:20.443767 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf464a-745d-4dff-86ab-5a21f61faecb None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:20.472647 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da637d-9b08-48ad-b352-16774ba22ec1 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:20.485176 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771a951b-9289-45a5-a16b-8b1f94f35f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:20.485711 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771a951b-9289-45a5-a16b-8b1f94f35f15 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:20.486004 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771a951b-9289-45a5-a16b-8b1f94f35f15 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:20.486279 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771a951b-9289-45a5-a16b-8b1f94f35f15 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:20.495965 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771a951b-9289-45a5-a16b-8b1f94f35f15 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:20.496827 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:20.497460 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771a951b-9289-45a5-a16b-8b1f94f35f15 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:20.512956 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-771a951b-9289-45a5-a16b-8b1f94f35f15 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:16:20.512956 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:20.512956 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:20.512956 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:20.512956 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:20.512956 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:20.512956 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:20.512956 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:20.512956 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:20.512956 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:20.512956 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:20.512956 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:20.512956 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:16:20.512956 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:16:20.512956 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:16:20.514230 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:16:20.514230 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:20.514230 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:20.514230 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:20.514230 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:20.514230 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:20.514230 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:20.514230 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:20.514230 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:20.514230 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:20.514230 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:20.514230 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:20.514230 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:20.514230 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:20.514230 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:20.514230 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:20.514230 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:20.516675 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:16:20.516675 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:16:20.516675 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:16:20.516675 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:16:20.516675 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:16:20.516675 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:16:20.516675 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:16:20.516675 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:16:20.516675 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 257/523] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 12:16:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:20.516675 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771a951b-9289-45a5-a16b-8b1f94f35f15 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:20.531634 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685e5121-0a50-44bd-ba2b-e8c5cb1776d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:20.532593 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e5121-0a50-44bd-ba2b-e8c5cb1776d3 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:20.533016 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e5121-0a50-44bd-ba2b-e8c5cb1776d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:20.533473 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e5121-0a50-44bd-ba2b-e8c5cb1776d3 None admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:20.534439 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685e5121-0a50-44bd-ba2b-e8c5cb1776d3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:20.534900 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685e5121-0a50-44bd-ba2b-e8c5cb1776d3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:20.536977 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685e5121-0a50-44bd-ba2b-e8c5cb1776d3 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:20.561581 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 267/524] 10.222.0.79 () {56 vars in 1148 bytes} [Wed Aug 31 12:16:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:20.562549 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685e5121-0a50-44bd-ba2b-e8c5cb1776d3 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:20.604736 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:20.685655 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771a951b-9289-45a5-a16b-8b1f94f35f15 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:20.736476 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685e5121-0a50-44bd-ba2b-e8c5cb1776d3 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:20.738418 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42e3b09-f50f-43a6-85da-79b6f63dd40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:20.738960 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e3b09-f50f-43a6-85da-79b6f63dd40f None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:20.739245 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e3b09-f50f-43a6-85da-79b6f63dd40f None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:20.739517 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e3b09-f50f-43a6-85da-79b6f63dd40f None admin] PATH_INFO: `/v3/users` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:20.740268 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42e3b09-f50f-43a6-85da-79b6f63dd40f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:20.740569 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42e3b09-f50f-43a6-85da-79b6f63dd40f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:20.742655 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42e3b09-f50f-43a6-85da-79b6f63dd40f None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:20.765121 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 258/525] 10.222.0.79 () {56 vars in 1139 bytes} [Wed Aug 31 12:16:20 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:20.765983 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42e3b09-f50f-43a6-85da-79b6f63dd40f None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:20.786900 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9fda61-811d-4d27-b86a-5f5cbbcb464c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:20.787516 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9fda61-811d-4d27-b86a-5f5cbbcb464c None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:20.787795 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9fda61-811d-4d27-b86a-5f5cbbcb464c None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:20.788061 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9fda61-811d-4d27-b86a-5f5cbbcb464c None admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:20.788880 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9fda61-811d-4d27-b86a-5f5cbbcb464c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:20.789240 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9fda61-811d-4d27-b86a-5f5cbbcb464c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:20.790926 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9fda61-811d-4d27-b86a-5f5cbbcb464c None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:20.811984 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 268/526] 10.222.0.79 () {56 vars in 1137 bytes} [Wed Aug 31 12:16:20 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:20.812716 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9fda61-811d-4d27-b86a-5f5cbbcb464c None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:20.864960 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:20.907353 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42e3b09-f50f-43a6-85da-79b6f63dd40f None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:20.927378 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:20.951561 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9fda61-811d-4d27-b86a-5f5cbbcb464c None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:20.952761 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687abfaf-0f66-407b-b441-f3114285f5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:20.953491 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687abfaf-0f66-407b-b441-f3114285f5b3 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:20.953780 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687abfaf-0f66-407b-b441-f3114285f5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:20.954053 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687abfaf-0f66-407b-b441-f3114285f5b3 None admin] PATH_INFO: `/v3/projects` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:20.954896 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687abfaf-0f66-407b-b441-f3114285f5b3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:20.955220 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687abfaf-0f66-407b-b441-f3114285f5b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:20.956674 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687abfaf-0f66-407b-b441-f3114285f5b3 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:20.980144 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 259/527] 10.222.0.79 () {56 vars in 1148 bytes} [Wed Aug 31 12:16:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:20.981132 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687abfaf-0f66-407b-b441-f3114285f5b3 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:21.003880 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02886add-3be2-4b5c-915d-b1e2523cab1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:21.004477 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02886add-3be2-4b5c-915d-b1e2523cab1e None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:21.004756 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02886add-3be2-4b5c-915d-b1e2523cab1e None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:21.005146 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02886add-3be2-4b5c-915d-b1e2523cab1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:21.005758 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02886add-3be2-4b5c-915d-b1e2523cab1e None admin] RBAC: Adding query filter params (role.id=37fee7a104964826a0762987a1531a9a, scope.project.id=a94f4957f2a047cc844342e1c7c74ca5, user.id=62401c8e1457450590f4147e0665265a) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:21.006063 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02886add-3be2-4b5c-915d-b1e2523cab1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:21.007596 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02886add-3be2-4b5c-915d-b1e2523cab1e None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:21.022884 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 269/528] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 12:16:20 2022] GET /identity/v3/role_assignments?user.id=62401c8e1457450590f4147e0665265a&scope.project.id=a94f4957f2a047cc844342e1c7c74ca5&role.id=37fee7a104964826a0762987a1531a9a => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:21.022884 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02886add-3be2-4b5c-915d-b1e2523cab1e None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:21.179250 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:21.186826 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02886add-3be2-4b5c-915d-b1e2523cab1e None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:21.188365 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687abfaf-0f66-407b-b441-f3114285f5b3 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:21.246101 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc50886-b541-46cb-9198-33dcf8267ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:21.246101 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc50886-b541-46cb-9198-33dcf8267ba9 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:21.246101 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc50886-b541-46cb-9198-33dcf8267ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:21.246480 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc50886-b541-46cb-9198-33dcf8267ba9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:21.246577 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a86358-4802-42ed-9558-0c9efc72f100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:21.247762 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a86358-4802-42ed-9558-0c9efc72f100 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:21.248429 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a86358-4802-42ed-9558-0c9efc72f100 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:21.248995 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a86358-4802-42ed-9558-0c9efc72f100 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:21.332532 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:21.341380 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc50886-b541-46cb-9198-33dcf8267ba9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:21.343534 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc50886-b541-46cb-9198-33dcf8267ba9 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:21.367598 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a86358-4802-42ed-9558-0c9efc72f100 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:21.369964 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a86358-4802-42ed-9558-0c9efc72f100 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:21.480973 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:21.495077 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 270/529] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 12:16:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:16:21.497418 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc50886-b541-46cb-9198-33dcf8267ba9 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:21.511343 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 260/530] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 12:16:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:16:21.513780 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a86358-4802-42ed-9558-0c9efc72f100 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:21.628037 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc50886-b541-46cb-9198-33dcf8267ba9 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:21.655904 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:21.670322 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ce3c49-b099-4eae-931c-462c737f9c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:21.671146 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce3c49-b099-4eae-931c-462c737f9c67 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:21.671493 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce3c49-b099-4eae-931c-462c737f9c67 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:21.671849 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce3c49-b099-4eae-931c-462c737f9c67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:21.672706 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ce3c49-b099-4eae-931c-462c737f9c67 None admin] RBAC: Adding query filter params (role.id=37fee7a104964826a0762987a1531a9a, scope.project.id=a94f4957f2a047cc844342e1c7c74ca5, user.id=d8b3bb8f689b45b99ed43f672264a26d) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:21.673001 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ce3c49-b099-4eae-931c-462c737f9c67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:21.674607 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ce3c49-b099-4eae-931c-462c737f9c67 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:21.687204 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 271/531] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 12:16:21 2022] GET /identity/v3/role_assignments?user.id=d8b3bb8f689b45b99ed43f672264a26d&scope.project.id=a94f4957f2a047cc844342e1c7c74ca5&role.id=37fee7a104964826a0762987a1531a9a => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:21.688169 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ce3c49-b099-4eae-931c-462c737f9c67 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:21.710521 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a86358-4802-42ed-9558-0c9efc72f100 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:21.779365 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e04aeec-fada-4b0b-aa70-6cfb0f22cbf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:21.780871 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e04aeec-fada-4b0b-aa70-6cfb0f22cbf8 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:21.781993 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e04aeec-fada-4b0b-aa70-6cfb0f22cbf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:21.782814 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e04aeec-fada-4b0b-aa70-6cfb0f22cbf8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:21.803689 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e04aeec-fada-4b0b-aa70-6cfb0f22cbf8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:21.806998 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e04aeec-fada-4b0b-aa70-6cfb0f22cbf8 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:21.810564 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:21.840515 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-6e04aeec-fada-4b0b-aa70-6cfb0f22cbf8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:21.840515 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:21.840515 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:21.840515 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:21.840515 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:21.840515 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:21.840515 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:21.840515 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:21.840515 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:21.840515 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:21.840515 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:21.840515 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:21.840515 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:16:21.840515 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:16:21.840515 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:16:21.840515 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:16:21.841648 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:21.841648 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:21.841648 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:21.841648 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:21.841648 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:21.841648 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:21.841648 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:21.841648 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:21.841648 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:21.841648 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:21.841648 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:21.841648 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:21.841648 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:21.841648 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:21.841648 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:21.841648 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:21.841648 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:16:21.842667 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:16:21.842667 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:21.842667 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:16:21.845440 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 261/532] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:16:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:21.856811 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e04aeec-fada-4b0b-aa70-6cfb0f22cbf8 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:21.864776 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ce3c49-b099-4eae-931c-462c737f9c67 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:21.905995 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93ce000-489c-4596-94ab-35956206fc00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:21.907073 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ce000-489c-4596-94ab-35956206fc00 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:21.907557 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ce000-489c-4596-94ab-35956206fc00 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:21.908063 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ce000-489c-4596-94ab-35956206fc00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:21.922157 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93ce000-489c-4596-94ab-35956206fc00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:21.924030 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93ce000-489c-4596-94ab-35956206fc00 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:21.944527 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-f93ce000-489c-4596-94ab-35956206fc00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:21.944527 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:21.944527 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:21.944527 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:21.944527 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:21.944527 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:21.944527 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:21.944527 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:21.944527 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:21.944527 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:21.944527 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:21.944527 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:21.944527 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:16:21.944527 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:16:21.944527 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:16:21.944527 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:16:21.946155 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:21.946155 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:21.946155 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:21.946155 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:21.946155 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:21.946155 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:21.946155 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:21.946155 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:21.946155 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:21.946155 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:21.946155 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:21.946155 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:21.946155 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:21.946155 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:21.946155 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:21.946155 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:21.946155 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:16:21.947374 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:16:21.947374 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:21.947374 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:16:21.947654 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 272/533] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:16:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:21.952394 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a937de-c9c6-4e99-96cf-5ddaab7747cc None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:21.952394 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a937de-c9c6-4e99-96cf-5ddaab7747cc None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:21.952394 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a937de-c9c6-4e99-96cf-5ddaab7747cc None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:21.952394 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 273/534] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:16:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:16:21.954917 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a937de-c9c6-4e99-96cf-5ddaab7747cc None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:22.000737 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e04aeec-fada-4b0b-aa70-6cfb0f22cbf8 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:22.037880 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:22.052664 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fac540-8409-45d3-b9c3-89f3395d5b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:22.053556 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fac540-8409-45d3-b9c3-89f3395d5b50 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:22.053999 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fac540-8409-45d3-b9c3-89f3395d5b50 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:22.054486 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fac540-8409-45d3-b9c3-89f3395d5b50 None admin] PATH_INFO: `/v3/domains` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:22.055853 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fac540-8409-45d3-b9c3-89f3395d5b50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:22.056398 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fac540-8409-45d3-b9c3-89f3395d5b50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:22.058192 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fac540-8409-45d3-b9c3-89f3395d5b50 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:22.081882 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 262/535] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 12:16:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:22.081882 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f0364-5366-49df-b408-40642eb3d79b None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:22.081882 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f0364-5366-49df-b408-40642eb3d79b None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:22.081882 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f0364-5366-49df-b408-40642eb3d79b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:22.102436 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-da1f0364-5366-49df-b408-40642eb3d79b None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:22.103558 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-da1f0364-5366-49df-b408-40642eb3d79b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:22.111520 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a937de-c9c6-4e99-96cf-5ddaab7747cc None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:22.135097 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:22.171011 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769bc0c5-6a96-4885-aeef-78d80dd90daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:22.171706 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769bc0c5-6a96-4885-aeef-78d80dd90daa None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:22.172813 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769bc0c5-6a96-4885-aeef-78d80dd90daa None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:22.173198 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769bc0c5-6a96-4885-aeef-78d80dd90daa None admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:22.174177 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769bc0c5-6a96-4885-aeef-78d80dd90daa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:22.174767 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769bc0c5-6a96-4885-aeef-78d80dd90daa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:22.176712 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769bc0c5-6a96-4885-aeef-78d80dd90daa None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:22.194917 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 274/537] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 12:16:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:22.195361 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 263/537] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:16:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:16:22.196140 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769bc0c5-6a96-4885-aeef-78d80dd90daa None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:22.200080 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1f0364-5366-49df-b408-40642eb3d79b None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:22.322270 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769bc0c5-6a96-4885-aeef-78d80dd90daa None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:22.408516 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba596bbf-fceb-49cb-94ff-9ac508523f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:22.409601 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba596bbf-fceb-49cb-94ff-9ac508523f32 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:22.410323 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba596bbf-fceb-49cb-94ff-9ac508523f32 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:22.410787 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba596bbf-fceb-49cb-94ff-9ac508523f32 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:22.436878 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba596bbf-fceb-49cb-94ff-9ac508523f32 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:22.441035 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba596bbf-fceb-49cb-94ff-9ac508523f32 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:22.484942 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-ba596bbf-fceb-49cb-94ff-9ac508523f32 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:16:22.484942 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:22.484942 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:22.484942 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:22.484942 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:22.484942 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:22.484942 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:22.484942 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:22.484942 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:22.484942 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:22.484942 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:22.484942 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:22.484942 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:16:22.484942 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:16:22.484942 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:16:22.485863 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:16:22.485863 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:22.485863 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:22.485863 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:22.485863 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:22.485863 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:22.485863 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:22.485863 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:22.485863 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:22.485863 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:22.485863 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:22.485863 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:22.485863 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:22.485863 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:22.485863 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:22.485863 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:22.485863 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:22.486720 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:16:22.486720 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:16:22.486720 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:16:22.486720 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:16:22.486720 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:16:22.486720 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:16:22.486720 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:16:22.486720 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:16:22.490878 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1f0364-5366-49df-b408-40642eb3d79b None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:22.491813 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 275/538] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 12:16:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:22.495465 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba596bbf-fceb-49cb-94ff-9ac508523f32 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:22.540709 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:22.547546 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:22.575594 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3568d0ff-5169-43b4-9a0a-ae310f169156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:22.576960 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568d0ff-5169-43b4-9a0a-ae310f169156 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:22.577816 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568d0ff-5169-43b4-9a0a-ae310f169156 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:22.578645 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568d0ff-5169-43b4-9a0a-ae310f169156 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:22.592812 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3568d0ff-5169-43b4-9a0a-ae310f169156 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:22.598880 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3568d0ff-5169-43b4-9a0a-ae310f169156 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:22.625110 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-3568d0ff-5169-43b4-9a0a-ae310f169156 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:16:22.625110 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:22.625110 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:22.625110 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:22.625110 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:22.625110 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:22.625110 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:22.625110 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:22.625110 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:22.625110 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:22.625110 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:22.625110 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:22.625110 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:16:22.625110 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:16:22.625110 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:16:22.626006 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:16:22.626006 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:22.626006 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:22.626006 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:22.626006 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:22.626006 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:22.626006 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:22.626006 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:22.626006 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:22.626006 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:22.626006 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:22.626006 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:22.626006 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:22.626006 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:22.626006 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:22.626006 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:22.626006 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:22.626878 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:16:22.626878 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:16:22.626878 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:16:22.626878 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:16:22.626878 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:16:22.626878 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:16:22.626878 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:16:22.626878 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:16:22.632119 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 264/539] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 12:16:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 428 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:22.632119 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3568d0ff-5169-43b4-9a0a-ae310f169156 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:22.635990 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba596bbf-fceb-49cb-94ff-9ac508523f32 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:22.675938 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835d0a8c-eead-4acc-8e56-82b4c0bd598f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:22.678123 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d0a8c-eead-4acc-8e56-82b4c0bd598f None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:22.679658 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d0a8c-eead-4acc-8e56-82b4c0bd598f None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:22.680253 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d0a8c-eead-4acc-8e56-82b4c0bd598f None admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:22.682216 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835d0a8c-eead-4acc-8e56-82b4c0bd598f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:22.684129 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835d0a8c-eead-4acc-8e56-82b4c0bd598f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:22.686749 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835d0a8c-eead-4acc-8e56-82b4c0bd598f None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:22.714963 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 276/540] 10.222.0.79 () {56 vars in 1148 bytes} [Wed Aug 31 12:16:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:16:22.714963 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835d0a8c-eead-4acc-8e56-82b4c0bd598f None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:22.785484 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3568d0ff-5169-43b4-9a0a-ae310f169156 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:22.829027 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ef3208-e4d4-4930-8a7d-5f1ccdbb66fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:22.830235 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef3208-e4d4-4930-8a7d-5f1ccdbb66fd None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:22.830763 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef3208-e4d4-4930-8a7d-5f1ccdbb66fd None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:22.831376 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef3208-e4d4-4930-8a7d-5f1ccdbb66fd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:22.846178 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ef3208-e4d4-4930-8a7d-5f1ccdbb66fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:16:22.852991 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-e6ef3208-e4d4-4930-8a7d-5f1ccdbb66fd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:16:22.852991 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:22.852991 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:22.852991 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:22.852991 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:22.852991 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:22.852991 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:22.852991 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:22.852991 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:22.852991 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:22.852991 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:22.852991 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:22.852991 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:16:22.852991 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:16:22.852991 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:16:22.852991 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:16:22.855353 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:16:22.855353 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:16:22.855353 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:16:22.855353 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:16:22.855353 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:22.855353 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:22.855353 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:22.855353 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:22.855353 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:22.855353 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:22.855353 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:22.855353 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:22.855353 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:22.855353 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:22.855353 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:22.855353 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:22.857044 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:22.857044 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:22.857044 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:22.857044 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:22.857044 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:16:22.857044 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:16:22.857044 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:16:22.857044 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:16:22.857044 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:16:22.857044 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:16:22.857044 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:16:22.857044 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:16:22.857044 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 265/541] 10.222.0.79 () {56 vars in 1102 bytes} [Wed Aug 31 12:16:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:22.857044 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ef3208-e4d4-4930-8a7d-5f1ccdbb66fd None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:22.878317 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:22.887390 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835d0a8c-eead-4acc-8e56-82b4c0bd598f None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:22.907134 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:22.931122 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c32154-8277-424c-8761-a69fbbc9b0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:22.932001 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c32154-8277-424c-8761-a69fbbc9b0a8 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:22.932452 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c32154-8277-424c-8761-a69fbbc9b0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:22.932971 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c32154-8277-424c-8761-a69fbbc9b0a8 None admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:22.933836 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c32154-8277-424c-8761-a69fbbc9b0a8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:22.934311 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c32154-8277-424c-8761-a69fbbc9b0a8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:22.935980 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c32154-8277-424c-8761-a69fbbc9b0a8 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:22.952134 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 277/542] 10.222.0.79 () {56 vars in 1148 bytes} [Wed Aug 31 12:16:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:22.953458 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c32154-8277-424c-8761-a69fbbc9b0a8 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:22.994240 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ef3208-e4d4-4930-8a7d-5f1ccdbb66fd None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:23.035084 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a68f80-919b-4702-9e93-72262c2e2e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:23.035718 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a68f80-919b-4702-9e93-72262c2e2e03 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:23.036001 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a68f80-919b-4702-9e93-72262c2e2e03 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:23.036273 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a68f80-919b-4702-9e93-72262c2e2e03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:23.037064 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a68f80-919b-4702-9e93-72262c2e2e03 None admin] RBAC: Adding query filter params (role.id=37fee7a104964826a0762987a1531a9a, scope.project.id=a94f4957f2a047cc844342e1c7c74ca5, user.id=e79503178ac54e62ba385467d5617ea1) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:23.037324 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a68f80-919b-4702-9e93-72262c2e2e03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:23.039078 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a68f80-919b-4702-9e93-72262c2e2e03 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:23.046564 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 266/543] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 12:16:22 2022] GET /identity/v3/role_assignments?user.id=e79503178ac54e62ba385467d5617ea1&scope.project.id=a94f4957f2a047cc844342e1c7c74ca5&role.id=37fee7a104964826a0762987a1531a9a => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:23.047593 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a68f80-919b-4702-9e93-72262c2e2e03 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:23.079008 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c32154-8277-424c-8761-a69fbbc9b0a8 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:23.123243 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d636f215-14ca-4d72-850a-70e237d4b4ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:23.124400 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d636f215-14ca-4d72-850a-70e237d4b4ac None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:23.124885 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d636f215-14ca-4d72-850a-70e237d4b4ac None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:23.125425 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d636f215-14ca-4d72-850a-70e237d4b4ac None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:23.126387 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d636f215-14ca-4d72-850a-70e237d4b4ac None admin] RBAC: Adding query filter params (name=service) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:23.126941 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d636f215-14ca-4d72-850a-70e237d4b4ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:23.128837 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d636f215-14ca-4d72-850a-70e237d4b4ac None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:23.139839 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 278/544] 10.222.0.79 () {56 vars in 1103 bytes} [Wed Aug 31 12:16:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:23.148723 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d636f215-14ca-4d72-850a-70e237d4b4ac None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:23.173550 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:23.179378 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a68f80-919b-4702-9e93-72262c2e2e03 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:23.194789 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:23.223209 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31982515-d97f-4604-9652-85e0cb76f564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:23.224357 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31982515-d97f-4604-9652-85e0cb76f564 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:23.224926 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31982515-d97f-4604-9652-85e0cb76f564 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:23.225430 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31982515-d97f-4604-9652-85e0cb76f564 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:23.226502 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31982515-d97f-4604-9652-85e0cb76f564 None admin] RBAC: Adding query filter params (role.id=37fee7a104964826a0762987a1531a9a, scope.project.id=a94f4957f2a047cc844342e1c7c74ca5, user.id=1569b43c774c45ff80577d879ba9d819) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:23.227375 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31982515-d97f-4604-9652-85e0cb76f564 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:23.229282 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31982515-d97f-4604-9652-85e0cb76f564 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:23.236487 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 267/545] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 12:16:23 2022] GET /identity/v3/role_assignments?user.id=1569b43c774c45ff80577d879ba9d819&scope.project.id=a94f4957f2a047cc844342e1c7c74ca5&role.id=37fee7a104964826a0762987a1531a9a => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:23.397539 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d636f215-14ca-4d72-850a-70e237d4b4ac None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:23.416504 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26260a3a-ad44-4c2a-817e-47ab3a50d5ac None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:23.417503 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26260a3a-ad44-4c2a-817e-47ab3a50d5ac None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:23.418207 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26260a3a-ad44-4c2a-817e-47ab3a50d5ac None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:23.421381 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 268/546] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:16:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:16:23.429566 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3e00f-e274-4636-8932-25187b7563a1 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:23.430665 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3e00f-e274-4636-8932-25187b7563a1 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:23.431411 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3e00f-e274-4636-8932-25187b7563a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:23.471693 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d3920a-bd3a-41e8-b4f8-189331b3f60f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:23.473520 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d3920a-bd3a-41e8-b4f8-189331b3f60f None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:23.474187 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d3920a-bd3a-41e8-b4f8-189331b3f60f None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:23.474886 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d3920a-bd3a-41e8-b4f8-189331b3f60f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:23.489490 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-92c3e00f-e274-4636-8932-25187b7563a1 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:23.493926 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-92c3e00f-e274-4636-8932-25187b7563a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:23.509577 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d3920a-bd3a-41e8-b4f8-189331b3f60f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:23.512703 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d3920a-bd3a-41e8-b4f8-189331b3f60f None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:23.548688 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-35d3920a-bd3a-41e8-b4f8-189331b3f60f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:23.548688 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:23.548688 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:23.548688 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:23.548688 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:23.548688 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:23.548688 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:23.548688 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:23.548688 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:23.548688 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:23.548688 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:23.548688 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:23.548688 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:16:23.548688 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:16:23.548688 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:16:23.548688 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:16:23.550556 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:23.550556 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:23.550556 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:23.550556 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:23.550556 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:23.550556 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:23.550556 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:23.550556 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:23.550556 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:23.550556 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:23.550556 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:23.550556 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:23.550556 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:23.550556 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:23.550556 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:23.550556 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:23.550556 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:16:23.552148 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:16:23.552148 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:23.552148 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:16:23.553329 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 279/547] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:16:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 405 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:23.559253 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d3920a-bd3a-41e8-b4f8-189331b3f60f None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:23.636250 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 269/548] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:16:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:16:23.653476 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:23.696014 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d3920a-bd3a-41e8-b4f8-189331b3f60f None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:23.746663 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b431528f-429e-4b40-83cb-84cca74b25af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:23.747734 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b431528f-429e-4b40-83cb-84cca74b25af None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:23.748413 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b431528f-429e-4b40-83cb-84cca74b25af None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:23.748685 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b431528f-429e-4b40-83cb-84cca74b25af None admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:23.749898 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b431528f-429e-4b40-83cb-84cca74b25af None admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:23.750438 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b431528f-429e-4b40-83cb-84cca74b25af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:23.753019 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b431528f-429e-4b40-83cb-84cca74b25af None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:23.776725 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 280/549] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 12:16:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:23.784289 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c3e00f-e274-4636-8932-25187b7563a1 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:23.925409 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:23.934951 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c3e00f-e274-4636-8932-25187b7563a1 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:23.984631 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77b2c18-da1e-4297-90fd-f62ceb6c3d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:23.985292 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b2c18-da1e-4297-90fd-f62ceb6c3d7c None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:23.985573 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b2c18-da1e-4297-90fd-f62ceb6c3d7c None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:23.985847 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b2c18-da1e-4297-90fd-f62ceb6c3d7c None admin] PATH_INFO: `/v3/users/swift` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:24.000070 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77b2c18-da1e-4297-90fd-f62ceb6c3d7c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:24.001565 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77b2c18-da1e-4297-90fd-f62ceb6c3d7c None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:24.017868 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-c77b2c18-da1e-4297-90fd-f62ceb6c3d7c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 12:16:24.017868 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:24.017868 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:24.017868 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:24.017868 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:24.017868 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:24.017868 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:24.017868 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:24.017868 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:24.017868 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:24.017868 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:24.017868 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:24.017868 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:16:24.017868 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:16:24.017868 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:16:24.017868 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:16:24.018957 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:24.018957 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:24.018957 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:16:24.018957 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:16:24.018957 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:16:24.018957 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:16:24.018957 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:24.018957 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:24.018957 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:24.018957 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:24.018957 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:24.018957 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:24.018957 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:24.018957 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:24.018957 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:24.018957 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:24.018957 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:24.018957 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:24.019855 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:24.019855 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:24.019855 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:16:24.019855 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:16:24.019855 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:16:24.019855 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:16:24.019855 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:16:24.019855 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:16:24.019855 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 12:16:24.019855 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:16:24.019855 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 270/550] 10.222.0.79 () {56 vars in 1096 bytes} [Wed Aug 31 12:16:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:24.026687 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b431528f-429e-4b40-83cb-84cca74b25af None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:24.206425 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77b2c18-da1e-4297-90fd-f62ceb6c3d7c None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:24.252299 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b431528f-429e-4b40-83cb-84cca74b25af None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:24.327416 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:24.340197 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d02bb3c-339f-452d-b227-6244692d7674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:24.340832 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d02bb3c-339f-452d-b227-6244692d7674 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:24.341112 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d02bb3c-339f-452d-b227-6244692d7674 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:24.341380 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d02bb3c-339f-452d-b227-6244692d7674 None admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:24.342130 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d02bb3c-339f-452d-b227-6244692d7674 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:24.342433 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d02bb3c-339f-452d-b227-6244692d7674 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:24.343937 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d02bb3c-339f-452d-b227-6244692d7674 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:24.371769 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 281/551] 10.222.0.79 () {56 vars in 1135 bytes} [Wed Aug 31 12:16:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:24.377500 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d02bb3c-339f-452d-b227-6244692d7674 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:24.425709 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77b2c18-da1e-4297-90fd-f62ceb6c3d7c None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:24.503790 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064d619f-6cad-4a37-b76a-150c98575ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:24.504358 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064d619f-6cad-4a37-b76a-150c98575ab0 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:24.504635 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064d619f-6cad-4a37-b76a-150c98575ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:24.504901 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064d619f-6cad-4a37-b76a-150c98575ab0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:24.530187 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064d619f-6cad-4a37-b76a-150c98575ab0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:16:24.553872 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-064d619f-6cad-4a37-b76a-150c98575ab0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:16:24.553872 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:24.553872 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:24.553872 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:24.553872 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:24.553872 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:24.553872 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:24.553872 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:24.553872 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:24.553872 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:24.553872 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:24.553872 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:24.553872 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:16:24.553872 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:16:24.553872 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:16:24.553872 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:16:24.555696 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:16:24.555696 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:16:24.555696 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:16:24.555696 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:16:24.555696 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:24.555696 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:24.555696 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:24.555696 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:24.555696 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:24.555696 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:24.555696 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:24.555696 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:24.555696 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:24.555696 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:24.555696 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:24.555696 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:24.556539 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:24.556539 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:24.556539 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:24.556539 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:24.556539 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:16:24.556539 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:16:24.556539 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:16:24.556539 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:16:24.556539 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:16:24.556539 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:16:24.556539 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:16:24.556539 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:16:24.556539 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 271/552] 10.222.0.79 () {56 vars in 1102 bytes} [Wed Aug 31 12:16:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:16:24.565969 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064d619f-6cad-4a37-b76a-150c98575ab0 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:24.599996 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:24.621573 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d02bb3c-339f-452d-b227-6244692d7674 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:24.668249 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6fcd5b-88c7-4da9-8d93-8dbb9331b306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:24.668943 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6fcd5b-88c7-4da9-8d93-8dbb9331b306 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:24.669363 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6fcd5b-88c7-4da9-8d93-8dbb9331b306 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:24.669729 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6fcd5b-88c7-4da9-8d93-8dbb9331b306 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:24.738579 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064d619f-6cad-4a37-b76a-150c98575ab0 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:24.747858 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:24.766962 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6fcd5b-88c7-4da9-8d93-8dbb9331b306 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:24.769489 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6fcd5b-88c7-4da9-8d93-8dbb9331b306 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:24.796850 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8882b45e-d372-490d-84c6-657caa6aa0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:24.798756 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8882b45e-d372-490d-84c6-657caa6aa0b7 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:24.799403 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8882b45e-d372-490d-84c6-657caa6aa0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:24.799864 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8882b45e-d372-490d-84c6-657caa6aa0b7 None admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:24.800810 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8882b45e-d372-490d-84c6-657caa6aa0b7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:24.801455 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8882b45e-d372-490d-84c6-657caa6aa0b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:24.803441 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8882b45e-d372-490d-84c6-657caa6aa0b7 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:24.816301 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 272/553] 10.222.0.79 () {56 vars in 1103 bytes} [Wed Aug 31 12:16:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:24.818176 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dbd70d-4035-4271-85a4-7ac894435f79 None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:24.818650 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dbd70d-4035-4271-85a4-7ac894435f79 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:24.819126 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dbd70d-4035-4271-85a4-7ac894435f79 None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:24.825870 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 273/554] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:16:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:16:24.825870 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dbd70d-4035-4271-85a4-7ac894435f79 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:24.920198 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 282/555] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 12:16:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 12:16:24.921898 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7706ae08-e5ef-4cfd-9540-e8b2da7a627c None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:24.922386 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7706ae08-e5ef-4cfd-9540-e8b2da7a627c None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:24.922870 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7706ae08-e5ef-4cfd-9540-e8b2da7a627c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:24.945626 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-7706ae08-e5ef-4cfd-9540-e8b2da7a627c None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:24.947325 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-7706ae08-e5ef-4cfd-9540-e8b2da7a627c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:24.951212 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:24.981985 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dbd70d-4035-4271-85a4-7ac894435f79 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:25.033936 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ebd58e-93e7-4755-b623-8dca4712ac7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:25.034631 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ebd58e-93e7-4755-b623-8dca4712ac7e None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:25.034946 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ebd58e-93e7-4755-b623-8dca4712ac7e None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:25.035412 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ebd58e-93e7-4755-b623-8dca4712ac7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:25.051336 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ebd58e-93e7-4755-b623-8dca4712ac7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:25.053117 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ebd58e-93e7-4755-b623-8dca4712ac7e None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:25.067689 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 283/556] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:16:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:16:25.068169 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7706ae08-e5ef-4cfd-9540-e8b2da7a627c None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:25.086196 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-e8ebd58e-93e7-4755-b623-8dca4712ac7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:25.086196 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:25.086196 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:25.086196 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:25.086196 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:25.086196 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:25.086196 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:25.086196 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:25.086196 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:25.086196 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:25.086196 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:25.086196 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:25.086196 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:16:25.086196 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:16:25.086196 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:16:25.086196 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:16:25.087234 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:25.087234 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:25.087234 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:25.087234 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:25.087234 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:25.087234 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:25.087234 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:25.087234 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:25.087234 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:25.087234 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:25.087234 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:25.087234 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:25.087234 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:25.087234 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:25.087234 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:25.087234 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:25.087234 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:16:25.088177 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:16:25.088177 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:25.088177 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:16:25.088177 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 274/557] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:16:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:25.097203 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ebd58e-93e7-4755-b623-8dca4712ac7e None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:25.133952 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:25.297158 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ebd58e-93e7-4755-b623-8dca4712ac7e None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:25.329861 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:25.340735 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7706ae08-e5ef-4cfd-9540-e8b2da7a627c None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:25.344544 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3a3b4b-a3d3-4f6c-995b-df49874118e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:25.345492 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3a3b4b-a3d3-4f6c-995b-df49874118e0 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:25.346592 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3a3b4b-a3d3-4f6c-995b-df49874118e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:25.347182 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3a3b4b-a3d3-4f6c-995b-df49874118e0 None admin] PATH_INFO: `/v3/domains` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:25.349097 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3a3b4b-a3d3-4f6c-995b-df49874118e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:25.352877 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3a3b4b-a3d3-4f6c-995b-df49874118e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:25.354646 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3a3b4b-a3d3-4f6c-995b-df49874118e0 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:25.380056 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 275/558] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 12:16:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:25.388072 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3a3b4b-a3d3-4f6c-995b-df49874118e0 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:25.426525 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bb1a29-377f-42df-9ef0-5ad66f94cc3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:25.427642 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb1a29-377f-42df-9ef0-5ad66f94cc3b None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:25.428137 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb1a29-377f-42df-9ef0-5ad66f94cc3b None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:25.428425 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb1a29-377f-42df-9ef0-5ad66f94cc3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:25.456531 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bb1a29-377f-42df-9ef0-5ad66f94cc3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:25.459073 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bb1a29-377f-42df-9ef0-5ad66f94cc3b None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:25.487474 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-33bb1a29-377f-42df-9ef0-5ad66f94cc3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:25.487474 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:25.487474 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:25.487474 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:25.487474 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:25.487474 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:25.487474 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:25.487474 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:25.487474 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:25.487474 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:25.487474 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:25.487474 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:25.487474 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:16:25.487474 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:16:25.487474 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:16:25.487474 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:16:25.489384 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:25.489384 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:25.489384 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:25.489384 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:25.489384 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:25.489384 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:25.489384 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:25.489384 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:25.489384 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:25.489384 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:25.489384 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:25.489384 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:25.489384 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:25.489384 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:25.489384 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:25.489384 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:25.489384 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:16:25.492766 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:16:25.492766 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:25.492766 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:16:25.492766 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 284/559] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:16:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 422 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:25.492766 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8e6ba-5dcd-4f06-ac4d-c83a9cf35c56 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:25.492766 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8e6ba-5dcd-4f06-ac4d-c83a9cf35c56 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:25.493436 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8e6ba-5dcd-4f06-ac4d-c83a9cf35c56 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:25.498964 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 285/560] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:16:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:16:25.498964 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d8e6ba-5dcd-4f06-ac4d-c83a9cf35c56 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:25.561123 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3a3b4b-a3d3-4f6c-995b-df49874118e0 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:25.597636 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:25.605653 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4511fcf-0e31-4f5c-b3f0-f5de8ccdc06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:25.606352 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4511fcf-0e31-4f5c-b3f0-f5de8ccdc06d None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:25.606627 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4511fcf-0e31-4f5c-b3f0-f5de8ccdc06d None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:25.606916 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4511fcf-0e31-4f5c-b3f0-f5de8ccdc06d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:25.615042 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4511fcf-0e31-4f5c-b3f0-f5de8ccdc06d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:25.616539 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4511fcf-0e31-4f5c-b3f0-f5de8ccdc06d None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:25.635931 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-b4511fcf-0e31-4f5c-b3f0-f5de8ccdc06d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 12:16:25.635931 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:25.635931 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:25.635931 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:25.635931 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:25.635931 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:25.635931 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:25.635931 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:25.635931 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:25.635931 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:25.635931 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:25.635931 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:25.635931 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:16:25.635931 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:16:25.635931 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:16:25.635931 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:16:25.637372 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:25.637372 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:25.637372 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:16:25.637372 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:16:25.637372 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:16:25.637372 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:16:25.637372 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:25.637372 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:25.637372 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:25.637372 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:25.637372 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:25.637372 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:25.637372 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:25.637372 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:25.637372 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:25.637372 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:25.637372 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:25.637372 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:25.639789 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:25.639789 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:25.639789 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:16:25.639789 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:16:25.639789 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:16:25.639789 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:16:25.639789 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:16:25.639789 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:16:25.639789 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 12:16:25.639789 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:16:25.639789 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 276/561] 10.222.0.79 () {56 vars in 1093 bytes} [Wed Aug 31 12:16:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:25.639789 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4511fcf-0e31-4f5c-b3f0-f5de8ccdc06d None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:25.658189 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d8e6ba-5dcd-4f06-ac4d-c83a9cf35c56 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:25.716190 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa351bc4-a57d-495b-9dfb-4e2929e3104e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:25.717198 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa351bc4-a57d-495b-9dfb-4e2929e3104e None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:25.717818 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa351bc4-a57d-495b-9dfb-4e2929e3104e None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:25.718258 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa351bc4-a57d-495b-9dfb-4e2929e3104e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:25.721684 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:25.737814 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa351bc4-a57d-495b-9dfb-4e2929e3104e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:16:25.747085 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-fa351bc4-a57d-495b-9dfb-4e2929e3104e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:16:25.747085 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:25.747085 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:25.747085 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:25.747085 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:25.747085 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:25.747085 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:25.747085 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:25.747085 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:25.747085 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:25.747085 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:25.747085 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:25.747085 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:16:25.747085 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:16:25.747085 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:16:25.747085 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:16:25.748207 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:16:25.748207 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:16:25.748207 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:16:25.748207 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:16:25.748207 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:25.748207 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:25.748207 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:25.748207 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:25.748207 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:25.748207 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:25.748207 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:25.748207 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:25.748207 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:25.748207 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:25.748207 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:25.748207 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:25.751589 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:25.751589 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:25.751589 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:25.751589 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:25.751589 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:16:25.751589 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:16:25.751589 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:16:25.751589 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:16:25.751589 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:16:25.751589 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:16:25.751589 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:16:25.751589 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:16:25.751589 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 286/562] 10.222.0.79 () {56 vars in 1102 bytes} [Wed Aug 31 12:16:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:25.751589 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a7807a-b1d9-46c7-969e-b66ae71c147a None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:25.753066 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a7807a-b1d9-46c7-969e-b66ae71c147a None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:25.753066 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a7807a-b1d9-46c7-969e-b66ae71c147a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:25.782595 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-95a7807a-b1d9-46c7-969e-b66ae71c147a None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:25.784299 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-95a7807a-b1d9-46c7-969e-b66ae71c147a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:25.800490 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4511fcf-0e31-4f5c-b3f0-f5de8ccdc06d None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:25.858233 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dc24a3-e94a-46e0-b853-30c0770ca7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:25.859567 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc24a3-e94a-46e0-b853-30c0770ca7c5 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:25.859853 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc24a3-e94a-46e0-b853-30c0770ca7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:25.860126 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc24a3-e94a-46e0-b853-30c0770ca7c5 None admin] PATH_INFO: `/v3/domains` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:25.860883 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dc24a3-e94a-46e0-b853-30c0770ca7c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:25.861268 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dc24a3-e94a-46e0-b853-30c0770ca7c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:25.862793 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dc24a3-e94a-46e0-b853-30c0770ca7c5 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:25.887409 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 277/563] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 12:16:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:25.887409 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dc24a3-e94a-46e0-b853-30c0770ca7c5 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:25.895393 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 287/564] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:16:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:16:25.900801 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a7807a-b1d9-46c7-969e-b66ae71c147a None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:25.990442 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:26.033953 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dc24a3-e94a-46e0-b853-30c0770ca7c5 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:26.046773 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:26.049758 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a7807a-b1d9-46c7-969e-b66ae71c147a None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:26.088196 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ab3a0a-0aed-4ffc-9021-f30869990d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:26.089098 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab3a0a-0aed-4ffc-9021-f30869990d63 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:26.089533 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab3a0a-0aed-4ffc-9021-f30869990d63 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:26.090149 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab3a0a-0aed-4ffc-9021-f30869990d63 None admin] PATH_INFO: `/v3/users` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:26.091134 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ab3a0a-0aed-4ffc-9021-f30869990d63 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:26.091591 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ab3a0a-0aed-4ffc-9021-f30869990d63 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:26.092264 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a3cc26-a000-4ccb-9d00-f1a7de1ba9c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:26.093047 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a3cc26-a000-4ccb-9d00-f1a7de1ba9c6 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:26.093336 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a3cc26-a000-4ccb-9d00-f1a7de1ba9c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:26.093594 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a3cc26-a000-4ccb-9d00-f1a7de1ba9c6 None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:26.093938 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ab3a0a-0aed-4ffc-9021-f30869990d63 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:26.094264 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a3cc26-a000-4ccb-9d00-f1a7de1ba9c6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:26.094562 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a3cc26-a000-4ccb-9d00-f1a7de1ba9c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:26.095981 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a3cc26-a000-4ccb-9d00-f1a7de1ba9c6 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:26.105480 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 288/565] 10.222.0.79 () {56 vars in 1103 bytes} [Wed Aug 31 12:16:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:26.106457 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a3cc26-a000-4ccb-9d00-f1a7de1ba9c6 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:26.126670 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 278/566] 10.222.0.79 () {56 vars in 1133 bytes} [Wed Aug 31 12:16:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:26.129489 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e280da0-a5f1-4481-a235-1790d9344d83 None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:26.129489 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e280da0-a5f1-4481-a235-1790d9344d83 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:26.129489 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e280da0-a5f1-4481-a235-1790d9344d83 None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:26.129489 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 279/567] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:16:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:16:26.134496 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e280da0-a5f1-4481-a235-1790d9344d83 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:26.250720 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a3cc26-a000-4ccb-9d00-f1a7de1ba9c6 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:26.255763 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e280da0-a5f1-4481-a235-1790d9344d83 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:26.272747 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:26.288520 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b49447-abfd-4b5d-849c-a74af50c7597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:26.289764 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b49447-abfd-4b5d-849c-a74af50c7597 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:26.290152 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b49447-abfd-4b5d-849c-a74af50c7597 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:26.290457 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b49447-abfd-4b5d-849c-a74af50c7597 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:26.298225 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4352139-8c62-40e0-82e8-a855bce7ae6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:26.298487 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b49447-abfd-4b5d-849c-a74af50c7597 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:26.299095 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4352139-8c62-40e0-82e8-a855bce7ae6b None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:26.299476 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4352139-8c62-40e0-82e8-a855bce7ae6b None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:26.299743 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b49447-abfd-4b5d-849c-a74af50c7597 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:26.299907 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4352139-8c62-40e0-82e8-a855bce7ae6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:26.312100 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4352139-8c62-40e0-82e8-a855bce7ae6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:26.312384 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-39b49447-abfd-4b5d-849c-a74af50c7597 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:16:26.312384 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:26.312384 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:26.312384 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:26.312384 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:26.312384 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:26.312384 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:26.312384 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:26.312384 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:26.312384 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:26.312384 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:26.312384 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:26.312384 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:16:26.312384 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:16:26.312384 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:16:26.314156 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:16:26.314156 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:26.314156 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:26.314156 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:26.314156 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:26.314156 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:26.314156 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:26.314156 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:26.314156 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:26.314156 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:26.314156 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:26.314156 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:26.314156 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:26.314156 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:26.314156 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:26.314156 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:26.314156 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:26.315679 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:16:26.315679 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:16:26.315679 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:16:26.315679 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:16:26.315679 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:16:26.315679 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:16:26.315679 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:16:26.315679 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:16:26.315679 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 289/568] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 12:16:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:26.315679 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b49447-abfd-4b5d-849c-a74af50c7597 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:26.316232 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4352139-8c62-40e0-82e8-a855bce7ae6b None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:26.337214 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-a4352139-8c62-40e0-82e8-a855bce7ae6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:26.337214 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:26.337214 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:26.337214 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:26.337214 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:26.337214 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:26.337214 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:26.337214 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:26.337214 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:26.337214 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:26.337214 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:26.337214 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:26.337214 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:16:26.337214 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:16:26.337214 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:16:26.337214 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:16:26.338676 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:26.338676 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:26.338676 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:26.338676 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:26.338676 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:26.338676 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:26.338676 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:26.338676 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:26.338676 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:26.338676 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:26.338676 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:26.338676 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:26.338676 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:26.338676 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:26.338676 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:26.338676 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:26.338676 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:16:26.340442 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:16:26.340442 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:26.340442 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:16:26.340442 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 280/569] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:16:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:26.340442 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db16a2-49dd-478d-b3fd-0def7834153c None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:26.340442 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db16a2-49dd-478d-b3fd-0def7834153c None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:26.341081 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db16a2-49dd-478d-b3fd-0def7834153c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:26.368970 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-d4db16a2-49dd-478d-b3fd-0def7834153c None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:26.370187 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-d4db16a2-49dd-478d-b3fd-0def7834153c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:26.384554 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:26.442075 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b49447-abfd-4b5d-849c-a74af50c7597 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:26.453167 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 281/570] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:16:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:16:26.454024 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db16a2-49dd-478d-b3fd-0def7834153c None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:26.496578 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c9552c-1cab-4c0f-a6e5-940652a1f92e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:26.497417 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c9552c-1cab-4c0f-a6e5-940652a1f92e None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:26.497700 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c9552c-1cab-4c0f-a6e5-940652a1f92e None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:26.497973 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c9552c-1cab-4c0f-a6e5-940652a1f92e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:26.510872 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c9552c-1cab-4c0f-a6e5-940652a1f92e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:26.512492 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c9552c-1cab-4c0f-a6e5-940652a1f92e None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:26.532343 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-79c9552c-1cab-4c0f-a6e5-940652a1f92e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:26.532343 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:26.532343 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:26.532343 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:26.532343 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:26.532343 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:26.532343 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:26.532343 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:26.532343 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:26.532343 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:26.532343 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:26.532343 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:26.532343 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:16:26.532343 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:16:26.532343 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:16:26.532343 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:16:26.533347 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:26.533347 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:26.533347 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:26.533347 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:26.533347 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:26.533347 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:26.533347 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:26.533347 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:26.533347 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:26.533347 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:26.533347 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:26.533347 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:26.533347 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:26.533347 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:26.533347 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:26.533347 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:26.533347 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:16:26.534231 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:16:26.534231 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:26.534231 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:16:26.534231 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 290/571] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:16:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:26.534535 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c9552c-1cab-4c0f-a6e5-940652a1f92e None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:26.579246 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db16a2-49dd-478d-b3fd-0def7834153c None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:26.579554 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:26.634332 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e04dab8-8c52-4d07-a924-3f7981638e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:26.635523 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e04dab8-8c52-4d07-a924-3f7981638e0b None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:26.635967 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e04dab8-8c52-4d07-a924-3f7981638e0b None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:26.636475 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e04dab8-8c52-4d07-a924-3f7981638e0b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:26.658095 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e04dab8-8c52-4d07-a924-3f7981638e0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:16:26.668967 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-4e04dab8-8c52-4d07-a924-3f7981638e0b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:16:26.668967 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:26.668967 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:26.668967 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:26.668967 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:26.668967 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:26.668967 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:26.668967 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:26.668967 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:26.668967 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:26.668967 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:26.668967 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:26.668967 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:16:26.668967 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:16:26.668967 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:16:26.668967 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:16:26.670050 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:16:26.670050 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:16:26.670050 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:16:26.670050 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:16:26.670050 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:26.670050 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:26.670050 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:26.670050 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:26.670050 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:26.670050 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:26.670050 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:26.670050 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:26.670050 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:26.670050 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:26.670050 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:26.670050 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:26.671183 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:26.671183 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:26.671183 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:26.671183 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:26.671183 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:16:26.671183 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:16:26.671183 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:16:26.671183 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:16:26.671183 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:16:26.671183 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:16:26.671183 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:16:26.671183 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:16:26.671859 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c9552c-1cab-4c0f-a6e5-940652a1f92e None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:26.679220 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 282/572] 10.222.0.79 () {56 vars in 1102 bytes} [Wed Aug 31 12:16:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:26.681855 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e04dab8-8c52-4d07-a924-3f7981638e0b None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:26.697073 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:26.730444 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4775a358-b0de-4768-9073-b8482c6906bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:26.731123 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775a358-b0de-4768-9073-b8482c6906bd None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:26.732060 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775a358-b0de-4768-9073-b8482c6906bd None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:26.732367 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775a358-b0de-4768-9073-b8482c6906bd None admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:26.733095 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4775a358-b0de-4768-9073-b8482c6906bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:26.733404 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4775a358-b0de-4768-9073-b8482c6906bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:26.734894 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4775a358-b0de-4768-9073-b8482c6906bd None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:26.749289 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 291/573] 10.222.0.79 () {56 vars in 1148 bytes} [Wed Aug 31 12:16:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:26.750147 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4775a358-b0de-4768-9073-b8482c6906bd None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:26.815422 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e04dab8-8c52-4d07-a924-3f7981638e0b None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:26.858282 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9310d459-8340-4cef-a20a-a087a60d4fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:26.858958 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9310d459-8340-4cef-a20a-a087a60d4fe9 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:26.859242 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9310d459-8340-4cef-a20a-a087a60d4fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:26.859516 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9310d459-8340-4cef-a20a-a087a60d4fe9 None admin] PATH_INFO: `/v3/domains` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:26.860210 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9310d459-8340-4cef-a20a-a087a60d4fe9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:26.860517 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9310d459-8340-4cef-a20a-a087a60d4fe9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:26.861955 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9310d459-8340-4cef-a20a-a087a60d4fe9 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:26.874958 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:26.875371 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 283/574] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 12:16:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:26.876241 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9310d459-8340-4cef-a20a-a087a60d4fe9 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:26.885124 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4775a358-b0de-4768-9073-b8482c6906bd None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:26.935619 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd035d3c-569e-488d-b30e-64dee012cdcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:26.936368 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd035d3c-569e-488d-b30e-64dee012cdcd None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:26.936650 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd035d3c-569e-488d-b30e-64dee012cdcd None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:26.936923 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd035d3c-569e-488d-b30e-64dee012cdcd None admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:26.937886 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd035d3c-569e-488d-b30e-64dee012cdcd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:26.938347 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd035d3c-569e-488d-b30e-64dee012cdcd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:26.940899 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd035d3c-569e-488d-b30e-64dee012cdcd None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:26.956994 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:26.962643 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 292/575] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 12:16:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:26.963683 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd035d3c-569e-488d-b30e-64dee012cdcd None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:26.997255 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9310d459-8340-4cef-a20a-a087a60d4fe9 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:27.040284 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af04e2f-9ca5-474f-87b7-d10dda543fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:27.040824 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af04e2f-9ca5-474f-87b7-d10dda543fa4 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:27.041110 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af04e2f-9ca5-474f-87b7-d10dda543fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:27.041385 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af04e2f-9ca5-474f-87b7-d10dda543fa4 None admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:27.042071 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af04e2f-9ca5-474f-87b7-d10dda543fa4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:27.042378 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af04e2f-9ca5-474f-87b7-d10dda543fa4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:27.043827 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af04e2f-9ca5-474f-87b7-d10dda543fa4 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:27.052842 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 284/576] 10.222.0.79 () {56 vars in 1103 bytes} [Wed Aug 31 12:16:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:27.053730 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af04e2f-9ca5-474f-87b7-d10dda543fa4 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:27.082665 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd035d3c-569e-488d-b30e-64dee012cdcd None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:27.121242 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284e7eb7-7d3c-455c-9238-d4c1d64416bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:27.122066 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e7eb7-7d3c-455c-9238-d4c1d64416bd None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:27.122434 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e7eb7-7d3c-455c-9238-d4c1d64416bd None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:27.122778 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e7eb7-7d3c-455c-9238-d4c1d64416bd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:27.137146 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284e7eb7-7d3c-455c-9238-d4c1d64416bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:16:27.142536 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-284e7eb7-7d3c-455c-9238-d4c1d64416bd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:16:27.142536 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:27.142536 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:27.142536 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:27.142536 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:27.142536 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:27.142536 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:27.142536 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:27.142536 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:27.142536 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:27.142536 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:27.142536 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:27.142536 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:16:27.142536 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:16:27.142536 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:16:27.142536 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:16:27.143786 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:16:27.143786 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:16:27.143786 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:16:27.143786 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:16:27.143786 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:27.143786 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:27.143786 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:27.143786 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:27.143786 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:27.143786 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:27.143786 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:27.143786 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:27.143786 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:27.143786 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:27.143786 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:27.143786 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:27.144725 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:27.144725 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:27.144725 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:27.144725 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:27.144725 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:16:27.144725 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:16:27.144725 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:16:27.144725 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:16:27.144725 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:16:27.144725 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:16:27.144725 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:16:27.144725 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:16:27.147017 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 293/577] 10.222.0.79 () {56 vars in 1102 bytes} [Wed Aug 31 12:16:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:27.148960 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284e7eb7-7d3c-455c-9238-d4c1d64416bd None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:27.169645 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:27.183236 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af04e2f-9ca5-474f-87b7-d10dda543fa4 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:27.230467 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:27.237789 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e660e33-20e2-4b2d-af50-d67aa47f850f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:27.238746 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e660e33-20e2-4b2d-af50-d67aa47f850f None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:27.239129 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e660e33-20e2-4b2d-af50-d67aa47f850f None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:27.239468 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e660e33-20e2-4b2d-af50-d67aa47f850f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:27.240287 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e660e33-20e2-4b2d-af50-d67aa47f850f None admin] RBAC: Adding query filter params (role.id=37fee7a104964826a0762987a1531a9a, scope.project.id=a94f4957f2a047cc844342e1c7c74ca5, user.id=4896540cc14f40b08d05ade32cfd0f37) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:27.240802 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e660e33-20e2-4b2d-af50-d67aa47f850f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:27.243326 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e660e33-20e2-4b2d-af50-d67aa47f850f None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:27.249836 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 285/578] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 12:16:27 2022] GET /identity/v3/role_assignments?user.id=4896540cc14f40b08d05ade32cfd0f37&scope.project.id=a94f4957f2a047cc844342e1c7c74ca5&role.id=37fee7a104964826a0762987a1531a9a => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:27.250732 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e660e33-20e2-4b2d-af50-d67aa47f850f None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:27.275381 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284e7eb7-7d3c-455c-9238-d4c1d64416bd None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:27.342499 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6100b03-b981-4e8c-91da-3437ff72c43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:27.343728 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6100b03-b981-4e8c-91da-3437ff72c43c None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:27.344297 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6100b03-b981-4e8c-91da-3437ff72c43c None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:27.344818 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6100b03-b981-4e8c-91da-3437ff72c43c None admin] PATH_INFO: `/v3/users/glance` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:27.356830 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6100b03-b981-4e8c-91da-3437ff72c43c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:27.358339 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6100b03-b981-4e8c-91da-3437ff72c43c None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:27.371970 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-a6100b03-b981-4e8c-91da-3437ff72c43c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 31 12:16:27.371970 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:27.371970 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:27.371970 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:27.371970 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:27.371970 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:27.371970 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:27.371970 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:27.371970 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:27.371970 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:27.371970 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:27.371970 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:27.371970 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:16:27.371970 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:16:27.371970 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:16:27.371970 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:16:27.374014 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:27.374014 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:27.374014 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:16:27.374014 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:16:27.374014 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:16:27.374014 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:16:27.374014 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:27.374014 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:27.374014 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:27.374014 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:27.374014 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:27.374014 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:27.374014 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:27.374014 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:27.374014 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:27.374014 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:27.374014 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:27.374014 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:27.375846 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:27.375846 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:27.375846 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:16:27.375846 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:16:27.375846 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:16:27.375846 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:16:27.375846 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:16:27.375846 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:16:27.375846 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 31 12:16:27.375846 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:16:27.375846 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 294/579] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 12:16:27 2022] GET /identity/v3/users/glance => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:27.375846 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6100b03-b981-4e8c-91da-3437ff72c43c None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:27.430874 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e660e33-20e2-4b2d-af50-d67aa47f850f None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:27.474469 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:27.481367 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee13a13f-4cd1-491e-b67b-aa666ee1a183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:27.482806 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee13a13f-4cd1-491e-b67b-aa666ee1a183 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:27.483279 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee13a13f-4cd1-491e-b67b-aa666ee1a183 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:27.483722 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee13a13f-4cd1-491e-b67b-aa666ee1a183 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:27.494587 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee13a13f-4cd1-491e-b67b-aa666ee1a183 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:27.497592 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee13a13f-4cd1-491e-b67b-aa666ee1a183 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:27.509166 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6100b03-b981-4e8c-91da-3437ff72c43c None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:27.515514 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-ee13a13f-4cd1-491e-b67b-aa666ee1a183 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:16:27.515514 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:27.515514 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:27.515514 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:27.515514 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:27.515514 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:27.515514 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:27.515514 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:27.515514 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:27.515514 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:27.515514 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:27.515514 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:27.515514 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:16:27.515514 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:16:27.515514 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:16:27.516634 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:16:27.516634 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:27.516634 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:27.516634 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:27.516634 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:27.516634 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:27.516634 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:27.516634 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:27.516634 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:27.516634 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:27.516634 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:27.516634 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:27.516634 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:27.516634 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:27.516634 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:27.516634 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:27.516634 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:27.517849 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:16:27.517849 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:16:27.517849 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:16:27.517849 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:16:27.517849 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:16:27.517849 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:16:27.517849 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:16:27.517849 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:16:27.526652 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 286/580] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 12:16:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:27.526652 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee13a13f-4cd1-491e-b67b-aa666ee1a183 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:27.561589 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cb5389-52c3-4831-b236-3102663f6591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:27.562236 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb5389-52c3-4831-b236-3102663f6591 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:27.562633 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb5389-52c3-4831-b236-3102663f6591 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:27.562819 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb5389-52c3-4831-b236-3102663f6591 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:27.578970 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cb5389-52c3-4831-b236-3102663f6591 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:27.581546 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cb5389-52c3-4831-b236-3102663f6591 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:27.603144 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:27.611480 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-64cb5389-52c3-4831-b236-3102663f6591 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:27.611480 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:27.611480 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:27.611480 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:27.611480 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:27.611480 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:27.611480 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:27.611480 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:27.611480 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:27.611480 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:27.611480 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:27.611480 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:27.611480 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:16:27.611480 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:16:27.611480 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:16:27.611480 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:16:27.612697 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:27.612697 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:27.612697 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:27.612697 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:27.612697 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:27.612697 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:27.612697 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:27.612697 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:27.612697 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:27.612697 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:27.612697 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:27.612697 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:27.612697 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:27.612697 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:27.612697 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:27.612697 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:27.612697 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:16:27.620021 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:16:27.620021 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:27.620021 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:16:27.620021 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 295/581] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:16:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:27.620021 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cb5389-52c3-4831-b236-3102663f6591 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:27.680776 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee13a13f-4cd1-491e-b67b-aa666ee1a183 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:27.748158 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6d9141-1d24-48ff-b7f1-975a31c4c07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:27.749509 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d9141-1d24-48ff-b7f1-975a31c4c07a None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:27.750172 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d9141-1d24-48ff-b7f1-975a31c4c07a None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:27.751023 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d9141-1d24-48ff-b7f1-975a31c4c07a None admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:27.752199 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6d9141-1d24-48ff-b7f1-975a31c4c07a None admin] RBAC: Adding query filter params (name=service) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:27.752726 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6d9141-1d24-48ff-b7f1-975a31c4c07a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:27.755494 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6d9141-1d24-48ff-b7f1-975a31c4c07a None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:27.766780 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cb5389-52c3-4831-b236-3102663f6591 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:27.770774 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 287/582] 10.222.0.79 () {56 vars in 1103 bytes} [Wed Aug 31 12:16:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:27.771669 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6d9141-1d24-48ff-b7f1-975a31c4c07a None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:27.799866 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:27.819564 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b55b822-28b2-4066-a1b1-bf08066e53ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:27.821815 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b55b822-28b2-4066-a1b1-bf08066e53ac None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:27.822248 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b55b822-28b2-4066-a1b1-bf08066e53ac None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:27.822640 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b55b822-28b2-4066-a1b1-bf08066e53ac None admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:27.823904 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b55b822-28b2-4066-a1b1-bf08066e53ac None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:27.824264 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b55b822-28b2-4066-a1b1-bf08066e53ac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:27.826263 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b55b822-28b2-4066-a1b1-bf08066e53ac None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:27.856463 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 296/583] 10.222.0.79 () {56 vars in 1137 bytes} [Wed Aug 31 12:16:27 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:27.864891 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b55b822-28b2-4066-a1b1-bf08066e53ac None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:27.933380 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6d9141-1d24-48ff-b7f1-975a31c4c07a None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:27.963331 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:27.996377 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af515c2-bf6e-41fe-a2c5-eda419ef74ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:27.997464 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af515c2-bf6e-41fe-a2c5-eda419ef74ea None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:27.997919 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af515c2-bf6e-41fe-a2c5-eda419ef74ea None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:27.998510 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af515c2-bf6e-41fe-a2c5-eda419ef74ea None admin] PATH_INFO: `/v3/projects` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:27.999819 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af515c2-bf6e-41fe-a2c5-eda419ef74ea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:28.000427 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af515c2-bf6e-41fe-a2c5-eda419ef74ea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:28.003245 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af515c2-bf6e-41fe-a2c5-eda419ef74ea None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:28.030108 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 288/584] 10.222.0.79 () {56 vars in 1148 bytes} [Wed Aug 31 12:16:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:28.030108 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af515c2-bf6e-41fe-a2c5-eda419ef74ea None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:28.040921 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b55b822-28b2-4066-a1b1-bf08066e53ac None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:28.093303 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b10d7b-e562-4c9e-a51e-864e0a1640dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:28.094764 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b10d7b-e562-4c9e-a51e-864e0a1640dc None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:28.095716 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b10d7b-e562-4c9e-a51e-864e0a1640dc None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:28.095828 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b10d7b-e562-4c9e-a51e-864e0a1640dc None admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:28.096858 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b10d7b-e562-4c9e-a51e-864e0a1640dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:28.097395 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b10d7b-e562-4c9e-a51e-864e0a1640dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:28.099502 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b10d7b-e562-4c9e-a51e-864e0a1640dc None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:28.122525 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 297/585] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 12:16:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:28.123643 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b10d7b-e562-4c9e-a51e-864e0a1640dc None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:28.158458 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af515c2-bf6e-41fe-a2c5-eda419ef74ea None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:28.191248 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:28.203444 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329282bc-7d46-41b3-90ac-3e068350a7e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:28.204587 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329282bc-7d46-41b3-90ac-3e068350a7e1 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:28.204865 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329282bc-7d46-41b3-90ac-3e068350a7e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:28.205405 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329282bc-7d46-41b3-90ac-3e068350a7e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:28.217922 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329282bc-7d46-41b3-90ac-3e068350a7e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:28.219444 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329282bc-7d46-41b3-90ac-3e068350a7e1 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:28.237589 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-329282bc-7d46-41b3-90ac-3e068350a7e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:28.237589 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:28.237589 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:28.237589 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:28.237589 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:28.237589 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:28.237589 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:28.237589 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:28.237589 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:28.237589 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:28.237589 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:28.237589 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:28.237589 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:16:28.237589 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:16:28.237589 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:16:28.237589 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:16:28.238943 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:28.238943 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:28.238943 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:28.238943 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:28.238943 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:28.238943 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:28.238943 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:28.238943 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:28.238943 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:28.238943 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:28.238943 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:28.238943 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:28.238943 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:28.238943 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:28.238943 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:28.238943 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:28.238943 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:16:28.239913 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:16:28.239913 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:28.239913 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:16:28.239913 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 289/586] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:16:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:28.239913 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329282bc-7d46-41b3-90ac-3e068350a7e1 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:28.279490 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b10d7b-e562-4c9e-a51e-864e0a1640dc None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:28.283400 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:28.327539 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d108aa4f-3b58-4ee2-bc7d-6a67fa110d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:28.328403 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108aa4f-3b58-4ee2-bc7d-6a67fa110d56 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:28.328403 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108aa4f-3b58-4ee2-bc7d-6a67fa110d56 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:28.328687 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108aa4f-3b58-4ee2-bc7d-6a67fa110d56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:28.344064 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d108aa4f-3b58-4ee2-bc7d-6a67fa110d56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:28.347325 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d108aa4f-3b58-4ee2-bc7d-6a67fa110d56 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:28.368655 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-d108aa4f-3b58-4ee2-bc7d-6a67fa110d56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:28.368655 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:28.368655 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:28.368655 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:28.368655 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:28.368655 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:28.368655 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:28.368655 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:28.368655 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:28.368655 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:28.368655 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:28.368655 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:28.368655 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:16:28.368655 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:16:28.368655 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:16:28.368655 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:16:28.370497 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:28.370497 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:28.370497 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:28.370497 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:28.370497 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:28.370497 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:28.370497 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:28.370497 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:28.370497 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:28.370497 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:28.370497 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:28.370497 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:28.370497 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:28.370497 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:28.370497 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:28.370497 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:28.370497 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:16:28.372374 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:16:28.372374 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:28.372374 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:16:28.372374 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 298/587] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:16:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:28.372374 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d108aa4f-3b58-4ee2-bc7d-6a67fa110d56 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:28.407496 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329282bc-7d46-41b3-90ac-3e068350a7e1 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:28.467926 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e821aa9-8c2b-4dcb-b157-7e9582893e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:28.469081 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e821aa9-8c2b-4dcb-b157-7e9582893e6e None admin] REQUEST_METHOD: `PUT` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:28.469470 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e821aa9-8c2b-4dcb-b157-7e9582893e6e None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:28.469754 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e821aa9-8c2b-4dcb-b157-7e9582893e6e None admin] PATH_INFO: `/v3/projects/a94f4957f2a047cc844342e1c7c74ca5/users/62401c8e1457450590f4147e0665265a/roles/37fee7a104964826a0762987a1531a9a` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:28.501982 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e821aa9-8c2b-4dcb-b157-7e9582893e6e None admin] RBAC: Authorizing `identity:create_grant(project_id=a94f4957f2a047cc844342e1c7c74ca5, user_id=62401c8e1457450590f4147e0665265a, role_id=37fee7a104964826a0762987a1531a9a)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:28.505098 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e821aa9-8c2b-4dcb-b157-7e9582893e6e None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:28.517084 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:28.530908 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d108aa4f-3b58-4ee2-bc7d-6a67fa110d56 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:28.534429 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 290/588] 10.222.0.79 () {58 vars in 1439 bytes} [Wed Aug 31 12:16:28 2022] PUT /identity/v3/projects/a94f4957f2a047cc844342e1c7c74ca5/users/62401c8e1457450590f4147e0665265a/roles/37fee7a104964826a0762987a1531a9a => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:16:28.537842 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e821aa9-8c2b-4dcb-b157-7e9582893e6e None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:28.604031 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54ddeed-c1d6-4f67-8749-e4d1938b4d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:28.605485 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ddeed-c1d6-4f67-8749-e4d1938b4d7d None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:28.606198 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ddeed-c1d6-4f67-8749-e4d1938b4d7d None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:28.606967 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ddeed-c1d6-4f67-8749-e4d1938b4d7d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:28.622827 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54ddeed-c1d6-4f67-8749-e4d1938b4d7d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:28.626097 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54ddeed-c1d6-4f67-8749-e4d1938b4d7d None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:28.648241 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-d54ddeed-c1d6-4f67-8749-e4d1938b4d7d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 12:16:28.648241 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:28.648241 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:28.648241 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:28.648241 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:28.648241 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:28.648241 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:28.648241 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:28.648241 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:28.648241 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:28.648241 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:28.648241 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:28.648241 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:16:28.648241 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:16:28.648241 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:16:28.648241 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:16:28.649922 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:28.649922 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:28.649922 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:16:28.649922 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:16:28.649922 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:16:28.649922 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:16:28.649922 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:28.649922 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:28.649922 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:28.649922 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:28.649922 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:28.649922 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:28.649922 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:28.649922 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:28.649922 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:28.649922 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:28.649922 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:28.649922 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:28.651872 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:28.651872 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:28.651872 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:16:28.651872 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:16:28.651872 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:16:28.651872 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:16:28.651872 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:16:28.651872 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:16:28.651872 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 12:16:28.651872 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:16:28.655731 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 299/589] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 12:16:28 2022] GET /identity/v3/users/cinder => generated 84 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:28.657605 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54ddeed-c1d6-4f67-8749-e4d1938b4d7d None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:28.721916 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:28.769213 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e821aa9-8c2b-4dcb-b157-7e9582893e6e None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:28.814743 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3333a16d-f4ef-4e53-a330-dbda9be51e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:28.815507 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3333a16d-f4ef-4e53-a330-dbda9be51e98 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:28.815848 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3333a16d-f4ef-4e53-a330-dbda9be51e98 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:28.816224 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3333a16d-f4ef-4e53-a330-dbda9be51e98 None admin] PATH_INFO: `/v3/domains` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:28.816972 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3333a16d-f4ef-4e53-a330-dbda9be51e98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:28.817337 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3333a16d-f4ef-4e53-a330-dbda9be51e98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:28.819068 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3333a16d-f4ef-4e53-a330-dbda9be51e98 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:28.839688 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 291/590] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 12:16:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:28.839946 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3333a16d-f4ef-4e53-a330-dbda9be51e98 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:28.864495 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54ddeed-c1d6-4f67-8749-e4d1938b4d7d None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:28.933640 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b61af-5ab6-417e-b229-35014d887b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:28.935202 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b61af-5ab6-417e-b229-35014d887b93 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:28.935925 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b61af-5ab6-417e-b229-35014d887b93 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:28.936608 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b61af-5ab6-417e-b229-35014d887b93 None admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:28.938035 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247b61af-5ab6-417e-b229-35014d887b93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:28.938845 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247b61af-5ab6-417e-b229-35014d887b93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:28.941856 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247b61af-5ab6-417e-b229-35014d887b93 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:28.968252 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 300/591] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 12:16:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:28.970257 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b61af-5ab6-417e-b229-35014d887b93 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:28.971026 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3333a16d-f4ef-4e53-a330-dbda9be51e98 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:29.003608 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:29.017078 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d19e1bc-3e88-4ad7-86d6-21c930526722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:29.018333 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19e1bc-3e88-4ad7-86d6-21c930526722 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:29.018811 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19e1bc-3e88-4ad7-86d6-21c930526722 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:29.019252 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19e1bc-3e88-4ad7-86d6-21c930526722 None admin] PATH_INFO: `/v3/users` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:29.020205 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d19e1bc-3e88-4ad7-86d6-21c930526722 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:29.020660 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d19e1bc-3e88-4ad7-86d6-21c930526722 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:29.022328 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d19e1bc-3e88-4ad7-86d6-21c930526722 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:29.033826 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:29.046642 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 292/592] 10.222.0.79 () {56 vars in 1137 bytes} [Wed Aug 31 12:16:28 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:29.048164 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d19e1bc-3e88-4ad7-86d6-21c930526722 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:29.170251 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d19e1bc-3e88-4ad7-86d6-21c930526722 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:29.187129 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b61af-5ab6-417e-b229-35014d887b93 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:29.212261 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e694ccbb-c881-4892-9634-098ccf4389d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:29.213220 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694ccbb-c881-4892-9634-098ccf4389d5 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:29.213645 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694ccbb-c881-4892-9634-098ccf4389d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:29.214059 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694ccbb-c881-4892-9634-098ccf4389d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:29.222265 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e694ccbb-c881-4892-9634-098ccf4389d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:29.224125 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e694ccbb-c881-4892-9634-098ccf4389d5 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:29.238167 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-e694ccbb-c881-4892-9634-098ccf4389d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:16:29.238167 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:29.238167 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:29.238167 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:29.238167 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:29.238167 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:29.238167 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:29.238167 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:29.238167 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:29.238167 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:29.238167 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:29.238167 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:29.238167 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:16:29.238167 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:16:29.238167 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:16:29.239336 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:16:29.239336 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:29.239336 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:29.239336 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:29.239336 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:29.239336 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:29.239336 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:29.239336 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:29.239336 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:29.239336 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:29.239336 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:29.239336 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:29.239336 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:29.239336 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:29.239336 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:29.239336 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:29.239336 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:29.240370 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:16:29.240370 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:16:29.240370 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:16:29.240370 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:16:29.240370 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:16:29.240370 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:16:29.240370 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:16:29.240370 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:16:29.243134 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 293/593] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 12:16:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:29.244533 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e694ccbb-c881-4892-9634-098ccf4389d5 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:29.261452 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae57d0f6-d4a2-4c8c-a699-3d62dae5bab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:29.262669 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae57d0f6-d4a2-4c8c-a699-3d62dae5bab8 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:29.263284 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae57d0f6-d4a2-4c8c-a699-3d62dae5bab8 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:29.263842 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae57d0f6-d4a2-4c8c-a699-3d62dae5bab8 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:29.277999 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae57d0f6-d4a2-4c8c-a699-3d62dae5bab8 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:29.280916 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae57d0f6-d4a2-4c8c-a699-3d62dae5bab8 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:29.305175 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-ae57d0f6-d4a2-4c8c-a699-3d62dae5bab8 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 12:16:29.305175 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:29.305175 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:29.305175 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:29.305175 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:29.305175 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:29.305175 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:29.305175 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:29.305175 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:29.305175 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:29.305175 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:29.305175 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:29.305175 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:16:29.305175 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:16:29.305175 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:16:29.305175 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:16:29.306569 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:29.306569 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:29.306569 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:16:29.306569 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:16:29.306569 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:16:29.306569 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:16:29.306569 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:29.306569 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:29.306569 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:29.306569 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:29.306569 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:29.306569 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:29.306569 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:29.306569 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:29.306569 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:29.306569 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:29.306569 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:29.306569 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:29.312472 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:29.312472 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:29.312472 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:16:29.312472 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:16:29.312472 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:16:29.312472 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:16:29.312472 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:16:29.312472 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:16:29.312472 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 12:16:29.312472 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:16:29.312472 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 301/594] 10.222.0.79 () {56 vars in 1102 bytes} [Wed Aug 31 12:16:28 2022] GET /identity/v3/users/neutron => generated 85 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:29.312472 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae57d0f6-d4a2-4c8c-a699-3d62dae5bab8 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:29.316251 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:29.370327 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e694ccbb-c881-4892-9634-098ccf4389d5 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:29.414484 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312b5db2-b253-4ef7-8769-19ec2a4230ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:29.415186 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312b5db2-b253-4ef7-8769-19ec2a4230ed None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:29.415493 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312b5db2-b253-4ef7-8769-19ec2a4230ed None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:29.415728 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312b5db2-b253-4ef7-8769-19ec2a4230ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:29.429618 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312b5db2-b253-4ef7-8769-19ec2a4230ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:29.431332 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312b5db2-b253-4ef7-8769-19ec2a4230ed None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:29.454457 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:29.462176 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-312b5db2-b253-4ef7-8769-19ec2a4230ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:29.462176 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:29.462176 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:29.462176 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:29.462176 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:29.462176 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:29.462176 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:29.462176 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:29.462176 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:29.462176 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:29.462176 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:29.462176 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:29.462176 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:16:29.462176 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:16:29.462176 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:16:29.462176 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:16:29.463971 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:29.463971 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:29.463971 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:29.463971 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:29.463971 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:29.463971 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:29.463971 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:29.463971 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:29.463971 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:29.463971 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:29.463971 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:29.463971 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:29.463971 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:29.463971 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:29.463971 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:29.463971 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:29.463971 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:16:29.465622 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:16:29.465622 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:29.465622 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:16:29.465622 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 294/595] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:16:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:29.467429 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5add53f-d4e2-4188-a9cf-b49aba5b26b3 None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:29.467429 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5add53f-d4e2-4188-a9cf-b49aba5b26b3 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:29.467429 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5add53f-d4e2-4188-a9cf-b49aba5b26b3 None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:29.470329 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 295/596] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:16:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:16:29.474727 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5add53f-d4e2-4188-a9cf-b49aba5b26b3 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:29.497698 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae57d0f6-d4a2-4c8c-a699-3d62dae5bab8 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:29.543551 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322aa179-3da8-4355-ae92-8ae94c94ae40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:29.544367 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322aa179-3da8-4355-ae92-8ae94c94ae40 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:29.544788 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322aa179-3da8-4355-ae92-8ae94c94ae40 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:29.545212 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322aa179-3da8-4355-ae92-8ae94c94ae40 None admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:29.546070 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322aa179-3da8-4355-ae92-8ae94c94ae40 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:29.546500 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322aa179-3da8-4355-ae92-8ae94c94ae40 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:29.548738 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322aa179-3da8-4355-ae92-8ae94c94ae40 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:29.570765 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 302/597] 10.222.0.79 () {56 vars in 1148 bytes} [Wed Aug 31 12:16:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:29.570765 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322aa179-3da8-4355-ae92-8ae94c94ae40 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:29.662621 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5add53f-d4e2-4188-a9cf-b49aba5b26b3 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:29.680883 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:29.725549 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcae5fd7-0e8d-4e70-b0dc-65101b48f8c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:29.726944 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcae5fd7-0e8d-4e70-b0dc-65101b48f8c1 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:29.727368 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcae5fd7-0e8d-4e70-b0dc-65101b48f8c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:29.727767 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcae5fd7-0e8d-4e70-b0dc-65101b48f8c1 None admin] PATH_INFO: `/v3/users` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:29.729379 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcae5fd7-0e8d-4e70-b0dc-65101b48f8c1 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:29.729379 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcae5fd7-0e8d-4e70-b0dc-65101b48f8c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:29.731052 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcae5fd7-0e8d-4e70-b0dc-65101b48f8c1 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:29.752002 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322aa179-3da8-4355-ae92-8ae94c94ae40 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:29.754736 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 296/598] 10.222.0.79 () {56 vars in 1139 bytes} [Wed Aug 31 12:16:29 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:29.757309 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc246bc-e1e8-4277-87a8-2eb4968af2bb None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:29.758417 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc246bc-e1e8-4277-87a8-2eb4968af2bb None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:29.758915 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc246bc-e1e8-4277-87a8-2eb4968af2bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:29.783942 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-3fc246bc-e1e8-4277-87a8-2eb4968af2bb None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:29.785539 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-3fc246bc-e1e8-4277-87a8-2eb4968af2bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:29.828903 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbde0d1e-3766-453d-97ed-5ca3c0509139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:29.829621 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde0d1e-3766-453d-97ed-5ca3c0509139 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:29.829990 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde0d1e-3766-453d-97ed-5ca3c0509139 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:29.830296 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde0d1e-3766-453d-97ed-5ca3c0509139 None admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:29.831174 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbde0d1e-3766-453d-97ed-5ca3c0509139 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:29.831534 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbde0d1e-3766-453d-97ed-5ca3c0509139 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:29.833231 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbde0d1e-3766-453d-97ed-5ca3c0509139 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:29.835224 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:29.855112 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 303/599] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 12:16:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:29.855112 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbde0d1e-3766-453d-97ed-5ca3c0509139 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:29.914114 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 297/600] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:16:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:16:29.918025 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc246bc-e1e8-4277-87a8-2eb4968af2bb None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:30.057988 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbde0d1e-3766-453d-97ed-5ca3c0509139 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:30.098485 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:30.110105 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc246bc-e1e8-4277-87a8-2eb4968af2bb None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:30.134081 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37cea51-4a0b-498d-a1e0-675d03f4622c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:30.135595 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37cea51-4a0b-498d-a1e0-675d03f4622c None admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:30.136456 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37cea51-4a0b-498d-a1e0-675d03f4622c None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:30.137193 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37cea51-4a0b-498d-a1e0-675d03f4622c None admin] PATH_INFO: `/v3/projects/a94f4957f2a047cc844342e1c7c74ca5/users/d8b3bb8f689b45b99ed43f672264a26d/roles/37fee7a104964826a0762987a1531a9a` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:30.168187 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37cea51-4a0b-498d-a1e0-675d03f4622c None admin] RBAC: Authorizing `identity:create_grant(project_id=a94f4957f2a047cc844342e1c7c74ca5, user_id=d8b3bb8f689b45b99ed43f672264a26d, role_id=37fee7a104964826a0762987a1531a9a)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:30.171723 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37cea51-4a0b-498d-a1e0-675d03f4622c None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:30.174808 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb97bd5-d635-433d-a9ff-a6556729a251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:30.175914 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb97bd5-d635-433d-a9ff-a6556729a251 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:30.176389 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb97bd5-d635-433d-a9ff-a6556729a251 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:30.177091 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb97bd5-d635-433d-a9ff-a6556729a251 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:30.197887 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb97bd5-d635-433d-a9ff-a6556729a251 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:30.200196 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 304/601] 10.222.0.79 () {58 vars in 1439 bytes} [Wed Aug 31 12:16:29 2022] PUT /identity/v3/projects/a94f4957f2a047cc844342e1c7c74ca5/users/d8b3bb8f689b45b99ed43f672264a26d/roles/37fee7a104964826a0762987a1531a9a => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:16:30.202055 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37cea51-4a0b-498d-a1e0-675d03f4622c None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:30.207134 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb97bd5-d635-433d-a9ff-a6556729a251 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:30.249939 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-2eb97bd5-d635-433d-a9ff-a6556729a251 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:30.249939 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:30.249939 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:30.249939 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:30.249939 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:30.249939 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:30.249939 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:30.249939 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:30.249939 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:30.249939 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:30.249939 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:30.249939 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:30.249939 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:16:30.249939 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:16:30.249939 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:16:30.249939 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:16:30.251957 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:30.251957 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:30.251957 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:30.251957 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:30.251957 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:30.251957 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:30.251957 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:30.251957 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:30.251957 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:30.251957 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:30.251957 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:30.251957 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:30.251957 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:30.251957 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:30.251957 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:30.251957 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:30.251957 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:16:30.253758 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:16:30.253758 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:30.253758 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:16:30.259643 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 298/602] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:16:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:30.269001 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb97bd5-d635-433d-a9ff-a6556729a251 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:30.309673 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:30.462480 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37cea51-4a0b-498d-a1e0-675d03f4622c None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:30.548848 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923d3501-5792-417e-a63c-f184891d26e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:30.549683 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d3501-5792-417e-a63c-f184891d26e3 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:30.550151 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d3501-5792-417e-a63c-f184891d26e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:30.550692 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d3501-5792-417e-a63c-f184891d26e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:30.562186 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923d3501-5792-417e-a63c-f184891d26e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:30.564876 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923d3501-5792-417e-a63c-f184891d26e3 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:30.575624 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb97bd5-d635-433d-a9ff-a6556729a251 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:30.587986 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-923d3501-5792-417e-a63c-f184891d26e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:16:30.587986 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:30.587986 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:30.587986 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:30.587986 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:30.587986 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:30.587986 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:30.587986 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:30.587986 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:30.587986 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:30.587986 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:30.587986 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:30.587986 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:16:30.587986 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:16:30.587986 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:16:30.589999 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:16:30.589999 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:30.589999 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:30.589999 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:30.589999 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:30.589999 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:30.589999 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:30.589999 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:30.589999 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:30.589999 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:30.589999 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:30.589999 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:30.589999 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:30.589999 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:30.589999 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:30.589999 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:30.589999 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:30.592092 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:16:30.592092 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:16:30.592092 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:16:30.592092 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:16:30.592092 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:16:30.592092 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:16:30.592092 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:16:30.592092 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:16:30.599037 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 305/603] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 12:16:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 393 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:30.600834 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923d3501-5792-417e-a63c-f184891d26e3 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:30.649120 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94a6077-a568-405b-bb96-f2cd61e853d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:30.650286 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a6077-a568-405b-bb96-f2cd61e853d4 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:30.650999 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a6077-a568-405b-bb96-f2cd61e853d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:30.651538 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a6077-a568-405b-bb96-f2cd61e853d4 None admin] PATH_INFO: `/v3/domains` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:30.652900 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94a6077-a568-405b-bb96-f2cd61e853d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:30.653579 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94a6077-a568-405b-bb96-f2cd61e853d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:30.656288 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94a6077-a568-405b-bb96-f2cd61e853d4 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:30.678652 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 299/604] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 12:16:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 411 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:16:30.683454 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94a6077-a568-405b-bb96-f2cd61e853d4 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:30.713260 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:30.817961 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923d3501-5792-417e-a63c-f184891d26e3 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:30.824011 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:30.887511 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94a6077-a568-405b-bb96-f2cd61e853d4 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:30.896959 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53837728-92f6-4f36-869f-6f64dfbde403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:30.899053 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53837728-92f6-4f36-869f-6f64dfbde403 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:30.899821 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53837728-92f6-4f36-869f-6f64dfbde403 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:30.900531 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53837728-92f6-4f36-869f-6f64dfbde403 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:30.921994 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53837728-92f6-4f36-869f-6f64dfbde403 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:16:30.931448 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-53837728-92f6-4f36-869f-6f64dfbde403 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:16:30.931448 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:30.931448 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:30.931448 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:30.931448 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:30.931448 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:30.931448 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:30.931448 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:30.931448 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:30.931448 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:30.931448 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:30.931448 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:30.931448 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:16:30.931448 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:16:30.931448 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:16:30.931448 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:16:30.932655 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:16:30.932655 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:16:30.932655 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:16:30.932655 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:16:30.932655 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:30.932655 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:30.932655 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:30.932655 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:30.932655 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:30.932655 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:30.932655 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:30.932655 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:30.932655 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:30.932655 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:30.932655 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:30.932655 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:30.933687 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:30.933687 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:30.933687 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:30.933687 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:30.933687 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:16:30.933687 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:16:30.933687 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:16:30.933687 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:16:30.933687 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:16:30.933687 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:16:30.933687 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:16:30.933687 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:16:30.933687 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 306/605] 10.222.0.79 () {56 vars in 1102 bytes} [Wed Aug 31 12:16:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:30.934953 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53837728-92f6-4f36-869f-6f64dfbde403 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:30.953613 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df3bfc7-1ab8-46d6-9b3b-17ac5af363d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:30.954495 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df3bfc7-1ab8-46d6-9b3b-17ac5af363d3 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:30.954836 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df3bfc7-1ab8-46d6-9b3b-17ac5af363d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:30.955187 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df3bfc7-1ab8-46d6-9b3b-17ac5af363d3 None admin] PATH_INFO: `/v3/projects` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:30.955915 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df3bfc7-1ab8-46d6-9b3b-17ac5af363d3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:30.956248 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df3bfc7-1ab8-46d6-9b3b-17ac5af363d3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:30.957838 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df3bfc7-1ab8-46d6-9b3b-17ac5af363d3 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:30.986965 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 300/606] 10.222.0.79 () {56 vars in 1148 bytes} [Wed Aug 31 12:16:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:30.986965 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6976825-bb14-4993-aaea-db2303c1d4c7 None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:30.986965 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6976825-bb14-4993-aaea-db2303c1d4c7 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:30.986965 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6976825-bb14-4993-aaea-db2303c1d4c7 None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:30.986965 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 301/607] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:16:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:16:30.986965 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6976825-bb14-4993-aaea-db2303c1d4c7 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:31.115924 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:31.135353 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53837728-92f6-4f36-869f-6f64dfbde403 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:31.183833 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6976825-bb14-4993-aaea-db2303c1d4c7 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:31.203931 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d67c440-ffa9-4388-88ec-7d03190c8551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:31.205115 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d67c440-ffa9-4388-88ec-7d03190c8551 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:31.205610 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d67c440-ffa9-4388-88ec-7d03190c8551 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:31.206077 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d67c440-ffa9-4388-88ec-7d03190c8551 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:31.220684 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d67c440-ffa9-4388-88ec-7d03190c8551 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:31.223420 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d67c440-ffa9-4388-88ec-7d03190c8551 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:31.244309 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-6d67c440-ffa9-4388-88ec-7d03190c8551 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:16:31.244309 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:31.244309 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:31.244309 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:31.244309 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:31.244309 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:31.244309 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:31.244309 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:31.244309 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:31.244309 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:31.244309 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:31.244309 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:31.244309 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:16:31.244309 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:16:31.244309 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:16:31.246009 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:16:31.246009 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:31.246009 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:31.246009 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:31.246009 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:31.246009 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:31.246009 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:31.246009 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:31.246009 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:31.246009 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:31.246009 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:31.246009 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:31.246009 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:31.246009 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:31.246009 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:31.246009 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:31.246009 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:31.248687 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:16:31.248687 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:16:31.248687 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:16:31.248687 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:16:31.248687 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:16:31.248687 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:16:31.248687 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:16:31.248687 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:16:31.248687 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 307/608] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 12:16:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:31.248687 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d67c440-ffa9-4388-88ec-7d03190c8551 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:31.261240 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f860be4-7309-4aed-a782-37f03b6e91b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:31.262317 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f860be4-7309-4aed-a782-37f03b6e91b3 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:31.262796 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f860be4-7309-4aed-a782-37f03b6e91b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:31.263266 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f860be4-7309-4aed-a782-37f03b6e91b3 None admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:31.264456 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f860be4-7309-4aed-a782-37f03b6e91b3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:31.264954 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f860be4-7309-4aed-a782-37f03b6e91b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:31.267542 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f860be4-7309-4aed-a782-37f03b6e91b3 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:31.284153 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 302/609] 10.222.0.79 () {56 vars in 1103 bytes} [Wed Aug 31 12:16:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:31.286138 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c8a5d3-7633-4c1a-8f7e-51ecdbb01642 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:31.286624 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c8a5d3-7633-4c1a-8f7e-51ecdbb01642 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:31.287141 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c8a5d3-7633-4c1a-8f7e-51ecdbb01642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:31.294584 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:31.314642 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-29c8a5d3-7633-4c1a-8f7e-51ecdbb01642 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:31.316526 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-29c8a5d3-7633-4c1a-8f7e-51ecdbb01642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:31.435825 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 303/610] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:16:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:16:31.436920 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c8a5d3-7633-4c1a-8f7e-51ecdbb01642 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:31.456886 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d67c440-ffa9-4388-88ec-7d03190c8551 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:31.517843 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8de11b3-59cb-4344-b3e5-b4f42be94816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:31.519407 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de11b3-59cb-4344-b3e5-b4f42be94816 None admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:31.520070 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de11b3-59cb-4344-b3e5-b4f42be94816 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:31.520719 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de11b3-59cb-4344-b3e5-b4f42be94816 None admin] PATH_INFO: `/v3/projects/a94f4957f2a047cc844342e1c7c74ca5/users/e79503178ac54e62ba385467d5617ea1/roles/37fee7a104964826a0762987a1531a9a` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:31.555001 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8de11b3-59cb-4344-b3e5-b4f42be94816 None admin] RBAC: Authorizing `identity:create_grant(project_id=a94f4957f2a047cc844342e1c7c74ca5, user_id=e79503178ac54e62ba385467d5617ea1, role_id=37fee7a104964826a0762987a1531a9a)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:31.558323 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8de11b3-59cb-4344-b3e5-b4f42be94816 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:31.566890 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:31.595003 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 308/611] 10.222.0.79 () {58 vars in 1439 bytes} [Wed Aug 31 12:16:31 2022] PUT /identity/v3/projects/a94f4957f2a047cc844342e1c7c74ca5/users/e79503178ac54e62ba385467d5617ea1/roles/37fee7a104964826a0762987a1531a9a => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:16:31.596868 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8de11b3-59cb-4344-b3e5-b4f42be94816 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:31.628893 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c8a5d3-7633-4c1a-8f7e-51ecdbb01642 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:31.697574 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894db235-d92c-4265-aa4a-caa633b1acf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:31.698187 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894db235-d92c-4265-aa4a-caa633b1acf0 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:31.698458 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894db235-d92c-4265-aa4a-caa633b1acf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:31.698723 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894db235-d92c-4265-aa4a-caa633b1acf0 None admin] PATH_INFO: `/v3/projects` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:31.699488 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894db235-d92c-4265-aa4a-caa633b1acf0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:31.699791 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894db235-d92c-4265-aa4a-caa633b1acf0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:31.701315 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894db235-d92c-4265-aa4a-caa633b1acf0 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:31.731145 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 304/612] 10.222.0.79 () {56 vars in 1148 bytes} [Wed Aug 31 12:16:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:31.741103 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894db235-d92c-4265-aa4a-caa633b1acf0 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:31.818235 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:31.881422 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8de11b3-59cb-4344-b3e5-b4f42be94816 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:31.897667 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894db235-d92c-4265-aa4a-caa633b1acf0 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:31.925881 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:31.947537 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4db03c-c239-4fc1-9d36-f3789e32451c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:31.948790 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4db03c-c239-4fc1-9d36-f3789e32451c None admin] REQUEST_METHOD: `PUT` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:31.949303 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4db03c-c239-4fc1-9d36-f3789e32451c None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:31.949986 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4db03c-c239-4fc1-9d36-f3789e32451c None admin] PATH_INFO: `/v3/projects/a94f4957f2a047cc844342e1c7c74ca5/users/1569b43c774c45ff80577d879ba9d819/roles/37fee7a104964826a0762987a1531a9a` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:31.951717 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cc5e83-bff7-4e2c-8026-927bfd52eb55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:31.952908 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cc5e83-bff7-4e2c-8026-927bfd52eb55 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:31.953634 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cc5e83-bff7-4e2c-8026-927bfd52eb55 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:31.954226 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cc5e83-bff7-4e2c-8026-927bfd52eb55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:31.970301 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4db03c-c239-4fc1-9d36-f3789e32451c None admin] RBAC: Authorizing `identity:create_grant(project_id=a94f4957f2a047cc844342e1c7c74ca5, user_id=1569b43c774c45ff80577d879ba9d819, role_id=37fee7a104964826a0762987a1531a9a)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:31.971046 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cc5e83-bff7-4e2c-8026-927bfd52eb55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:31.972267 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4db03c-c239-4fc1-9d36-f3789e32451c None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:31.972754 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cc5e83-bff7-4e2c-8026-927bfd52eb55 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:31.990512 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 305/613] 10.222.0.79 () {58 vars in 1439 bytes} [Wed Aug 31 12:16:31 2022] PUT /identity/v3/projects/a94f4957f2a047cc844342e1c7c74ca5/users/1569b43c774c45ff80577d879ba9d819/roles/37fee7a104964826a0762987a1531a9a => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:16:31.992279 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4db03c-c239-4fc1-9d36-f3789e32451c None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:31.995435 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-a1cc5e83-bff7-4e2c-8026-927bfd52eb55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:31.995435 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:31.995435 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:31.995435 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:31.995435 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:31.995435 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:31.995435 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:31.995435 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:31.995435 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:31.995435 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:31.995435 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:31.995435 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:31.995435 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:16:31.995435 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:16:31.995435 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:16:31.995435 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:16:31.996571 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:31.996571 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:31.996571 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:31.996571 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:31.996571 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:31.996571 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:31.996571 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:31.996571 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:31.996571 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:31.996571 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:31.996571 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:31.996571 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:31.996571 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:31.996571 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:31.996571 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:31.996571 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:31.996571 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:16:31.997499 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:16:31.997499 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:31.997499 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:16:31.999051 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 309/614] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:16:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 402 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:32.006079 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cc5e83-bff7-4e2c-8026-927bfd52eb55 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:32.147586 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4db03c-c239-4fc1-9d36-f3789e32451c None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:32.196747 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b707ff-2d3e-4f8a-93d9-da8b49a9aa59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:32.198022 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b707ff-2d3e-4f8a-93d9-da8b49a9aa59 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:32.198495 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b707ff-2d3e-4f8a-93d9-da8b49a9aa59 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:32.199045 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b707ff-2d3e-4f8a-93d9-da8b49a9aa59 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:32.215316 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b707ff-2d3e-4f8a-93d9-da8b49a9aa59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:16:32.221451 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-36b707ff-2d3e-4f8a-93d9-da8b49a9aa59 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:16:32.221451 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:32.221451 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:32.221451 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:32.221451 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:32.221451 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:32.221451 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:32.221451 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:32.221451 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:32.221451 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:32.221451 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:32.221451 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:32.221451 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:16:32.221451 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:16:32.221451 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:16:32.221451 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:16:32.222487 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:16:32.222487 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:16:32.222487 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:16:32.222487 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:16:32.222487 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:32.222487 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:32.222487 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:32.222487 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:32.222487 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:32.222487 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:32.222487 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:32.222487 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:32.222487 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:32.222487 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:32.222487 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:32.222487 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:32.223403 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:32.223403 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:32.223403 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:32.223403 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:32.223403 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:16:32.223403 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:16:32.223403 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:16:32.223403 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:16:32.223403 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:16:32.223403 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:16:32.223403 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:16:32.223403 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:16:32.227569 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 306/615] 10.222.0.79 () {56 vars in 1102 bytes} [Wed Aug 31 12:16:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:32.235308 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b707ff-2d3e-4f8a-93d9-da8b49a9aa59 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:32.246892 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cc5e83-bff7-4e2c-8026-927bfd52eb55 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:32.295259 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:32.311784 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:32.329869 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e7d83c-634d-4037-a13d-4e2afd7768bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:32.330652 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7d83c-634d-4037-a13d-4e2afd7768bf None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:32.331083 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7d83c-634d-4037-a13d-4e2afd7768bf None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:32.331473 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7d83c-634d-4037-a13d-4e2afd7768bf None admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:32.332584 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e7d83c-634d-4037-a13d-4e2afd7768bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:32.332799 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e7d83c-634d-4037-a13d-4e2afd7768bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:32.334357 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e7d83c-634d-4037-a13d-4e2afd7768bf None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:32.353969 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 310/616] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 12:16:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:32.365856 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e7d83c-634d-4037-a13d-4e2afd7768bf None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:32.451604 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b707ff-2d3e-4f8a-93d9-da8b49a9aa59 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:32.550921 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4a45e5-b2d6-4407-b893-982b28ea83c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:32.551538 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a45e5-b2d6-4407-b893-982b28ea83c9 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:32.551824 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a45e5-b2d6-4407-b893-982b28ea83c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:32.552095 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a45e5-b2d6-4407-b893-982b28ea83c9 None admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:32.552792 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4a45e5-b2d6-4407-b893-982b28ea83c9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:32.553095 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4a45e5-b2d6-4407-b893-982b28ea83c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:32.554891 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4a45e5-b2d6-4407-b893-982b28ea83c9 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:32.577562 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e7d83c-634d-4037-a13d-4e2afd7768bf None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:32.581645 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 307/617] 10.222.0.79 () {56 vars in 1103 bytes} [Wed Aug 31 12:16:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:32.587782 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4a45e5-b2d6-4407-b893-982b28ea83c9 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:32.665306 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450c059f-1865-4b0b-90c8-c9eca167df6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:32.666463 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c059f-1865-4b0b-90c8-c9eca167df6f None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:32.667001 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c059f-1865-4b0b-90c8-c9eca167df6f None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:32.667548 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c059f-1865-4b0b-90c8-c9eca167df6f None admin] PATH_INFO: `/v3/users/swift` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:32.692760 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450c059f-1865-4b0b-90c8-c9eca167df6f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:32.696126 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450c059f-1865-4b0b-90c8-c9eca167df6f None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:32.732910 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:32.746635 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-450c059f-1865-4b0b-90c8-c9eca167df6f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 12:16:32.746635 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:32.746635 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:32.746635 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:32.746635 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:32.746635 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:32.746635 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:32.746635 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:32.746635 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:32.746635 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:32.746635 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:32.746635 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:32.746635 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:16:32.746635 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:16:32.746635 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:16:32.746635 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:16:32.748580 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:32.748580 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:32.748580 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:16:32.748580 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:16:32.748580 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:16:32.748580 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:16:32.748580 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:32.748580 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:32.748580 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:32.748580 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:32.748580 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:32.748580 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:32.748580 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:32.748580 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:32.748580 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:32.748580 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:32.748580 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:32.748580 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:32.750586 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:32.750586 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:32.750586 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:16:32.750586 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:16:32.750586 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:16:32.750586 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:16:32.750586 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:16:32.750586 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:16:32.750586 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 12:16:32.750586 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:16:32.750586 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 311/618] 10.222.0.79 () {56 vars in 1096 bytes} [Wed Aug 31 12:16:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 384 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:16:32.752660 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4a45e5-b2d6-4407-b893-982b28ea83c9 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:32.758414 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450c059f-1865-4b0b-90c8-c9eca167df6f None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:32.795868 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dabb22d-35e4-4055-9b10-2e435b347815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:32.796795 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dabb22d-35e4-4055-9b10-2e435b347815 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:32.797227 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dabb22d-35e4-4055-9b10-2e435b347815 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:32.797646 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dabb22d-35e4-4055-9b10-2e435b347815 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:32.815017 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dabb22d-35e4-4055-9b10-2e435b347815 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:32.816808 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dabb22d-35e4-4055-9b10-2e435b347815 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:32.842419 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-1dabb22d-35e4-4055-9b10-2e435b347815 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:32.842419 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:32.842419 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:32.842419 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:32.842419 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:32.842419 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:32.842419 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:32.842419 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:32.842419 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:32.842419 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:32.842419 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:32.842419 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:32.842419 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:16:32.842419 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:16:32.842419 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:16:32.842419 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:16:32.843599 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:32.843599 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:32.843599 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:32.843599 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:32.843599 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:32.843599 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:32.843599 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:32.843599 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:32.843599 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:32.843599 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:32.843599 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:32.843599 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:32.843599 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:32.843599 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:32.843599 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:32.843599 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:32.843599 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:16:32.844625 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:16:32.844625 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:32.844625 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:16:32.857920 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 308/619] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:16:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:16:32.861670 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dabb22d-35e4-4055-9b10-2e435b347815 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:32.882095 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:33.010261 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450c059f-1865-4b0b-90c8-c9eca167df6f None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:33.084558 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a1cbe8-9f6f-4ec8-ae60-d74419549d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:33.085876 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a1cbe8-9f6f-4ec8-ae60-d74419549d5d None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:33.086650 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a1cbe8-9f6f-4ec8-ae60-d74419549d5d None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:33.087180 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a1cbe8-9f6f-4ec8-ae60-d74419549d5d None admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:33.088617 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a1cbe8-9f6f-4ec8-ae60-d74419549d5d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:33.089158 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a1cbe8-9f6f-4ec8-ae60-d74419549d5d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:33.091752 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a1cbe8-9f6f-4ec8-ae60-d74419549d5d None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:33.106449 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dabb22d-35e4-4055-9b10-2e435b347815 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:33.148847 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 312/620] 10.222.0.79 () {56 vars in 1135 bytes} [Wed Aug 31 12:16:32 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 392 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:33.157245 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a1cbe8-9f6f-4ec8-ae60-d74419549d5d None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:33.212362 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76dd026-2c4d-4687-9544-7077bec570ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:33.213401 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76dd026-2c4d-4687-9544-7077bec570ae None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:33.214007 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76dd026-2c4d-4687-9544-7077bec570ae None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:33.214480 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76dd026-2c4d-4687-9544-7077bec570ae None admin] PATH_INFO: `/v3/domains` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:33.215684 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76dd026-2c4d-4687-9544-7077bec570ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:33.216229 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76dd026-2c4d-4687-9544-7077bec570ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:33.218787 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76dd026-2c4d-4687-9544-7077bec570ae None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:33.265117 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 309/621] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 12:16:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 404 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:33.274706 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76dd026-2c4d-4687-9544-7077bec570ae None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:33.281713 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:33.446374 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a1cbe8-9f6f-4ec8-ae60-d74419549d5d None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:33.449243 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:33.506170 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76dd026-2c4d-4687-9544-7077bec570ae None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:33.523913 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fec4ec-a841-41bf-8913-784e2a387674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:33.524580 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fec4ec-a841-41bf-8913-784e2a387674 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:33.524875 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fec4ec-a841-41bf-8913-784e2a387674 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:33.525113 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fec4ec-a841-41bf-8913-784e2a387674 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:33.551329 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fec4ec-a841-41bf-8913-784e2a387674 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:33.552820 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fec4ec-a841-41bf-8913-784e2a387674 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:33.583378 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-d6fec4ec-a841-41bf-8913-784e2a387674 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:33.583378 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:33.583378 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:33.583378 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:33.583378 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:33.583378 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:33.583378 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:33.583378 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:33.583378 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:33.583378 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:33.583378 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:33.583378 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:33.583378 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:16:33.583378 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:16:33.583378 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:16:33.583378 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:16:33.584415 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:33.584415 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:33.584415 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:33.584415 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:33.584415 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:33.584415 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:33.584415 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:33.584415 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:33.584415 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:33.584415 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:33.584415 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:33.584415 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:33.584415 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:33.584415 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:33.584415 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:33.584415 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:33.584415 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:16:33.585329 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:16:33.585329 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:33.585329 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:16:33.587396 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 313/622] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:16:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 430 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:16:33.594924 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fec4ec-a841-41bf-8913-784e2a387674 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:33.596923 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5402eb94-86ce-4f21-bc98-73510332e0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:33.597584 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402eb94-86ce-4f21-bc98-73510332e0f3 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:33.597865 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402eb94-86ce-4f21-bc98-73510332e0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:33.598134 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402eb94-86ce-4f21-bc98-73510332e0f3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:33.615821 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5402eb94-86ce-4f21-bc98-73510332e0f3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:33.617862 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5402eb94-86ce-4f21-bc98-73510332e0f3 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:33.640352 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-5402eb94-86ce-4f21-bc98-73510332e0f3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 12:16:33.640352 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:33.640352 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:33.640352 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:33.640352 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:33.640352 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:33.640352 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:33.640352 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:33.640352 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:33.640352 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:33.640352 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:33.640352 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:33.640352 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:16:33.640352 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:16:33.640352 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:16:33.640352 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:16:33.642639 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:33.642639 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:33.642639 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:16:33.642639 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:16:33.642639 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:16:33.642639 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:16:33.642639 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:33.642639 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:33.642639 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:33.642639 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:33.642639 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:33.642639 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:33.642639 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:33.642639 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:33.642639 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:33.642639 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:33.642639 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:33.642639 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:33.644858 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:33.644858 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:33.644858 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:16:33.644858 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:16:33.644858 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:16:33.644858 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:16:33.644858 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:16:33.644858 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:16:33.644858 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 12:16:33.644858 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:16:33.644858 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 310/623] 10.222.0.79 () {56 vars in 1093 bytes} [Wed Aug 31 12:16:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:16:33.652235 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5402eb94-86ce-4f21-bc98-73510332e0f3 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:33.728570 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:33.752008 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fec4ec-a841-41bf-8913-784e2a387674 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:33.773826 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5402eb94-86ce-4f21-bc98-73510332e0f3 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:33.792562 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc6661d-36ff-48c8-b77b-b89e4dfee15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:33.793176 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc6661d-36ff-48c8-b77b-b89e4dfee15c None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:33.793777 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc6661d-36ff-48c8-b77b-b89e4dfee15c None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:33.794053 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc6661d-36ff-48c8-b77b-b89e4dfee15c None admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:33.794760 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc6661d-36ff-48c8-b77b-b89e4dfee15c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:33.795101 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc6661d-36ff-48c8-b77b-b89e4dfee15c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:33.796509 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc6661d-36ff-48c8-b77b-b89e4dfee15c None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:33.817616 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f8f995-b7d5-4b1a-a9e1-cfbe84e031de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:33.818435 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f8f995-b7d5-4b1a-a9e1-cfbe84e031de None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:33.818813 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f8f995-b7d5-4b1a-a9e1-cfbe84e031de None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:33.819214 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f8f995-b7d5-4b1a-a9e1-cfbe84e031de None admin] PATH_INFO: `/v3/users` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:33.820602 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f8f995-b7d5-4b1a-a9e1-cfbe84e031de None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:33.821069 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f8f995-b7d5-4b1a-a9e1-cfbe84e031de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:33.822327 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 314/624] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 12:16:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:33.822818 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f8f995-b7d5-4b1a-a9e1-cfbe84e031de None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:33.823738 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6cd95-aa76-4795-9d74-11ed7b8cb4ba None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:33.824028 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6cd95-aa76-4795-9d74-11ed7b8cb4ba None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:33.824302 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6cd95-aa76-4795-9d74-11ed7b8cb4ba None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:33.825846 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 315/625] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:16:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:16:33.830993 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d6cd95-aa76-4795-9d74-11ed7b8cb4ba None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:33.848241 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 311/626] 10.222.0.79 () {56 vars in 1133 bytes} [Wed Aug 31 12:16:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:16:33.849778 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f7114f-7c6d-4366-a755-28c25b578e2a None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:33.850173 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f7114f-7c6d-4366-a755-28c25b578e2a None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:33.850550 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f7114f-7c6d-4366-a755-28c25b578e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:33.869645 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:33.877147 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-a5f7114f-7c6d-4366-a755-28c25b578e2a None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:33.879356 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-a5f7114f-7c6d-4366-a755-28c25b578e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:33.967194 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 312/627] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:16:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:16:33.968248 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f7114f-7c6d-4366-a755-28c25b578e2a None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:33.980071 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d6cd95-aa76-4795-9d74-11ed7b8cb4ba None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:34.024342 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11238a6f-bbbf-498e-980d-ff6c318449ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:34.026158 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11238a6f-bbbf-498e-980d-ff6c318449ce None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:34.026438 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11238a6f-bbbf-498e-980d-ff6c318449ce None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:34.026714 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11238a6f-bbbf-498e-980d-ff6c318449ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:34.035107 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11238a6f-bbbf-498e-980d-ff6c318449ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:34.036678 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11238a6f-bbbf-498e-980d-ff6c318449ce None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:34.051032 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-11238a6f-bbbf-498e-980d-ff6c318449ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:16:34.051032 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:34.051032 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:34.051032 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:34.051032 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:34.051032 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:34.051032 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:34.051032 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:34.051032 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:34.051032 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:34.051032 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:34.051032 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:34.051032 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:16:34.051032 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:16:34.051032 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:16:34.052020 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:16:34.052020 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:34.052020 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:34.052020 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:34.052020 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:34.052020 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:34.052020 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:34.052020 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:34.052020 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:34.052020 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:34.052020 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:34.052020 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:34.052020 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:34.052020 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:34.052020 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:34.052020 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:34.052020 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:34.053351 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:16:34.053351 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:16:34.053351 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:16:34.053351 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:16:34.053351 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:16:34.053351 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:16:34.053351 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:16:34.053351 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:16:34.053351 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 316/628] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 12:16:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:34.062240 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11238a6f-bbbf-498e-980d-ff6c318449ce None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:34.094832 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:34.194334 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f7114f-7c6d-4366-a755-28c25b578e2a None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:34.203299 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:34.227303 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11238a6f-bbbf-498e-980d-ff6c318449ce None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:34.266673 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffc85d4-b3a8-422a-8040-4bbac9b8289f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:34.267338 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc85d4-b3a8-422a-8040-4bbac9b8289f None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:34.267700 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc85d4-b3a8-422a-8040-4bbac9b8289f None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:34.267913 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc85d4-b3a8-422a-8040-4bbac9b8289f None admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:34.268744 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffc85d4-b3a8-422a-8040-4bbac9b8289f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:34.269061 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffc85d4-b3a8-422a-8040-4bbac9b8289f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:34.270650 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffc85d4-b3a8-422a-8040-4bbac9b8289f None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:34.272534 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ba7270-fc96-46e0-b304-dd4a60205c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:34.273709 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba7270-fc96-46e0-b304-dd4a60205c4e None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:34.273993 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba7270-fc96-46e0-b304-dd4a60205c4e None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:34.274263 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba7270-fc96-46e0-b304-dd4a60205c4e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:34.296754 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 317/629] 10.222.0.79 () {56 vars in 1148 bytes} [Wed Aug 31 12:16:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:34.302995 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffc85d4-b3a8-422a-8040-4bbac9b8289f None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:34.413253 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ba7270-fc96-46e0-b304-dd4a60205c4e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:34.414901 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ba7270-fc96-46e0-b304-dd4a60205c4e None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:34.464321 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffc85d4-b3a8-422a-8040-4bbac9b8289f None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:34.481133 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:34.503805 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061aacd8-c7a0-4cab-8d5d-2a0283b7d615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:34.504478 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061aacd8-c7a0-4cab-8d5d-2a0283b7d615 None admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:34.504760 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061aacd8-c7a0-4cab-8d5d-2a0283b7d615 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:34.505036 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061aacd8-c7a0-4cab-8d5d-2a0283b7d615 None admin] PATH_INFO: `/v3/projects/a94f4957f2a047cc844342e1c7c74ca5/users/4896540cc14f40b08d05ade32cfd0f37/roles/37fee7a104964826a0762987a1531a9a` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:34.509387 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:34.522127 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061aacd8-c7a0-4cab-8d5d-2a0283b7d615 None admin] RBAC: Authorizing `identity:create_grant(project_id=a94f4957f2a047cc844342e1c7c74ca5, user_id=4896540cc14f40b08d05ade32cfd0f37, role_id=37fee7a104964826a0762987a1531a9a)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:34.524454 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061aacd8-c7a0-4cab-8d5d-2a0283b7d615 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:34.540289 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 313/630] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 12:16:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 572 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:16:34.541419 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ba7270-fc96-46e0-b304-dd4a60205c4e None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:34.545800 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 318/631] 10.222.0.79 () {58 vars in 1439 bytes} [Wed Aug 31 12:16:34 2022] PUT /identity/v3/projects/a94f4957f2a047cc844342e1c7c74ca5/users/4896540cc14f40b08d05ade32cfd0f37/roles/37fee7a104964826a0762987a1531a9a => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:16:34.547790 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061aacd8-c7a0-4cab-8d5d-2a0283b7d615 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:34.692411 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061aacd8-c7a0-4cab-8d5d-2a0283b7d615 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:34.744990 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ba7270-fc96-46e0-b304-dd4a60205c4e None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:34.798771 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51d5215-1d3e-457c-9bbb-bb8c311cc201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:34.801088 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d5215-1d3e-457c-9bbb-bb8c311cc201 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:34.802109 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d5215-1d3e-457c-9bbb-bb8c311cc201 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:34.802816 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d5215-1d3e-457c-9bbb-bb8c311cc201 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:34.824106 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a728eed-55fc-4edb-8596-6eac294c75ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:34.824795 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a728eed-55fc-4edb-8596-6eac294c75ac None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:34.825075 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a728eed-55fc-4edb-8596-6eac294c75ac None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:34.825351 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a728eed-55fc-4edb-8596-6eac294c75ac None admin] PATH_INFO: `/v3/roles/service` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:34.828894 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51d5215-1d3e-457c-9bbb-bb8c311cc201 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:34.833441 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51d5215-1d3e-457c-9bbb-bb8c311cc201 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:34.842136 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a728eed-55fc-4edb-8596-6eac294c75ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:16:34.848555 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-9a728eed-55fc-4edb-8596-6eac294c75ac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:16:34.848555 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:34.848555 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:34.848555 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:34.848555 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:34.848555 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:34.848555 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:34.848555 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:34.848555 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:34.848555 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:34.848555 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:34.848555 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:34.848555 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:16:34.848555 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:16:34.848555 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:16:34.848555 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:16:34.850467 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:16:34.850467 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:16:34.850467 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:16:34.850467 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:16:34.850467 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:34.850467 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:34.850467 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:34.850467 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:34.850467 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:34.850467 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:34.850467 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:34.850467 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:34.850467 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:34.850467 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:34.850467 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:34.850467 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:34.854436 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:34.854436 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:34.854436 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:34.854436 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:34.854436 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:16:34.854436 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:16:34.854436 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:16:34.854436 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:16:34.854436 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:16:34.854436 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:16:34.854436 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:16:34.854436 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:16:34.854436 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 314/632] 10.222.0.79 () {56 vars in 1102 bytes} [Wed Aug 31 12:16:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:34.855878 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-b51d5215-1d3e-457c-9bbb-bb8c311cc201 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:34.855878 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:34.855878 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:34.855878 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:34.855878 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:34.855878 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:34.855878 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:34.855878 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:34.855878 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:34.855878 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:34.855878 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:34.855878 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:34.855878 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:16:34.855878 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:16:34.855878 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:16:34.855878 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:16:34.857552 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:34.857552 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:34.857552 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:34.857552 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:34.857552 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:34.857552 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:34.857552 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:34.857552 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:34.857552 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:34.857552 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:34.857552 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:34.857552 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:34.857552 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:34.857552 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:34.857552 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:34.857552 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:34.857552 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:16:34.863172 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:16:34.863172 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:34.863172 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:16:34.863172 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 319/633] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:16:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:34.864169 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef28e0f-8329-4cb9-8276-ca3549fc2a1c None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:34.864169 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef28e0f-8329-4cb9-8276-ca3549fc2a1c None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:34.864169 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef28e0f-8329-4cb9-8276-ca3549fc2a1c None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:34.864837 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51d5215-1d3e-457c-9bbb-bb8c311cc201 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:34.865072 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 315/634] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:16:34 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:16:34.868855 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef28e0f-8329-4cb9-8276-ca3549fc2a1c None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:34.897567 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:34.915348 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:34.993910 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51d5215-1d3e-457c-9bbb-bb8c311cc201 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:35.034724 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef28e0f-8329-4cb9-8276-ca3549fc2a1c None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:35.059126 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e791a52-3e26-4dca-87d4-bcf4831c6552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:35.060210 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e791a52-3e26-4dca-87d4-bcf4831c6552 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:35.060719 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e791a52-3e26-4dca-87d4-bcf4831c6552 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:35.061217 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e791a52-3e26-4dca-87d4-bcf4831c6552 None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:35.062464 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e791a52-3e26-4dca-87d4-bcf4831c6552 None admin] RBAC: Adding query filter params (name=service) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:35.063059 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e791a52-3e26-4dca-87d4-bcf4831c6552 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:35.065816 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e791a52-3e26-4dca-87d4-bcf4831c6552 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:35.079390 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d83c136-be35-4d4f-b801-e278b25d9f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:35.080350 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d83c136-be35-4d4f-b801-e278b25d9f6e None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:35.080821 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d83c136-be35-4d4f-b801-e278b25d9f6e None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:35.081279 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d83c136-be35-4d4f-b801-e278b25d9f6e None admin] PATH_INFO: `/v3/domains` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:35.082141 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d83c136-be35-4d4f-b801-e278b25d9f6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:35.082570 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 320/635] 10.222.0.79 () {56 vars in 1103 bytes} [Wed Aug 31 12:16:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:35.082892 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d83c136-be35-4d4f-b801-e278b25d9f6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:35.084542 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d83c136-be35-4d4f-b801-e278b25d9f6e None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:35.084890 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b6073-201a-4d2e-945a-28b35c446efc None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:35.085404 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b6073-201a-4d2e-945a-28b35c446efc None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:35.086673 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b6073-201a-4d2e-945a-28b35c446efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:35.105638 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 316/636] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 12:16:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:35.107364 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54bf681-572e-4c46-9434-037ba9ab8587 None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:35.107846 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54bf681-572e-4c46-9434-037ba9ab8587 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:35.108308 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54bf681-572e-4c46-9434-037ba9ab8587 None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:35.110629 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 317/637] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:16:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:16:35.111818 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54bf681-572e-4c46-9434-037ba9ab8587 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:35.118301 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-334b6073-201a-4d2e-945a-28b35c446efc None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:35.120460 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-334b6073-201a-4d2e-945a-28b35c446efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:35.210093 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 321/638] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:16:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:16:35.211772 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334b6073-201a-4d2e-945a-28b35c446efc None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:35.224692 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:35.260641 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54bf681-572e-4c46-9434-037ba9ab8587 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:35.275463 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:35.305764 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010757f1-3eed-41f6-9b68-bc3b03aadb36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:35.306627 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010757f1-3eed-41f6-9b68-bc3b03aadb36 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:35.307102 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010757f1-3eed-41f6-9b68-bc3b03aadb36 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:35.307483 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010757f1-3eed-41f6-9b68-bc3b03aadb36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:35.319590 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010757f1-3eed-41f6-9b68-bc3b03aadb36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:35.321996 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010757f1-3eed-41f6-9b68-bc3b03aadb36 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:35.338801 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-010757f1-3eed-41f6-9b68-bc3b03aadb36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:35.338801 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:35.338801 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:35.338801 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:35.338801 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:35.338801 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:35.338801 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:35.338801 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:35.338801 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:35.338801 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:35.338801 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:35.338801 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:35.338801 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:16:35.338801 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:16:35.338801 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:16:35.338801 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:16:35.340961 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:35.340961 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:35.340961 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:35.340961 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:35.340961 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:35.340961 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:35.340961 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:35.340961 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:35.340961 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:35.340961 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:35.340961 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:35.340961 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:35.340961 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:35.340961 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:35.340961 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:35.340961 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:35.340961 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:16:35.343302 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:16:35.343302 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:35.343302 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:16:35.343823 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 318/639] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:16:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:35.345510 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491aeef2-bf67-449f-b393-fe47820ea4ac None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:35.347341 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491aeef2-bf67-449f-b393-fe47820ea4ac None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:35.347341 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491aeef2-bf67-449f-b393-fe47820ea4ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:35.373471 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-491aeef2-bf67-449f-b393-fe47820ea4ac None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:35.374779 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-491aeef2-bf67-449f-b393-fe47820ea4ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:35.421315 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334b6073-201a-4d2e-945a-28b35c446efc None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:35.462891 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 319/640] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:16:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:16:35.462891 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491aeef2-bf67-449f-b393-fe47820ea4ac None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:35.499702 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2881346c-b257-4053-9827-6bd888ccd9d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:35.500401 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2881346c-b257-4053-9827-6bd888ccd9d2 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:35.500659 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2881346c-b257-4053-9827-6bd888ccd9d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:35.500880 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2881346c-b257-4053-9827-6bd888ccd9d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:35.509388 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2881346c-b257-4053-9827-6bd888ccd9d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:35.511289 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2881346c-b257-4053-9827-6bd888ccd9d2 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:35.521115 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:35.526675 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-2881346c-b257-4053-9827-6bd888ccd9d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:16:35.526675 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:35.526675 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:35.526675 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:35.526675 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:35.526675 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:35.526675 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:35.526675 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:35.526675 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:35.526675 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:35.526675 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:35.526675 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:35.526675 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:16:35.526675 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:16:35.526675 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:16:35.529106 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:16:35.529106 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:35.529106 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:35.529106 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:35.529106 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:35.529106 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:35.529106 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:35.529106 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:35.529106 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:35.529106 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:35.529106 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:35.529106 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:35.529106 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:35.529106 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:35.529106 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:35.529106 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:35.529106 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:35.530930 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:16:35.530930 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:16:35.530930 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:16:35.530930 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:16:35.530930 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:16:35.530930 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:16:35.530930 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:16:35.530930 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:16:35.530930 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 322/641] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 12:16:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:35.530930 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2881346c-b257-4053-9827-6bd888ccd9d2 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:35.573236 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491aeef2-bf67-449f-b393-fe47820ea4ac None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:35.614565 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610c59bf-d2d9-4ed2-8f5f-2a96a088f1be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:35.615234 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610c59bf-d2d9-4ed2-8f5f-2a96a088f1be None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:35.615607 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610c59bf-d2d9-4ed2-8f5f-2a96a088f1be None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:35.615890 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610c59bf-d2d9-4ed2-8f5f-2a96a088f1be None admin] PATH_INFO: `/v3/domains` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:35.616563 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610c59bf-d2d9-4ed2-8f5f-2a96a088f1be None admin] RBAC: Adding query filter params (name=Default) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:35.616963 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610c59bf-d2d9-4ed2-8f5f-2a96a088f1be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:35.618715 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610c59bf-d2d9-4ed2-8f5f-2a96a088f1be None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:35.638739 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 320/642] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 12:16:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:35.640953 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610c59bf-d2d9-4ed2-8f5f-2a96a088f1be None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:35.686555 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:35.710076 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2881346c-b257-4053-9827-6bd888ccd9d2 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:35.777864 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610c59bf-d2d9-4ed2-8f5f-2a96a088f1be None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:35.785453 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776e11ad-6b66-4046-854d-100420657e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:35.786670 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e11ad-6b66-4046-854d-100420657e9c None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:35.787362 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e11ad-6b66-4046-854d-100420657e9c None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:35.788323 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e11ad-6b66-4046-854d-100420657e9c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:35.797506 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:35.813596 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776e11ad-6b66-4046-854d-100420657e9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:16:35.823438 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aef3e3-687b-4bd5-b1fd-33f9930f0751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:35.824323 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aef3e3-687b-4bd5-b1fd-33f9930f0751 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:35.824785 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aef3e3-687b-4bd5-b1fd-33f9930f0751 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:35.825262 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aef3e3-687b-4bd5-b1fd-33f9930f0751 None admin] PATH_INFO: `/v3/projects` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:35.825852 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-776e11ad-6b66-4046-854d-100420657e9c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:16:35.825852 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:35.825852 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:35.825852 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:35.825852 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:35.825852 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:35.825852 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:35.825852 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:35.825852 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:35.825852 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:35.825852 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:35.825852 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:35.825852 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:16:35.825852 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:16:35.825852 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:16:35.825852 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:16:35.827099 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:16:35.827099 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:16:35.827099 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:16:35.827099 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:16:35.827099 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:35.827099 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:35.827099 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:35.827099 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:35.827099 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:35.827099 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:35.827099 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:35.827099 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:35.827099 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:35.827099 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:35.827099 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:35.827099 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:35.828189 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:35.828189 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:35.828189 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:35.828189 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:35.828189 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:16:35.828189 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:16:35.828189 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:16:35.828189 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:16:35.828189 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:16:35.828189 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:16:35.828189 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:16:35.828189 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:16:35.828189 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 323/643] 10.222.0.79 () {56 vars in 1102 bytes} [Wed Aug 31 12:16:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:35.829358 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776e11ad-6b66-4046-854d-100420657e9c None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:35.829866 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aef3e3-687b-4bd5-b1fd-33f9930f0751 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:35.830404 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aef3e3-687b-4bd5-b1fd-33f9930f0751 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:35.832107 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aef3e3-687b-4bd5-b1fd-33f9930f0751 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:35.849526 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 321/644] 10.222.0.79 () {56 vars in 1148 bytes} [Wed Aug 31 12:16:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:35.851404 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aef3e3-687b-4bd5-b1fd-33f9930f0751 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:35.980767 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aef3e3-687b-4bd5-b1fd-33f9930f0751 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:36.004709 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776e11ad-6b66-4046-854d-100420657e9c None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:36.020979 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e6989-fdca-49bb-a2e3-4167aa4c0a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:36.021637 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e6989-fdca-49bb-a2e3-4167aa4c0a5f None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:36.021923 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e6989-fdca-49bb-a2e3-4167aa4c0a5f None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:36.022177 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e6989-fdca-49bb-a2e3-4167aa4c0a5f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:36.035622 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297e6989-fdca-49bb-a2e3-4167aa4c0a5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:16:36.041217 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-297e6989-fdca-49bb-a2e3-4167aa4c0a5f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:16:36.041217 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:36.041217 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:36.041217 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:36.041217 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:36.041217 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:36.041217 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:36.041217 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:36.041217 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:36.041217 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:36.041217 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:36.041217 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:36.041217 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:16:36.041217 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:16:36.041217 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:16:36.041217 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:16:36.043498 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:16:36.043498 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:16:36.043498 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:16:36.043498 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:16:36.043498 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:36.043498 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:36.043498 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:36.043498 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:36.043498 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:36.043498 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:36.043498 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:36.043498 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:36.043498 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:36.043498 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:36.043498 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:36.043498 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:36.045690 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:36.045690 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:36.045690 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:36.045690 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:36.045690 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:16:36.045690 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:16:36.045690 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:16:36.045690 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:16:36.045690 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:16:36.045690 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:16:36.045690 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:16:36.045690 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:16:36.045690 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 322/645] 10.222.0.79 () {56 vars in 1102 bytes} [Wed Aug 31 12:16:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:36.045690 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e6989-fdca-49bb-a2e3-4167aa4c0a5f None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:36.061296 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396a74c3-d741-4fde-b558-9441dada2f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:36.062096 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a74c3-d741-4fde-b558-9441dada2f83 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:36.062501 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a74c3-d741-4fde-b558-9441dada2f83 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:36.062963 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a74c3-d741-4fde-b558-9441dada2f83 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:36.073992 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396a74c3-d741-4fde-b558-9441dada2f83 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:36.076153 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396a74c3-d741-4fde-b558-9441dada2f83 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:36.091724 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:36.092210 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-396a74c3-d741-4fde-b558-9441dada2f83 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 31 12:16:36.092210 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:36.092210 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:36.092210 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:36.092210 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:36.092210 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:36.092210 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:36.092210 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:36.092210 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:36.092210 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:36.092210 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:36.092210 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:36.092210 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:16:36.092210 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:16:36.092210 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:16:36.092210 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:16:36.095855 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:36.095855 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:36.095855 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:16:36.095855 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:16:36.095855 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:16:36.095855 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:16:36.095855 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:36.095855 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:36.095855 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:36.095855 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:36.095855 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:36.095855 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:36.095855 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:36.095855 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:36.095855 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:36.095855 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:36.095855 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:36.095855 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:36.097021 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:36.097021 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:36.097021 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:16:36.097021 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:16:36.097021 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:16:36.097021 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:16:36.097021 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:16:36.097021 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:16:36.097021 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 31 12:16:36.097021 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:16:36.097021 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 324/646] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 12:16:35 2022] GET /identity/v3/users/glance => generated 84 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:36.097021 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396a74c3-d741-4fde-b558-9441dada2f83 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:36.117921 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:36.207686 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e6989-fdca-49bb-a2e3-4167aa4c0a5f None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:36.264853 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396a74c3-d741-4fde-b558-9441dada2f83 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:36.265672 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4f7df1-e5a0-4d7c-9417-e5c4db440ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:36.266633 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4f7df1-e5a0-4d7c-9417-e5c4db440ab0 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:36.267202 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4f7df1-e5a0-4d7c-9417-e5c4db440ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:36.267593 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4f7df1-e5a0-4d7c-9417-e5c4db440ab0 None admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:36.268727 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4f7df1-e5a0-4d7c-9417-e5c4db440ab0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:36.269148 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4f7df1-e5a0-4d7c-9417-e5c4db440ab0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:36.271212 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4f7df1-e5a0-4d7c-9417-e5c4db440ab0 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:36.289310 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 323/647] 10.222.0.79 () {56 vars in 1103 bytes} [Wed Aug 31 12:16:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:36.289310 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4f7df1-e5a0-4d7c-9417-e5c4db440ab0 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:36.327007 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a213b5e-ad67-4406-b83c-316865d347a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:36.327980 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a213b5e-ad67-4406-b83c-316865d347a3 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:36.328430 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a213b5e-ad67-4406-b83c-316865d347a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:36.328877 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a213b5e-ad67-4406-b83c-316865d347a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:36.330099 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a213b5e-ad67-4406-b83c-316865d347a3 None admin] RBAC: Adding query filter params (role.id=37fee7a104964826a0762987a1531a9a, scope.project.id=a94f4957f2a047cc844342e1c7c74ca5, user.id=62401c8e1457450590f4147e0665265a) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:36.330609 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a213b5e-ad67-4406-b83c-316865d347a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:36.332997 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a213b5e-ad67-4406-b83c-316865d347a3 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:36.343991 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 325/648] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 12:16:36 2022] GET /identity/v3/role_assignments?user.id=62401c8e1457450590f4147e0665265a&scope.project.id=a94f4957f2a047cc844342e1c7c74ca5&role.id=37fee7a104964826a0762987a1531a9a => generated 608 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:36.345423 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a213b5e-ad67-4406-b83c-316865d347a3 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:36.477952 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:36.489025 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:36.504759 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4f7df1-e5a0-4d7c-9417-e5c4db440ab0 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:36.514414 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a213b5e-ad67-4406-b83c-316865d347a3 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:36.560344 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760d4428-7fb1-41b5-83b7-19e4b9ec05c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:36.560891 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760d4428-7fb1-41b5-83b7-19e4b9ec05c3 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:36.561175 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760d4428-7fb1-41b5-83b7-19e4b9ec05c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:36.561354 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f2b9bd-e33e-45d5-b841-1b4dbaeebc9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:36.561465 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760d4428-7fb1-41b5-83b7-19e4b9ec05c3 None admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:36.561950 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f2b9bd-e33e-45d5-b841-1b4dbaeebc9f None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:36.562233 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f2b9bd-e33e-45d5-b841-1b4dbaeebc9f None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:36.562505 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f2b9bd-e33e-45d5-b841-1b4dbaeebc9f None admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:36.563125 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760d4428-7fb1-41b5-83b7-19e4b9ec05c3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:36.563230 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f2b9bd-e33e-45d5-b841-1b4dbaeebc9f None admin] RBAC: Adding query filter params (name=service) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:36.563435 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760d4428-7fb1-41b5-83b7-19e4b9ec05c3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:36.563543 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f2b9bd-e33e-45d5-b841-1b4dbaeebc9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:36.564905 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760d4428-7fb1-41b5-83b7-19e4b9ec05c3 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:36.565767 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f2b9bd-e33e-45d5-b841-1b4dbaeebc9f None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:36.579404 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 324/649] 10.222.0.79 () {56 vars in 1103 bytes} [Wed Aug 31 12:16:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:36.580284 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f2b9bd-e33e-45d5-b841-1b4dbaeebc9f None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:36.589465 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 326/650] 10.222.0.79 () {56 vars in 1137 bytes} [Wed Aug 31 12:16:36 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:36.591699 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760d4428-7fb1-41b5-83b7-19e4b9ec05c3 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:36.743955 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f2b9bd-e33e-45d5-b841-1b4dbaeebc9f None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:36.783815 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760d4428-7fb1-41b5-83b7-19e4b9ec05c3 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:36.796700 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98cf5fd-dc7d-42af-869b-acf68b2f9025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:36.797353 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98cf5fd-dc7d-42af-869b-acf68b2f9025 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:36.797652 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98cf5fd-dc7d-42af-869b-acf68b2f9025 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:36.797904 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98cf5fd-dc7d-42af-869b-acf68b2f9025 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:36.810492 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98cf5fd-dc7d-42af-869b-acf68b2f9025 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:36.811937 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98cf5fd-dc7d-42af-869b-acf68b2f9025 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:36.828095 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-c98cf5fd-dc7d-42af-869b-acf68b2f9025 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:36.828095 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:36.828095 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:36.828095 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:36.828095 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:36.828095 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:36.828095 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:36.828095 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:36.828095 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:36.828095 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:36.828095 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:36.828095 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:36.828095 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:16:36.828095 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:16:36.828095 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:16:36.828095 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:16:36.829171 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:36.829171 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:36.829171 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:36.829171 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:36.829171 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:36.829171 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:36.829171 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:36.829171 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:36.829171 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:36.829171 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:36.829171 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:36.829171 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:36.829171 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:36.829171 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:36.829171 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:36.829171 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:36.829171 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:16:36.830135 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:16:36.830135 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:36.830135 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:16:36.830135 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 325/651] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:16:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:36.830433 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98cf5fd-dc7d-42af-869b-acf68b2f9025 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:36.845644 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:36.849760 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:36.857631 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a357f8-88ab-421a-bc45-00974548f166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:36.858288 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a357f8-88ab-421a-bc45-00974548f166 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:36.858570 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a357f8-88ab-421a-bc45-00974548f166 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:36.858843 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a357f8-88ab-421a-bc45-00974548f166 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:36.871760 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a357f8-88ab-421a-bc45-00974548f166 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:36.873833 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a357f8-88ab-421a-bc45-00974548f166 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:36.892465 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-70a357f8-88ab-421a-bc45-00974548f166 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:36.892465 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:36.892465 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:36.892465 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:36.892465 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:36.892465 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:36.892465 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:36.892465 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:36.892465 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:36.892465 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:36.892465 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:36.892465 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:36.892465 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:16:36.892465 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:16:36.892465 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:16:36.892465 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:16:36.893591 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:36.893591 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:36.893591 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:36.893591 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:36.893591 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:36.893591 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:36.893591 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:36.893591 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:36.893591 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:36.893591 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:36.893591 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:36.893591 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:36.893591 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:36.893591 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:36.893591 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:36.893591 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:36.893591 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:16:36.894528 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:16:36.894528 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:36.894528 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:16:36.894528 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 327/652] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:16:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:36.895180 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc330ad-9411-4211-82b5-97486c373c99 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:36.895464 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc330ad-9411-4211-82b5-97486c373c99 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:36.895739 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc330ad-9411-4211-82b5-97486c373c99 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:36.898911 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 328/653] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:16:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:16:36.898911 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc330ad-9411-4211-82b5-97486c373c99 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:36.990274 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98cf5fd-dc7d-42af-869b-acf68b2f9025 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:37.050280 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c40516-cfbd-4db1-96dc-16c01b6b52db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:37.050938 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c40516-cfbd-4db1-96dc-16c01b6b52db None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:37.051224 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c40516-cfbd-4db1-96dc-16c01b6b52db None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:37.051494 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c40516-cfbd-4db1-96dc-16c01b6b52db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:37.061007 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc330ad-9411-4211-82b5-97486c373c99 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:37.121263 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab676eb-30c2-4a81-be94-6b8f591443b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:37.122627 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab676eb-30c2-4a81-be94-6b8f591443b3 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:37.123163 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab676eb-30c2-4a81-be94-6b8f591443b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:37.123646 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab676eb-30c2-4a81-be94-6b8f591443b3 None admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:37.124819 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab676eb-30c2-4a81-be94-6b8f591443b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:37.125353 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab676eb-30c2-4a81-be94-6b8f591443b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:37.127998 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab676eb-30c2-4a81-be94-6b8f591443b3 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:37.134659 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c40516-cfbd-4db1-96dc-16c01b6b52db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:37.136209 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c40516-cfbd-4db1-96dc-16c01b6b52db None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:37.150607 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:37.158289 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 329/654] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 12:16:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:37.158289 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a400bc-eec2-4ca4-ab7f-83a516cf0444 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:37.158289 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a400bc-eec2-4ca4-ab7f-83a516cf0444 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:37.158289 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a400bc-eec2-4ca4-ab7f-83a516cf0444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:37.187861 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-e6a400bc-eec2-4ca4-ab7f-83a516cf0444 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:37.189980 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-e6a400bc-eec2-4ca4-ab7f-83a516cf0444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:37.267421 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:37.277383 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 326/655] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 12:16:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:16:37.277383 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c40516-cfbd-4db1-96dc-16c01b6b52db None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:37.320797 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 330/656] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:16:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:16:37.323179 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a400bc-eec2-4ca4-ab7f-83a516cf0444 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:37.427829 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c40516-cfbd-4db1-96dc-16c01b6b52db None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:37.445819 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:37.489284 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d639817d-73d4-4715-abd2-d26cae8ebc73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:37.490219 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639817d-73d4-4715-abd2-d26cae8ebc73 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:37.490630 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639817d-73d4-4715-abd2-d26cae8ebc73 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:37.491080 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639817d-73d4-4715-abd2-d26cae8ebc73 None admin] PATH_INFO: `/v3/domains` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:37.492757 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d639817d-73d4-4715-abd2-d26cae8ebc73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:37.493307 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d639817d-73d4-4715-abd2-d26cae8ebc73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:37.496079 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d639817d-73d4-4715-abd2-d26cae8ebc73 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:37.508119 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a400bc-eec2-4ca4-ab7f-83a516cf0444 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:37.518526 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 327/657] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 12:16:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:37.527600 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d639817d-73d4-4715-abd2-d26cae8ebc73 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:37.555408 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f8863f-aacd-4611-ae37-a2c01df5816a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:37.557079 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f8863f-aacd-4611-ae37-a2c01df5816a None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:37.557589 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f8863f-aacd-4611-ae37-a2c01df5816a None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:37.558058 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f8863f-aacd-4611-ae37-a2c01df5816a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:37.568115 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f8863f-aacd-4611-ae37-a2c01df5816a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:37.570897 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f8863f-aacd-4611-ae37-a2c01df5816a None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:37.588952 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-f5f8863f-aacd-4611-ae37-a2c01df5816a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 12:16:37.588952 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:37.588952 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:37.588952 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:37.588952 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:37.588952 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:37.588952 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:37.588952 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:37.588952 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:37.588952 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:37.588952 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:37.588952 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:37.588952 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:16:37.588952 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:16:37.588952 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:16:37.588952 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:16:37.589962 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:37.589962 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:37.589962 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:16:37.589962 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:16:37.589962 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:16:37.589962 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:16:37.589962 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:37.589962 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:37.589962 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:37.589962 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:37.589962 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:37.589962 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:37.589962 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:37.589962 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:37.589962 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:37.589962 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:37.589962 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:37.589962 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:37.590949 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:37.590949 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:37.590949 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:16:37.590949 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:16:37.590949 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:16:37.590949 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:16:37.590949 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:16:37.590949 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:16:37.590949 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 12:16:37.590949 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:16:37.599881 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 331/658] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 12:16:37 2022] GET /identity/v3/users/cinder => generated 84 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:37.599881 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f8863f-aacd-4611-ae37-a2c01df5816a None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:37.644303 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:37.724908 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d639817d-73d4-4715-abd2-d26cae8ebc73 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:37.748671 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f8863f-aacd-4611-ae37-a2c01df5816a None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:37.786681 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96bca0b-5e01-4cb2-b558-12257123f0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:37.787450 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96bca0b-5e01-4cb2-b558-12257123f0b7 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:37.787734 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96bca0b-5e01-4cb2-b558-12257123f0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:37.788014 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96bca0b-5e01-4cb2-b558-12257123f0b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:37.802726 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2396cfc-7285-4bac-a517-c321830719d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:37.803803 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2396cfc-7285-4bac-a517-c321830719d3 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:37.804304 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2396cfc-7285-4bac-a517-c321830719d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:37.804762 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2396cfc-7285-4bac-a517-c321830719d3 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:37.808791 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96bca0b-5e01-4cb2-b558-12257123f0b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:37.811595 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96bca0b-5e01-4cb2-b558-12257123f0b7 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:37.815079 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2396cfc-7285-4bac-a517-c321830719d3 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:37.817546 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2396cfc-7285-4bac-a517-c321830719d3 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:37.833858 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-e2396cfc-7285-4bac-a517-c321830719d3 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 12:16:37.833858 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:37.833858 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:37.833858 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:37.833858 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:37.833858 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:37.833858 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:37.833858 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:37.833858 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:37.833858 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:37.833858 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:37.833858 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:37.833858 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:16:37.833858 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:16:37.833858 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:16:37.833858 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:16:37.834876 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:37.834876 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:37.834876 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:16:37.834876 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:16:37.834876 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:16:37.834876 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:16:37.834876 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:37.834876 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:37.834876 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:37.834876 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:37.834876 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:37.834876 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:37.834876 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:37.834876 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:37.834876 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:37.834876 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:37.834876 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:37.834876 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:37.836227 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:37.836227 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:37.836227 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:16:37.836227 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:16:37.836227 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:16:37.836227 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:16:37.836227 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:16:37.836227 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:16:37.836227 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 12:16:37.836227 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:16:37.842651 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 332/659] 10.222.0.79 () {56 vars in 1102 bytes} [Wed Aug 31 12:16:37 2022] GET /identity/v3/users/neutron => generated 85 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:37.842651 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2396cfc-7285-4bac-a517-c321830719d3 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:37.842938 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-b96bca0b-5e01-4cb2-b558-12257123f0b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:37.842938 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:37.842938 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:37.842938 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:37.842938 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:37.842938 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:37.842938 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:37.842938 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:37.842938 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:37.842938 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:37.842938 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:37.842938 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:37.842938 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:16:37.842938 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:16:37.842938 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:16:37.842938 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:16:37.843802 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:37.843802 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:37.843802 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:37.843802 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:37.843802 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:37.843802 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:37.843802 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:37.843802 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:37.843802 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:37.843802 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:37.843802 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:37.843802 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:37.843802 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:37.843802 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:37.843802 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:37.843802 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:37.843802 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:16:37.844697 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:16:37.844697 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:37.844697 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:16:37.845304 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 328/660] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:16:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:37.850248 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96bca0b-5e01-4cb2-b558-12257123f0b7 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:37.892946 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:38.015928 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:38.026217 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2396cfc-7285-4bac-a517-c321830719d3 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:38.032675 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96bca0b-5e01-4cb2-b558-12257123f0b7 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:38.078138 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd20187-ea0e-43bd-99ed-475c0ff0ed85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:38.079176 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd20187-ea0e-43bd-99ed-475c0ff0ed85 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:38.079664 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd20187-ea0e-43bd-99ed-475c0ff0ed85 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:38.080154 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd20187-ea0e-43bd-99ed-475c0ff0ed85 None admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:38.081529 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd20187-ea0e-43bd-99ed-475c0ff0ed85 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:38.082215 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd20187-ea0e-43bd-99ed-475c0ff0ed85 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:38.084916 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd20187-ea0e-43bd-99ed-475c0ff0ed85 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:38.089699 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168b6d60-7787-4f59-870b-d0085669c4c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:38.090711 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b6d60-7787-4f59-870b-d0085669c4c1 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:38.091177 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b6d60-7787-4f59-870b-d0085669c4c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:38.091687 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b6d60-7787-4f59-870b-d0085669c4c1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:38.106584 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168b6d60-7787-4f59-870b-d0085669c4c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:16:38.114532 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-168b6d60-7787-4f59-870b-d0085669c4c1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:16:38.114532 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:38.114532 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:38.114532 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:38.114532 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:38.114532 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:38.114532 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:38.114532 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:38.114532 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:38.114532 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:38.114532 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:38.114532 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:38.114532 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:16:38.114532 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:16:38.114532 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:16:38.114532 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:16:38.116396 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:16:38.116396 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:16:38.116396 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:16:38.116396 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:16:38.116396 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:38.116396 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:38.116396 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:38.116396 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:38.116396 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:38.116396 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:38.116396 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:38.116396 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:38.116396 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:38.116396 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:38.116396 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:38.116396 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:38.118691 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:38.118691 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:38.118691 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:38.118691 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:38.118691 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:16:38.118691 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:16:38.118691 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:16:38.118691 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:16:38.118691 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:16:38.118691 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:16:38.118691 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:16:38.118691 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:16:38.118691 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 329/661] 10.222.0.79 () {56 vars in 1102 bytes} [Wed Aug 31 12:16:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:38.123005 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168b6d60-7787-4f59-870b-d0085669c4c1 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:38.130300 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 333/662] 10.222.0.79 () {56 vars in 1137 bytes} [Wed Aug 31 12:16:37 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:38.132157 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd20187-ea0e-43bd-99ed-475c0ff0ed85 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:38.269430 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:38.298086 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd20187-ea0e-43bd-99ed-475c0ff0ed85 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:38.305382 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168b6d60-7787-4f59-870b-d0085669c4c1 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:38.345003 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e042b34e-2d89-46e8-9f30-0b1b8559ccf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:38.345718 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e042b34e-2d89-46e8-9f30-0b1b8559ccf7 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:38.346129 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e042b34e-2d89-46e8-9f30-0b1b8559ccf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:38.346533 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e042b34e-2d89-46e8-9f30-0b1b8559ccf7 None admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:38.347668 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e042b34e-2d89-46e8-9f30-0b1b8559ccf7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:38.348164 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e042b34e-2d89-46e8-9f30-0b1b8559ccf7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:38.349681 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e042b34e-2d89-46e8-9f30-0b1b8559ccf7 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:38.367328 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 334/663] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 12:16:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:38.368797 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e042b34e-2d89-46e8-9f30-0b1b8559ccf7 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:38.388612 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012cea28-e0f1-48f2-8a81-0b1070e223b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:38.390024 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012cea28-e0f1-48f2-8a81-0b1070e223b8 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:38.391119 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:38.391464 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012cea28-e0f1-48f2-8a81-0b1070e223b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:38.392774 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012cea28-e0f1-48f2-8a81-0b1070e223b8 None admin] PATH_INFO: `/v3/users` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:38.394386 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012cea28-e0f1-48f2-8a81-0b1070e223b8 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:38.395203 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012cea28-e0f1-48f2-8a81-0b1070e223b8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:38.399463 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012cea28-e0f1-48f2-8a81-0b1070e223b8 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:38.433249 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 330/664] 10.222.0.79 () {56 vars in 1139 bytes} [Wed Aug 31 12:16:38 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:38.435061 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012cea28-e0f1-48f2-8a81-0b1070e223b8 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:38.513087 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e042b34e-2d89-46e8-9f30-0b1b8559ccf7 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:38.568619 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12cac80-37da-4ba2-b4a8-5b623a2b7d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:38.569650 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12cac80-37da-4ba2-b4a8-5b623a2b7d61 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:38.570486 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12cac80-37da-4ba2-b4a8-5b623a2b7d61 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:38.570898 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12cac80-37da-4ba2-b4a8-5b623a2b7d61 None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:38.572039 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12cac80-37da-4ba2-b4a8-5b623a2b7d61 None admin] RBAC: Adding query filter params (name=service) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:38.572534 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12cac80-37da-4ba2-b4a8-5b623a2b7d61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:38.574363 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12cac80-37da-4ba2-b4a8-5b623a2b7d61 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:38.594915 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 335/665] 10.222.0.79 () {56 vars in 1103 bytes} [Wed Aug 31 12:16:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:38.594915 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12cac80-37da-4ba2-b4a8-5b623a2b7d61 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:38.643154 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012cea28-e0f1-48f2-8a81-0b1070e223b8 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:38.701149 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbfdff6-49c9-4922-9c39-f2eb09eabd2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:38.702083 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbfdff6-49c9-4922-9c39-f2eb09eabd2a None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:38.702546 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbfdff6-49c9-4922-9c39-f2eb09eabd2a None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:38.703036 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbfdff6-49c9-4922-9c39-f2eb09eabd2a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:38.721850 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:38.728830 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:38.765792 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12cac80-37da-4ba2-b4a8-5b623a2b7d61 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:38.800835 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbfdff6-49c9-4922-9c39-f2eb09eabd2a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:38.802477 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbfdff6-49c9-4922-9c39-f2eb09eabd2a None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:38.807206 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1450b98a-67e4-4211-88fd-beb8f1667cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:38.807857 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1450b98a-67e4-4211-88fd-beb8f1667cc0 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:38.808132 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1450b98a-67e4-4211-88fd-beb8f1667cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:38.808402 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1450b98a-67e4-4211-88fd-beb8f1667cc0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:38.816097 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1450b98a-67e4-4211-88fd-beb8f1667cc0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:38.817908 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1450b98a-67e4-4211-88fd-beb8f1667cc0 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:38.830969 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-1450b98a-67e4-4211-88fd-beb8f1667cc0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:16:38.830969 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:38.830969 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:38.830969 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:38.830969 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:38.830969 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:38.830969 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:38.830969 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:38.830969 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:38.830969 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:38.830969 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:38.830969 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:38.830969 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:16:38.830969 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:16:38.830969 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:16:38.832816 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:16:38.832816 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:38.832816 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:38.832816 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:38.832816 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:38.832816 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:38.832816 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:38.832816 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:38.832816 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:38.832816 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:38.832816 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:38.832816 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:38.832816 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:38.832816 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:38.832816 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:38.832816 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:38.832816 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:38.834601 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:16:38.834601 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:16:38.834601 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:16:38.834601 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:16:38.834601 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:16:38.834601 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:16:38.834601 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:16:38.834601 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:16:38.834601 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 336/666] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 12:16:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:38.834601 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1450b98a-67e4-4211-88fd-beb8f1667cc0 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:38.939514 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 331/667] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 12:16:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:16:38.940762 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbfdff6-49c9-4922-9c39-f2eb09eabd2a None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:38.956624 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1450b98a-67e4-4211-88fd-beb8f1667cc0 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:39.000432 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1899b534-eabd-47db-b2e7-ba582a0a72b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:39.001453 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899b534-eabd-47db-b2e7-ba582a0a72b7 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:39.001895 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899b534-eabd-47db-b2e7-ba582a0a72b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:39.002282 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899b534-eabd-47db-b2e7-ba582a0a72b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:39.006098 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:39.008489 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:39.087199 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbfdff6-49c9-4922-9c39-f2eb09eabd2a None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:39.099180 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1899b534-eabd-47db-b2e7-ba582a0a72b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:39.100933 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1899b534-eabd-47db-b2e7-ba582a0a72b7 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:39.131302 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63681af-18c4-4e11-b685-ad16486159ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:39.131943 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63681af-18c4-4e11-b685-ad16486159ef None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:39.132223 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63681af-18c4-4e11-b685-ad16486159ef None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:39.133190 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63681af-18c4-4e11-b685-ad16486159ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:39.144817 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63681af-18c4-4e11-b685-ad16486159ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:39.146286 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63681af-18c4-4e11-b685-ad16486159ef None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:39.162069 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-e63681af-18c4-4e11-b685-ad16486159ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:39.162069 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:39.162069 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:39.162069 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:39.162069 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:39.162069 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:39.162069 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:39.162069 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:39.162069 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:39.162069 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:39.162069 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:39.162069 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:39.162069 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:16:39.162069 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:16:39.162069 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:16:39.162069 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:16:39.170571 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:39.170571 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:39.170571 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:39.170571 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:39.170571 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:39.170571 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:39.170571 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:39.170571 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:39.170571 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:39.170571 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:39.170571 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:39.170571 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:39.170571 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:39.170571 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:39.170571 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:39.170571 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:39.170571 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:16:39.172776 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:16:39.172776 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:39.172776 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:16:39.172776 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 332/668] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:16:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:39.172776 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a236d46-6751-4323-9e6e-579dbcf5ece6 None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:39.172776 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a236d46-6751-4323-9e6e-579dbcf5ece6 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:39.172776 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a236d46-6751-4323-9e6e-579dbcf5ece6 None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:39.172776 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 333/669] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:16:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:16:39.172776 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a236d46-6751-4323-9e6e-579dbcf5ece6 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:39.250537 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 337/670] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 12:16:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:16:39.251354 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1899b534-eabd-47db-b2e7-ba582a0a72b7 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:39.292968 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:39.328879 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:39.341868 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a236d46-6751-4323-9e6e-579dbcf5ece6 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:39.386173 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d9a11b-97dc-42a1-bbba-cab097b1d9ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:39.386799 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d9a11b-97dc-42a1-bbba-cab097b1d9ac None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:39.387114 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d9a11b-97dc-42a1-bbba-cab097b1d9ac None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:39.387387 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d9a11b-97dc-42a1-bbba-cab097b1d9ac None admin] PATH_INFO: `/v3/projects` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:39.388108 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d9a11b-97dc-42a1-bbba-cab097b1d9ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:39.388407 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d9a11b-97dc-42a1-bbba-cab097b1d9ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:39.389938 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d9a11b-97dc-42a1-bbba-cab097b1d9ac None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:39.396559 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1899b534-eabd-47db-b2e7-ba582a0a72b7 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:39.413183 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 334/671] 10.222.0.79 () {56 vars in 1148 bytes} [Wed Aug 31 12:16:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:39.413183 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d9a11b-97dc-42a1-bbba-cab097b1d9ac None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:39.439843 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8db727-ba1d-49a7-a321-523b735c80b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:39.440557 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8db727-ba1d-49a7-a321-523b735c80b0 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:39.440937 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8db727-ba1d-49a7-a321-523b735c80b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:39.441270 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8db727-ba1d-49a7-a321-523b735c80b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:39.463680 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8db727-ba1d-49a7-a321-523b735c80b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:39.465429 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8db727-ba1d-49a7-a321-523b735c80b0 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:39.484960 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-dd8db727-ba1d-49a7-a321-523b735c80b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:39.484960 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:39.484960 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:39.484960 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:39.484960 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:39.484960 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:39.484960 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:39.484960 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:39.484960 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:39.484960 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:39.484960 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:39.484960 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:39.484960 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:16:39.484960 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:16:39.484960 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:16:39.484960 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:16:39.486788 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:39.486788 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:39.486788 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:39.486788 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:39.486788 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:39.486788 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:39.486788 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:39.486788 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:39.486788 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:39.486788 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:39.486788 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:39.486788 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:39.486788 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:39.486788 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:39.486788 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:39.486788 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:39.486788 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:16:39.488141 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:16:39.488141 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:39.488141 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:16:39.488141 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 338/672] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:16:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:39.489354 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e5bd5-197f-4d4c-9009-1a5f1cd89c91 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:39.489826 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e5bd5-197f-4d4c-9009-1a5f1cd89c91 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:39.490291 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e5bd5-197f-4d4c-9009-1a5f1cd89c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:39.515150 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-243e5bd5-197f-4d4c-9009-1a5f1cd89c91 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:39.516392 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-243e5bd5-197f-4d4c-9009-1a5f1cd89c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:39.550944 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d9a11b-97dc-42a1-bbba-cab097b1d9ac None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:39.600283 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1414099c-7640-4eac-816e-3441dda29408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:39.601785 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1414099c-7640-4eac-816e-3441dda29408 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:39.602515 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1414099c-7640-4eac-816e-3441dda29408 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:39.603025 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1414099c-7640-4eac-816e-3441dda29408 None admin] PATH_INFO: `/v3/domains` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:39.604018 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1414099c-7640-4eac-816e-3441dda29408 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:39.604514 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1414099c-7640-4eac-816e-3441dda29408 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:39.606968 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1414099c-7640-4eac-816e-3441dda29408 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:39.610054 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 339/673] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:16:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:16:39.611302 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243e5bd5-197f-4d4c-9009-1a5f1cd89c91 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:39.629220 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 335/674] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 12:16:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:39.631038 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1414099c-7640-4eac-816e-3441dda29408 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:39.641131 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:39.662518 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:39.774730 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1414099c-7640-4eac-816e-3441dda29408 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:39.792400 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243e5bd5-197f-4d4c-9009-1a5f1cd89c91 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:39.818034 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e06735f-0106-4a6f-9459-f57abb06cb2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:39.818937 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e06735f-0106-4a6f-9459-f57abb06cb2a None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:39.819352 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e06735f-0106-4a6f-9459-f57abb06cb2a None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:39.820357 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e06735f-0106-4a6f-9459-f57abb06cb2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:39.821499 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e06735f-0106-4a6f-9459-f57abb06cb2a None admin] RBAC: Adding query filter params (role.id=37fee7a104964826a0762987a1531a9a, scope.project.id=a94f4957f2a047cc844342e1c7c74ca5, user.id=d8b3bb8f689b45b99ed43f672264a26d) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:39.821939 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e06735f-0106-4a6f-9459-f57abb06cb2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:39.823983 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e06735f-0106-4a6f-9459-f57abb06cb2a None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:39.838660 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 336/675] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 12:16:39 2022] GET /identity/v3/role_assignments?user.id=d8b3bb8f689b45b99ed43f672264a26d&scope.project.id=a94f4957f2a047cc844342e1c7c74ca5&role.id=37fee7a104964826a0762987a1531a9a => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:39.838660 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e06735f-0106-4a6f-9459-f57abb06cb2a None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:39.872263 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade3db57-f85e-472e-b324-f6761f80ea45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:39.873690 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3db57-f85e-472e-b324-f6761f80ea45 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:39.874466 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3db57-f85e-472e-b324-f6761f80ea45 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:39.875284 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3db57-f85e-472e-b324-f6761f80ea45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:39.902010 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade3db57-f85e-472e-b324-f6761f80ea45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:39.905525 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade3db57-f85e-472e-b324-f6761f80ea45 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:39.942324 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-ade3db57-f85e-472e-b324-f6761f80ea45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:39.942324 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:39.942324 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:39.942324 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:39.942324 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:39.942324 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:39.942324 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:39.942324 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:39.942324 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:39.942324 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:39.942324 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:39.942324 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:39.942324 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:16:39.942324 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:16:39.942324 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:16:39.942324 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:16:39.944421 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:39.944421 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:39.944421 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:39.944421 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:39.944421 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:39.944421 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:39.944421 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:39.944421 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:39.944421 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:39.944421 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:39.944421 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:39.944421 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:39.944421 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:39.944421 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:39.944421 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:39.944421 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:39.944421 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:16:39.947131 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:16:39.947131 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:39.947131 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:16:39.947131 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 340/676] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:16:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:39.952199 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade3db57-f85e-472e-b324-f6761f80ea45 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:39.998359 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:40.046632 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e06735f-0106-4a6f-9459-f57abb06cb2a None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:40.098085 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:40.098994 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c247a14e-7d4c-4856-ab04-467707ec7b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:40.100894 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247a14e-7d4c-4856-ab04-467707ec7b98 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:40.100894 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247a14e-7d4c-4856-ab04-467707ec7b98 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:40.101919 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247a14e-7d4c-4856-ab04-467707ec7b98 None admin] PATH_INFO: `/v3/domains` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:40.102770 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c247a14e-7d4c-4856-ab04-467707ec7b98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:40.103152 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c247a14e-7d4c-4856-ab04-467707ec7b98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:40.104572 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c247a14e-7d4c-4856-ab04-467707ec7b98 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:40.131404 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 337/677] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 12:16:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:40.134328 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c247a14e-7d4c-4856-ab04-467707ec7b98 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:40.160047 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade3db57-f85e-472e-b324-f6761f80ea45 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:40.218215 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3085c975-050a-464b-9a73-694b97eecd7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:40.221836 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3085c975-050a-464b-9a73-694b97eecd7b None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:40.222580 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3085c975-050a-464b-9a73-694b97eecd7b None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:40.223348 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3085c975-050a-464b-9a73-694b97eecd7b None admin] PATH_INFO: `/v3/users/swift` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:40.239877 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3085c975-050a-464b-9a73-694b97eecd7b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:40.242519 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3085c975-050a-464b-9a73-694b97eecd7b None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:40.261175 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-3085c975-050a-464b-9a73-694b97eecd7b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 12:16:40.261175 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:40.261175 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:40.261175 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:40.261175 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:40.261175 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:40.261175 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:40.261175 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:40.261175 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:40.261175 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:40.261175 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:40.261175 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:40.261175 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:16:40.261175 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:16:40.261175 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:16:40.261175 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:16:40.263372 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:40.263372 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:40.263372 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:16:40.263372 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:16:40.263372 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:16:40.263372 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:16:40.263372 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:40.263372 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:40.263372 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:40.263372 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:40.263372 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:40.263372 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:40.263372 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:40.263372 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:40.263372 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:40.263372 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:40.263372 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:40.263372 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:40.265324 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:40.265324 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:40.265324 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:16:40.265324 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:16:40.265324 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:16:40.265324 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:16:40.265324 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:16:40.265324 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:16:40.265324 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 12:16:40.265324 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:16:40.265324 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 341/678] 10.222.0.79 () {56 vars in 1096 bytes} [Wed Aug 31 12:16:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:40.265324 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3085c975-050a-464b-9a73-694b97eecd7b None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:40.301082 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c247a14e-7d4c-4856-ab04-467707ec7b98 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:40.364533 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aa59d6-9b91-4b99-a033-5d6e14d24aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:40.365162 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa59d6-9b91-4b99-a033-5d6e14d24aed None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:40.365440 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa59d6-9b91-4b99-a033-5d6e14d24aed None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:40.365721 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa59d6-9b91-4b99-a033-5d6e14d24aed None admin] PATH_INFO: `/v3/domains` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:40.366363 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aa59d6-9b91-4b99-a033-5d6e14d24aed None admin] RBAC: Adding query filter params (name=Default) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:40.367484 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aa59d6-9b91-4b99-a033-5d6e14d24aed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:40.368725 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aa59d6-9b91-4b99-a033-5d6e14d24aed None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:40.371537 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:40.384491 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 338/679] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 12:16:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:40.386793 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aa59d6-9b91-4b99-a033-5d6e14d24aed None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:40.420937 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3085c975-050a-464b-9a73-694b97eecd7b None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:40.466219 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:40.479332 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8096c238-9094-46e9-b77a-10a860ce97d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:40.480453 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8096c238-9094-46e9-b77a-10a860ce97d3 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:40.481132 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8096c238-9094-46e9-b77a-10a860ce97d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:40.481800 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8096c238-9094-46e9-b77a-10a860ce97d3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:40.500105 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8096c238-9094-46e9-b77a-10a860ce97d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:16:40.510816 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-8096c238-9094-46e9-b77a-10a860ce97d3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:16:40.510816 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:40.510816 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:40.510816 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:40.510816 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:40.510816 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:40.510816 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:40.510816 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:40.510816 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:40.510816 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:40.510816 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:40.510816 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:40.510816 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:16:40.510816 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:16:40.510816 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:16:40.510816 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:16:40.511982 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:16:40.511982 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:16:40.511982 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:16:40.511982 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:16:40.511982 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:40.511982 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:40.511982 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:40.511982 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:40.511982 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:40.511982 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:40.511982 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:40.511982 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:40.511982 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:40.511982 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:40.511982 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:40.511982 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:40.513059 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:40.513059 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:40.513059 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:40.513059 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:40.513059 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:16:40.513059 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:16:40.513059 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:16:40.513059 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:16:40.513059 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:16:40.513059 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:16:40.513059 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:16:40.513059 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:16:40.514082 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 342/680] 10.222.0.79 () {56 vars in 1096 bytes} [Wed Aug 31 12:16:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:40.516200 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8096c238-9094-46e9-b77a-10a860ce97d3 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:40.538681 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aa59d6-9b91-4b99-a033-5d6e14d24aed None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:40.597183 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dc08f0-d7d3-4916-a62b-2c5690edf60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:40.598132 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc08f0-d7d3-4916-a62b-2c5690edf60e None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:40.598579 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc08f0-d7d3-4916-a62b-2c5690edf60e None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:40.599053 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc08f0-d7d3-4916-a62b-2c5690edf60e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:40.610870 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dc08f0-d7d3-4916-a62b-2c5690edf60e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:40.613054 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dc08f0-d7d3-4916-a62b-2c5690edf60e None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:40.635649 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-c6dc08f0-d7d3-4916-a62b-2c5690edf60e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:16:40.635649 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:40.635649 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:40.635649 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:40.635649 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:40.635649 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:40.635649 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:40.635649 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:40.635649 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:40.635649 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:40.635649 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:40.635649 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:40.635649 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:16:40.635649 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:16:40.635649 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:16:40.636662 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:16:40.636662 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:40.636662 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:40.636662 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:40.636662 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:40.636662 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:40.636662 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:40.636662 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:40.636662 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:40.636662 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:40.636662 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:40.636662 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:40.636662 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:40.636662 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:40.636662 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:40.636662 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:40.636662 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:40.637638 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:16:40.637638 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:16:40.637638 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:16:40.637638 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:16:40.637638 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:16:40.637638 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:16:40.637638 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:16:40.637638 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:16:40.637638 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 339/681] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 12:16:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:40.639356 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dc08f0-d7d3-4916-a62b-2c5690edf60e None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:40.693954 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8096c238-9094-46e9-b77a-10a860ce97d3 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:40.714840 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:40.762207 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d4446d-1760-40b8-a347-2779f964bda1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:40.763485 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d4446d-1760-40b8-a347-2779f964bda1 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:40.763892 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d4446d-1760-40b8-a347-2779f964bda1 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:40.764353 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d4446d-1760-40b8-a347-2779f964bda1 None admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:40.765908 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d4446d-1760-40b8-a347-2779f964bda1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:40.766691 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d4446d-1760-40b8-a347-2779f964bda1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:40.769246 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d4446d-1760-40b8-a347-2779f964bda1 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:40.773508 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dc08f0-d7d3-4916-a62b-2c5690edf60e None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:40.803495 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 343/682] 10.222.0.79 () {56 vars in 1135 bytes} [Wed Aug 31 12:16:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:40.804880 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d4446d-1760-40b8-a347-2779f964bda1 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:40.838400 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e0821b-b39a-4922-957c-4923e9314b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:40.839632 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e0821b-b39a-4922-957c-4923e9314b1d None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:40.840095 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e0821b-b39a-4922-957c-4923e9314b1d None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:40.840594 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e0821b-b39a-4922-957c-4923e9314b1d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:40.854730 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e0821b-b39a-4922-957c-4923e9314b1d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:40.857505 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e0821b-b39a-4922-957c-4923e9314b1d None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:40.871383 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:40.883126 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-f7e0821b-b39a-4922-957c-4923e9314b1d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:16:40.883126 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:40.883126 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:40.883126 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:40.883126 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:40.883126 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:40.883126 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:40.883126 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:40.883126 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:40.883126 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:40.883126 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:40.883126 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:40.883126 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:16:40.883126 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:16:40.883126 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:16:40.884910 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:16:40.884910 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:40.884910 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:40.884910 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:40.884910 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:40.884910 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:40.884910 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:40.884910 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:40.884910 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:40.884910 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:40.884910 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:40.884910 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:40.884910 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:40.884910 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:40.884910 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:40.884910 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:40.884910 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:40.886726 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:16:40.886726 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:16:40.886726 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:16:40.886726 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:16:40.886726 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:16:40.886726 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:16:40.886726 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:16:40.886726 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:16:40.886726 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 340/683] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 12:16:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:40.886726 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e0821b-b39a-4922-957c-4923e9314b1d None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:40.964678 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d4446d-1760-40b8-a347-2779f964bda1 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:41.032175 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d759d33-f90c-44cb-81b3-83dcd15e2f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:41.033199 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d759d33-f90c-44cb-81b3-83dcd15e2f31 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:41.033683 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d759d33-f90c-44cb-81b3-83dcd15e2f31 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:41.034169 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d759d33-f90c-44cb-81b3-83dcd15e2f31 None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:41.035557 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d759d33-f90c-44cb-81b3-83dcd15e2f31 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:41.036088 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d759d33-f90c-44cb-81b3-83dcd15e2f31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:41.039236 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d759d33-f90c-44cb-81b3-83dcd15e2f31 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:41.047708 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e0821b-b39a-4922-957c-4923e9314b1d None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:41.058693 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 344/684] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 12:16:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:41.058693 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d759d33-f90c-44cb-81b3-83dcd15e2f31 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:41.070887 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:41.093511 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa05a4b9-9084-40d9-9eab-7474c7004500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:41.094322 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa05a4b9-9084-40d9-9eab-7474c7004500 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:41.094666 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa05a4b9-9084-40d9-9eab-7474c7004500 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:41.095033 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa05a4b9-9084-40d9-9eab-7474c7004500 None admin] PATH_INFO: `/v3/projects` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:41.096231 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa05a4b9-9084-40d9-9eab-7474c7004500 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:41.096536 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa05a4b9-9084-40d9-9eab-7474c7004500 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:41.098269 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa05a4b9-9084-40d9-9eab-7474c7004500 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:41.116253 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 341/685] 10.222.0.79 () {56 vars in 1148 bytes} [Wed Aug 31 12:16:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:41.118031 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa05a4b9-9084-40d9-9eab-7474c7004500 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:41.191246 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d759d33-f90c-44cb-81b3-83dcd15e2f31 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:41.201715 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:41.230804 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8611b198-4cba-4107-abb7-a231524d199e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:41.231455 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8611b198-4cba-4107-abb7-a231524d199e None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:41.231746 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8611b198-4cba-4107-abb7-a231524d199e None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:41.232003 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8611b198-4cba-4107-abb7-a231524d199e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:41.278261 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa05a4b9-9084-40d9-9eab-7474c7004500 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:41.314529 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8611b198-4cba-4107-abb7-a231524d199e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:41.316018 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8611b198-4cba-4107-abb7-a231524d199e None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:41.325032 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a7f37-01ce-492a-b19d-81fc29c6a795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:41.325970 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a7f37-01ce-492a-b19d-81fc29c6a795 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:41.326814 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a7f37-01ce-492a-b19d-81fc29c6a795 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:41.327289 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a7f37-01ce-492a-b19d-81fc29c6a795 None admin] PATH_INFO: `/v3/projects` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:41.328535 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888a7f37-01ce-492a-b19d-81fc29c6a795 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:41.329184 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888a7f37-01ce-492a-b19d-81fc29c6a795 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:41.331016 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888a7f37-01ce-492a-b19d-81fc29c6a795 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:41.347455 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 342/686] 10.222.0.79 () {56 vars in 1148 bytes} [Wed Aug 31 12:16:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:41.348437 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a7f37-01ce-492a-b19d-81fc29c6a795 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:41.419339 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:41.459045 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 345/687] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 12:16:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:16:41.460201 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8611b198-4cba-4107-abb7-a231524d199e None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:41.480472 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:41.537973 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a7f37-01ce-492a-b19d-81fc29c6a795 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:41.606269 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c798fc-5a11-4bec-8a66-fc7912255674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:41.607155 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c798fc-5a11-4bec-8a66-fc7912255674 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:41.607750 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c798fc-5a11-4bec-8a66-fc7912255674 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:41.608035 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c798fc-5a11-4bec-8a66-fc7912255674 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:41.617290 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8611b198-4cba-4107-abb7-a231524d199e None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:41.621161 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c798fc-5a11-4bec-8a66-fc7912255674 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:41.623669 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c798fc-5a11-4bec-8a66-fc7912255674 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:41.640006 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-a7c798fc-5a11-4bec-8a66-fc7912255674 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:41.640006 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:41.640006 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:41.640006 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:41.640006 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:41.640006 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:41.640006 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:41.640006 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:41.640006 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:41.640006 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:41.640006 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:41.640006 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:41.640006 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:16:41.640006 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:16:41.640006 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:16:41.640006 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:16:41.649954 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:41.649954 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:41.649954 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:41.649954 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:41.649954 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:41.649954 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:41.649954 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:41.649954 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:41.649954 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:41.649954 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:41.649954 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:41.649954 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:41.649954 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:41.649954 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:41.649954 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:41.649954 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:41.649954 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:16:41.652208 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:16:41.652208 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:41.652208 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:16:41.652208 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 343/688] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:16:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:41.652208 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c798fc-5a11-4bec-8a66-fc7912255674 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:41.695505 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00147b1c-6685-4e68-a3d0-828b8fb56c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:41.697174 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00147b1c-6685-4e68-a3d0-828b8fb56c14 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:41.697627 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00147b1c-6685-4e68-a3d0-828b8fb56c14 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:41.698070 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00147b1c-6685-4e68-a3d0-828b8fb56c14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:41.699332 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00147b1c-6685-4e68-a3d0-828b8fb56c14 None admin] RBAC: Adding query filter params (role.id=37fee7a104964826a0762987a1531a9a, scope.project.id=a94f4957f2a047cc844342e1c7c74ca5, user.id=e79503178ac54e62ba385467d5617ea1) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:41.699757 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00147b1c-6685-4e68-a3d0-828b8fb56c14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:41.702295 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00147b1c-6685-4e68-a3d0-828b8fb56c14 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:41.718886 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 346/689] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 12:16:41 2022] GET /identity/v3/role_assignments?user.id=e79503178ac54e62ba385467d5617ea1&scope.project.id=a94f4957f2a047cc844342e1c7c74ca5&role.id=37fee7a104964826a0762987a1531a9a => generated 608 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:41.718886 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00147b1c-6685-4e68-a3d0-828b8fb56c14 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:41.846879 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:41.871662 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:41.875209 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c798fc-5a11-4bec-8a66-fc7912255674 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:41.932825 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00147b1c-6685-4e68-a3d0-828b8fb56c14 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:41.954746 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399de5a8-b0d8-4ce9-8d7c-477427bac179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:41.956268 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399de5a8-b0d8-4ce9-8d7c-477427bac179 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:41.957031 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399de5a8-b0d8-4ce9-8d7c-477427bac179 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:41.957774 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399de5a8-b0d8-4ce9-8d7c-477427bac179 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:41.959394 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399de5a8-b0d8-4ce9-8d7c-477427bac179 None admin] RBAC: Adding query filter params (role.id=37fee7a104964826a0762987a1531a9a, scope.project.id=a94f4957f2a047cc844342e1c7c74ca5, user.id=1569b43c774c45ff80577d879ba9d819) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:41.960353 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399de5a8-b0d8-4ce9-8d7c-477427bac179 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:41.964051 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399de5a8-b0d8-4ce9-8d7c-477427bac179 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:41.975665 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 344/690] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 12:16:41 2022] GET /identity/v3/role_assignments?user.id=1569b43c774c45ff80577d879ba9d819&scope.project.id=a94f4957f2a047cc844342e1c7c74ca5&role.id=37fee7a104964826a0762987a1531a9a => generated 608 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:41.977952 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399de5a8-b0d8-4ce9-8d7c-477427bac179 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:42.002721 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322e9fc8-3f15-4936-8ab9-5a8b97b1ac15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:42.003990 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322e9fc8-3f15-4936-8ab9-5a8b97b1ac15 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:42.004456 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322e9fc8-3f15-4936-8ab9-5a8b97b1ac15 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:42.004912 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322e9fc8-3f15-4936-8ab9-5a8b97b1ac15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:42.030655 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322e9fc8-3f15-4936-8ab9-5a8b97b1ac15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:42.033652 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322e9fc8-3f15-4936-8ab9-5a8b97b1ac15 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:42.068388 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-322e9fc8-3f15-4936-8ab9-5a8b97b1ac15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:42.068388 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:42.068388 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:42.068388 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:42.068388 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:42.068388 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:42.068388 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:42.068388 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:42.068388 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:42.068388 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:42.068388 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:42.068388 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:42.068388 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:16:42.068388 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:16:42.068388 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:16:42.068388 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:16:42.070802 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:42.070802 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:42.070802 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:42.070802 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:42.070802 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:42.070802 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:42.070802 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:42.070802 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:42.070802 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:42.070802 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:42.070802 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:42.070802 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:42.070802 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:42.070802 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:42.070802 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:42.070802 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:42.070802 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:16:42.072825 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:16:42.072825 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:42.072825 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:16:42.079190 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 347/691] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:16:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:42.081348 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322e9fc8-3f15-4936-8ab9-5a8b97b1ac15 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:42.208185 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399de5a8-b0d8-4ce9-8d7c-477427bac179 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:42.262083 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2808e51d-b6c3-4071-80ff-d45f0753af1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:42.262926 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2808e51d-b6c3-4071-80ff-d45f0753af1a None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:42.263145 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2808e51d-b6c3-4071-80ff-d45f0753af1a None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:42.263419 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2808e51d-b6c3-4071-80ff-d45f0753af1a None admin] PATH_INFO: `/v3/domains` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:42.264074 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2808e51d-b6c3-4071-80ff-d45f0753af1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:42.264376 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2808e51d-b6c3-4071-80ff-d45f0753af1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:42.266572 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2808e51d-b6c3-4071-80ff-d45f0753af1a None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:42.284468 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 345/692] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 12:16:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:42.294440 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2808e51d-b6c3-4071-80ff-d45f0753af1a None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:42.323695 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:42.332281 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322e9fc8-3f15-4936-8ab9-5a8b97b1ac15 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:42.359428 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:42.373187 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874623e6-f1be-47cc-93f5-c11268bca447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:42.374093 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874623e6-f1be-47cc-93f5-c11268bca447 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:42.375377 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874623e6-f1be-47cc-93f5-c11268bca447 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:42.375816 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874623e6-f1be-47cc-93f5-c11268bca447 None admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:42.376651 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874623e6-f1be-47cc-93f5-c11268bca447 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:42.377163 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874623e6-f1be-47cc-93f5-c11268bca447 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:42.378713 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874623e6-f1be-47cc-93f5-c11268bca447 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:42.394018 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 348/693] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 12:16:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:42.408577 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874623e6-f1be-47cc-93f5-c11268bca447 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:42.510471 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2808e51d-b6c3-4071-80ff-d45f0753af1a None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:42.592424 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d816a96e-fb8b-4fad-854d-c8eacb0537d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:42.593075 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d816a96e-fb8b-4fad-854d-c8eacb0537d2 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:42.593351 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d816a96e-fb8b-4fad-854d-c8eacb0537d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:42.593617 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d816a96e-fb8b-4fad-854d-c8eacb0537d2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:42.602813 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d816a96e-fb8b-4fad-854d-c8eacb0537d2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:42.604581 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d816a96e-fb8b-4fad-854d-c8eacb0537d2 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:42.619247 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-d816a96e-fb8b-4fad-854d-c8eacb0537d2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 12:16:42.619247 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:42.619247 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:42.619247 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:42.619247 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:42.619247 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:42.619247 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:42.619247 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:42.619247 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:42.619247 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:42.619247 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:42.619247 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:42.619247 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:16:42.619247 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:16:42.619247 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:16:42.619247 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:16:42.621414 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:42.621414 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:42.621414 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:16:42.621414 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:16:42.621414 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:16:42.621414 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:16:42.621414 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:42.621414 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:42.621414 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:42.621414 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:42.621414 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:42.621414 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:42.621414 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:42.621414 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:42.621414 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:42.621414 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:42.621414 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:42.621414 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:42.623620 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:42.623620 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:42.623620 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:16:42.623620 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:16:42.623620 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:16:42.623620 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:16:42.623620 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:16:42.623620 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:16:42.623620 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 12:16:42.623620 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:16:42.623620 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 346/694] 10.222.0.79 () {56 vars in 1093 bytes} [Wed Aug 31 12:16:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:42.625210 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efdf9d7-c1e1-43b1-bb31-361b000119df None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:42.625586 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efdf9d7-c1e1-43b1-bb31-361b000119df None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:42.625945 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efdf9d7-c1e1-43b1-bb31-361b000119df None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:42.627743 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 347/695] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:16:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:16:42.628592 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efdf9d7-c1e1-43b1-bb31-361b000119df None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:42.646628 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874623e6-f1be-47cc-93f5-c11268bca447 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:42.707257 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15f947e-5375-4435-bbaf-bfa34a58b8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:42.708897 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f947e-5375-4435-bbaf-bfa34a58b8b7 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:42.709799 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f947e-5375-4435-bbaf-bfa34a58b8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:42.711405 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f947e-5375-4435-bbaf-bfa34a58b8b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:42.722239 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15f947e-5375-4435-bbaf-bfa34a58b8b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:42.724450 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15f947e-5375-4435-bbaf-bfa34a58b8b7 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:42.733386 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:42.758574 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-b15f947e-5375-4435-bbaf-bfa34a58b8b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:16:42.758574 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:42.758574 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:42.758574 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:42.758574 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:42.758574 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:42.758574 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:42.758574 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:42.758574 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:42.758574 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:42.758574 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:42.758574 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:42.758574 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:16:42.758574 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:16:42.758574 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:16:42.759867 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:16:42.759867 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:42.759867 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:42.759867 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:42.759867 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:42.759867 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:42.759867 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:42.759867 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:42.759867 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:42.759867 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:42.759867 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:42.759867 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:42.759867 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:42.759867 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:42.759867 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:42.759867 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:42.759867 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:42.761040 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:16:42.761040 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:16:42.761040 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:16:42.761040 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:16:42.761040 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:16:42.761040 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:16:42.761040 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:16:42.761040 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:16:42.764081 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 349/696] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 12:16:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:16:42.765606 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699633c-4fcb-477f-9b97-be5a74b34852 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:42.766031 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699633c-4fcb-477f-9b97-be5a74b34852 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:42.766448 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699633c-4fcb-477f-9b97-be5a74b34852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:42.784498 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efdf9d7-c1e1-43b1-bb31-361b000119df None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:42.796561 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-a699633c-4fcb-477f-9b97-be5a74b34852 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:42.798772 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-a699633c-4fcb-477f-9b97-be5a74b34852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:42.833768 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e720d3-1464-48d3-aac8-ba460097a143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:42.834607 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e720d3-1464-48d3-aac8-ba460097a143 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:42.835289 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e720d3-1464-48d3-aac8-ba460097a143 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:42.835637 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e720d3-1464-48d3-aac8-ba460097a143 None admin] PATH_INFO: `/v3/users` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:42.836932 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e720d3-1464-48d3-aac8-ba460097a143 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:42.837240 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e720d3-1464-48d3-aac8-ba460097a143 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:42.839227 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e720d3-1464-48d3-aac8-ba460097a143 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:42.859012 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:42.869113 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 348/697] 10.222.0.79 () {56 vars in 1133 bytes} [Wed Aug 31 12:16:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:42.869673 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e720d3-1464-48d3-aac8-ba460097a143 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:42.904070 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 350/698] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:16:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:16:42.905291 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a699633c-4fcb-477f-9b97-be5a74b34852 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:43.020066 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a699633c-4fcb-477f-9b97-be5a74b34852 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:43.116045 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e720d3-1464-48d3-aac8-ba460097a143 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:43.128772 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bbd6b6-f6b5-479c-975b-141755101fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:43.129407 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bbd6b6-f6b5-479c-975b-141755101fbb None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:43.129685 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bbd6b6-f6b5-479c-975b-141755101fbb None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:43.129953 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bbd6b6-f6b5-479c-975b-141755101fbb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:43.200469 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:43.201099 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:43.223672 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626372a9-d441-4d06-87bc-6ba4646b0a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:43.224305 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626372a9-d441-4d06-87bc-6ba4646b0a8b None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:43.224580 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626372a9-d441-4d06-87bc-6ba4646b0a8b None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:43.224863 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626372a9-d441-4d06-87bc-6ba4646b0a8b None admin] PATH_INFO: `/v3/projects` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:43.225553 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626372a9-d441-4d06-87bc-6ba4646b0a8b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:43.225951 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626372a9-d441-4d06-87bc-6ba4646b0a8b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:43.227495 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626372a9-d441-4d06-87bc-6ba4646b0a8b None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:43.231860 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bbd6b6-f6b5-479c-975b-141755101fbb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:43.233332 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bbd6b6-f6b5-479c-975b-141755101fbb None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:43.257748 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 349/699] 10.222.0.79 () {56 vars in 1148 bytes} [Wed Aug 31 12:16:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:43.274559 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626372a9-d441-4d06-87bc-6ba4646b0a8b None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:43.373076 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 351/700] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 12:16:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:16:43.374627 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bbd6b6-f6b5-479c-975b-141755101fbb None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:43.471275 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:43.482310 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626372a9-d441-4d06-87bc-6ba4646b0a8b None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:43.508839 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bbd6b6-f6b5-479c-975b-141755101fbb None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:43.533779 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4801a751-a1a3-40d1-be89-a4bc874eab0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:43.534921 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801a751-a1a3-40d1-be89-a4bc874eab0b None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:43.535522 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801a751-a1a3-40d1-be89-a4bc874eab0b None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:43.536132 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801a751-a1a3-40d1-be89-a4bc874eab0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:43.539378 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4801a751-a1a3-40d1-be89-a4bc874eab0b None admin] RBAC: Adding query filter params (role.id=37fee7a104964826a0762987a1531a9a, scope.project.id=a94f4957f2a047cc844342e1c7c74ca5, user.id=4896540cc14f40b08d05ade32cfd0f37) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:43.540270 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4801a751-a1a3-40d1-be89-a4bc874eab0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:43.543961 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4801a751-a1a3-40d1-be89-a4bc874eab0b None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:43.558529 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48b0fb1-d5bb-470e-ae3b-911df4d090e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:43.559863 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b0fb1-d5bb-470e-ae3b-911df4d090e8 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:43.560358 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b0fb1-d5bb-470e-ae3b-911df4d090e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:43.560807 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b0fb1-d5bb-470e-ae3b-911df4d090e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:43.564008 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 350/701] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 12:16:43 2022] GET /identity/v3/role_assignments?user.id=4896540cc14f40b08d05ade32cfd0f37&scope.project.id=a94f4957f2a047cc844342e1c7c74ca5&role.id=37fee7a104964826a0762987a1531a9a => generated 608 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:16:43.566326 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4801a751-a1a3-40d1-be89-a4bc874eab0b None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:43.577262 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48b0fb1-d5bb-470e-ae3b-911df4d090e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:43.579527 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48b0fb1-d5bb-470e-ae3b-911df4d090e8 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:43.621577 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-e48b0fb1-d5bb-470e-ae3b-911df4d090e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:43.621577 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:43.621577 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:43.621577 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:43.621577 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:43.621577 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:43.621577 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:43.621577 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:43.621577 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:43.621577 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:43.621577 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:43.621577 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:43.621577 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:16:43.621577 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:16:43.621577 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:16:43.621577 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:16:43.623820 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:43.623820 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:43.623820 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:43.623820 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:43.623820 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:43.623820 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:43.623820 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:43.623820 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:43.623820 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:43.623820 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:43.623820 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:43.623820 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:43.623820 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:43.623820 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:43.623820 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:43.623820 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:43.623820 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:16:43.625806 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:16:43.625806 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:43.625806 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:16:43.630526 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 352/702] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:16:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:16:43.653126 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48b0fb1-d5bb-470e-ae3b-911df4d090e8 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:43.731606 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:43.828299 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4801a751-a1a3-40d1-be89-a4bc874eab0b None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:43.892485 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebcc907-06cb-4c38-85ee-53d545fe9568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:43.893600 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebcc907-06cb-4c38-85ee-53d545fe9568 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:43.894079 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebcc907-06cb-4c38-85ee-53d545fe9568 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:43.894522 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebcc907-06cb-4c38-85ee-53d545fe9568 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:43.898585 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48b0fb1-d5bb-470e-ae3b-911df4d090e8 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:43.918379 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebcc907-06cb-4c38-85ee-53d545fe9568 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:43.922730 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebcc907-06cb-4c38-85ee-53d545fe9568 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:43.931388 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:43.944309 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cb6a2b-2cd3-4928-b066-93732885d801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:43.945562 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cb6a2b-2cd3-4928-b066-93732885d801 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:43.946066 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cb6a2b-2cd3-4928-b066-93732885d801 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:43.946342 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cb6a2b-2cd3-4928-b066-93732885d801 None admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:43.947085 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cb6a2b-2cd3-4928-b066-93732885d801 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:43.947394 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cb6a2b-2cd3-4928-b066-93732885d801 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:43.948818 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cb6a2b-2cd3-4928-b066-93732885d801 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:43.958452 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-8ebcc907-06cb-4c38-85ee-53d545fe9568 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:43.958452 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:43.958452 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:43.958452 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:43.958452 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:43.958452 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:43.958452 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:43.958452 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:43.958452 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:43.958452 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:43.958452 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:43.958452 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:43.958452 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:16:43.958452 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:16:43.958452 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:16:43.958452 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:16:43.959547 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:43.959547 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:43.959547 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:43.959547 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:43.959547 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:43.959547 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:43.959547 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:43.959547 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:43.959547 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:43.959547 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:43.959547 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:43.959547 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:43.959547 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:43.959547 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:43.959547 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:43.959547 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:43.959547 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:16:43.960625 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:16:43.960625 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:43.960625 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:16:43.961638 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 351/703] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:16:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 396 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:43.964144 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 353/704] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 12:16:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:16:43.976037 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cb6a2b-2cd3-4928-b066-93732885d801 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:43.976380 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebcc907-06cb-4c38-85ee-53d545fe9568 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:44.097043 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cb6a2b-2cd3-4928-b066-93732885d801 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:44.138370 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf74e4df-181f-495d-98b8-11b3ee1e31ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:44.139572 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf74e4df-181f-495d-98b8-11b3ee1e31ac None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:44.139860 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf74e4df-181f-495d-98b8-11b3ee1e31ac None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:44.140132 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf74e4df-181f-495d-98b8-11b3ee1e31ac None admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:44.140799 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf74e4df-181f-495d-98b8-11b3ee1e31ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:44.141100 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf74e4df-181f-495d-98b8-11b3ee1e31ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:44.142511 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf74e4df-181f-495d-98b8-11b3ee1e31ac None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:44.159259 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 354/705] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 12:16:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:44.165341 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf74e4df-181f-495d-98b8-11b3ee1e31ac None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:44.168402 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebcc907-06cb-4c38-85ee-53d545fe9568 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:44.191226 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:44.252933 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1428c99a-d55d-456a-aa31-c247ad6d1ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:44.253737 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1428c99a-d55d-456a-aa31-c247ad6d1ebe None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:44.254100 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1428c99a-d55d-456a-aa31-c247ad6d1ebe None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:44.254733 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1428c99a-d55d-456a-aa31-c247ad6d1ebe None admin] PATH_INFO: `/v3/projects/service` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:44.255810 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:44.270841 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1428c99a-d55d-456a-aa31-c247ad6d1ebe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:44.275209 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1428c99a-d55d-456a-aa31-c247ad6d1ebe None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:44.302536 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-1428c99a-d55d-456a-aa31-c247ad6d1ebe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:16:44.302536 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:44.302536 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:44.302536 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:44.302536 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:44.302536 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:44.302536 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:44.302536 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:44.302536 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:44.302536 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:44.302536 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:44.302536 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:44.302536 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:16:44.302536 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:16:44.302536 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:16:44.303571 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:16:44.303571 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:44.303571 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:44.303571 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:44.303571 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:44.303571 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:44.303571 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:44.303571 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:44.303571 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:44.303571 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:44.303571 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:44.303571 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:44.303571 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:44.303571 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:44.303571 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:44.303571 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:44.303571 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:44.304912 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:16:44.304912 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:16:44.304912 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:16:44.304912 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:16:44.304912 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:16:44.304912 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:16:44.304912 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:16:44.304912 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:16:44.304912 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 352/706] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 12:16:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:44.325132 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1428c99a-d55d-456a-aa31-c247ad6d1ebe None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:44.326770 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf74e4df-181f-495d-98b8-11b3ee1e31ac None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:44.376927 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145bcfa1-1514-488c-8bf8-5b810f9abc11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:44.377455 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145bcfa1-1514-488c-8bf8-5b810f9abc11 None admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:44.377734 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145bcfa1-1514-488c-8bf8-5b810f9abc11 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:44.377991 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145bcfa1-1514-488c-8bf8-5b810f9abc11 None admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:44.378681 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145bcfa1-1514-488c-8bf8-5b810f9abc11 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:44.380839 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145bcfa1-1514-488c-8bf8-5b810f9abc11 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:44.414424 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 355/707] 10.222.0.79 () {60 vars in 1132 bytes} [Wed Aug 31 12:16:44 2022] POST /identity/v3/users => generated 254 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:16:44.415902 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f66ff-cb81-4ab5-a4e2-e0df825fdb50 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:44.416238 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f66ff-cb81-4ab5-a4e2-e0df825fdb50 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:44.416481 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f66ff-cb81-4ab5-a4e2-e0df825fdb50 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:44.418243 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 356/708] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:16:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:16:44.425102 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253dbf4-6713-4dc2-80c9-d797d1983cee None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:44.425543 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253dbf4-6713-4dc2-80c9-d797d1983cee None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:44.425805 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253dbf4-6713-4dc2-80c9-d797d1983cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:44.471036 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-b253dbf4-6713-4dc2-80c9-d797d1983cee None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:44.472369 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-b253dbf4-6713-4dc2-80c9-d797d1983cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:44.497477 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1428c99a-d55d-456a-aa31-c247ad6d1ebe None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:44.542439 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813ad1ed-dab1-4096-a565-f95203b7c23f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:44.543120 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ad1ed-dab1-4096-a565-f95203b7c23f None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:44.543404 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ad1ed-dab1-4096-a565-f95203b7c23f None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:44.543673 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ad1ed-dab1-4096-a565-f95203b7c23f None admin] PATH_INFO: `/v3/projects` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:44.544414 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813ad1ed-dab1-4096-a565-f95203b7c23f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:44.544727 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813ad1ed-dab1-4096-a565-f95203b7c23f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:44.546269 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813ad1ed-dab1-4096-a565-f95203b7c23f None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:44.562099 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 353/709] 10.222.0.79 () {56 vars in 1148 bytes} [Wed Aug 31 12:16:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:44.568694 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813ad1ed-dab1-4096-a565-f95203b7c23f None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:44.607143 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:44.683134 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 357/710] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:16:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:16:44.684095 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd4043-64ab-4d5d-ae68-c523728cab40 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:44.684563 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd4043-64ab-4d5d-ae68-c523728cab40 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:44.684800 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd4043-64ab-4d5d-ae68-c523728cab40 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:44.686493 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 358/711] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:16:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:16:44.693093 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a67b3-96d7-4288-8736-6021cc3a459f None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:44.693421 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a67b3-96d7-4288-8736-6021cc3a459f None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:44.693716 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a67b3-96d7-4288-8736-6021cc3a459f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:44.722482 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-0d0a67b3-96d7-4288-8736-6021cc3a459f None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:44.723792 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-0d0a67b3-96d7-4288-8736-6021cc3a459f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:44.728729 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813ad1ed-dab1-4096-a565-f95203b7c23f None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:44.756229 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:44.800802 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c604a93-6813-4502-b107-d9ec0b268d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:44.801431 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c604a93-6813-4502-b107-d9ec0b268d1c None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:44.801710 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c604a93-6813-4502-b107-d9ec0b268d1c None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:44.801980 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c604a93-6813-4502-b107-d9ec0b268d1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:44.802798 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c604a93-6813-4502-b107-d9ec0b268d1c None admin] RBAC: Adding query filter params (role.id=a332ef951db949b0bad7019fbd28a1b9, scope.project.id=a94f4957f2a047cc844342e1c7c74ca5, user.id=62401c8e1457450590f4147e0665265a) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:44.803255 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c604a93-6813-4502-b107-d9ec0b268d1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:44.805359 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c604a93-6813-4502-b107-d9ec0b268d1c None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:44.808777 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 359/712] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:16:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:16:44.818271 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 354/713] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 12:16:44 2022] GET /identity/v3/role_assignments?user.id=62401c8e1457450590f4147e0665265a&scope.project.id=a94f4957f2a047cc844342e1c7c74ca5&role.id=a332ef951db949b0bad7019fbd28a1b9 => generated 259 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:45.119895 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0a67b3-96d7-4288-8736-6021cc3a459f None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:45.183589 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c604a93-6813-4502-b107-d9ec0b268d1c None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:45.252724 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0a67b3-96d7-4288-8736-6021cc3a459f None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:45.306359 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae7a939-24e7-4d41-ab21-5b694531f03a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:45.307043 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae7a939-24e7-4d41-ab21-5b694531f03a None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:45.307323 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae7a939-24e7-4d41-ab21-5b694531f03a None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:45.307589 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae7a939-24e7-4d41-ab21-5b694531f03a None admin] PATH_INFO: `/v3/services/network` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:45.308191 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae7a939-24e7-4d41-ab21-5b694531f03a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:45.309606 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae7a939-24e7-4d41-ab21-5b694531f03a None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:45.337302 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-bae7a939-24e7-4d41-ab21-5b694531f03a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 12:16:45.337302 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:45.337302 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 12:16:45.337302 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 12:16:45.337302 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 12:16:45.337302 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 12:16:45.337302 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 12:16:45.337302 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:16:45.337302 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 12:16:45.337302 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:16:45.337302 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:16:45.337302 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:16:45.337302 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:45.337302 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:45.337302 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:45.337302 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:45.337302 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:45.339951 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:45.339951 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:45.339951 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:45.339951 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:45.339951 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:45.339951 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:45.339951 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 12:16:45.339951 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 12:16:45.339951 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 12:16:45.339951 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 12:16:45.339951 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:45.339951 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:45.339951 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:45.339951 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:45.339951 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:45.339951 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:45.342004 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:45.342004 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:45.342004 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:45.342004 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:45.342004 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:45.342004 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:45.342004 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:45.342004 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:45.342004 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:45.342004 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:45.342004 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 12:16:45.342004 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:16:45.342004 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 12:16:45.342004 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:16:45.342004 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 360/714] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 12:16:45 2022] GET /identity/v3/services/network => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:45.345530 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae7a939-24e7-4d41-ab21-5b694531f03a None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:45.407439 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:45.415252 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:45.435882 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c604a93-6813-4502-b107-d9ec0b268d1c None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:45.511843 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae7a939-24e7-4d41-ab21-5b694531f03a None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:45.527639 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2e8650-d9e1-44a1-99ed-ef28e74996ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:45.528683 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2e8650-d9e1-44a1-99ed-ef28e74996ab None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:45.529161 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2e8650-d9e1-44a1-99ed-ef28e74996ab None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:45.529716 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2e8650-d9e1-44a1-99ed-ef28e74996ab None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:45.530542 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2e8650-d9e1-44a1-99ed-ef28e74996ab None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:45.532182 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2e8650-d9e1-44a1-99ed-ef28e74996ab None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:45.552414 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425d2fc0-363b-4a15-b73a-1934c2c0e018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:45.557890 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d2fc0-363b-4a15-b73a-1934c2c0e018 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:45.557890 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d2fc0-363b-4a15-b73a-1934c2c0e018 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:45.557890 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d2fc0-363b-4a15-b73a-1934c2c0e018 None admin] PATH_INFO: `/v3/services` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:45.557890 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425d2fc0-363b-4a15-b73a-1934c2c0e018 None admin] RBAC: Adding query filter params (name=network) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:45.557890 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425d2fc0-363b-4a15-b73a-1934c2c0e018 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:45.557890 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425d2fc0-363b-4a15-b73a-1934c2c0e018 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:45.558595 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-4d2e8650-d9e1-44a1-99ed-ef28e74996ab None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 12:16:45.558595 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:45.558595 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 12:16:45.558595 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 12:16:45.558595 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 12:16:45.558595 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 12:16:45.558595 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 12:16:45.558595 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:16:45.558595 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 12:16:45.558595 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:16:45.558595 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:16:45.558595 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:16:45.558595 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:45.558595 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:45.558595 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:45.558595 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:45.558595 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:45.559623 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:45.559623 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:45.559623 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:45.559623 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:45.559623 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:45.559623 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:45.559623 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 12:16:45.559623 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 12:16:45.559623 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 12:16:45.559623 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 12:16:45.559623 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:45.559623 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:45.559623 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:45.559623 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:45.559623 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:45.559623 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:45.560488 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:45.560488 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:45.560488 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:45.560488 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:45.560488 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:45.560488 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:45.560488 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:45.560488 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:45.560488 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:45.560488 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:45.560488 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 12:16:45.560488 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:16:45.560488 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 12:16:45.560488 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:16:45.562301 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 361/715] 10.222.0.79 () {56 vars in 1112 bytes} [Wed Aug 31 12:16:45 2022] GET /identity/v3/services?name=network => generated 124 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:45.567285 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 355/716] 10.222.0.79 () {56 vars in 1129 bytes} [Wed Aug 31 12:16:45 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 385 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:45.571514 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425d2fc0-363b-4a15-b73a-1934c2c0e018 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:45.574263 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2e8650-d9e1-44a1-99ed-ef28e74996ab None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:45.680811 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:45.688959 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425d2fc0-363b-4a15-b73a-1934c2c0e018 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:45.730035 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb329e-fc72-4ca5-94ec-c0eb767f8b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:45.730659 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb329e-fc72-4ca5-94ec-c0eb767f8b35 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:45.731210 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb329e-fc72-4ca5-94ec-c0eb767f8b35 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:45.731486 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb329e-fc72-4ca5-94ec-c0eb767f8b35 None admin] PATH_INFO: `/v3/services` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:45.734645 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeb329e-fc72-4ca5-94ec-c0eb767f8b35 None admin] RBAC: Adding query filter params (type=network) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:45.734988 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeb329e-fc72-4ca5-94ec-c0eb767f8b35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:45.736420 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeb329e-fc72-4ca5-94ec-c0eb767f8b35 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:45.749113 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 362/717] 10.222.0.79 () {56 vars in 1112 bytes} [Wed Aug 31 12:16:45 2022] GET /identity/v3/services?type=network => generated 124 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:16:45.789028 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2e8650-d9e1-44a1-99ed-ef28e74996ab None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:45.847235 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ec6e2a-a0db-4aed-83d2-7f4ce3d4cea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:45.847921 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec6e2a-a0db-4aed-83d2-7f4ce3d4cea4 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:45.848204 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec6e2a-a0db-4aed-83d2-7f4ce3d4cea4 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:45.848476 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec6e2a-a0db-4aed-83d2-7f4ce3d4cea4 None admin] PATH_INFO: `/v3/services` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:45.849120 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ec6e2a-a0db-4aed-83d2-7f4ce3d4cea4 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:45.849419 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ec6e2a-a0db-4aed-83d2-7f4ce3d4cea4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:45.850823 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ec6e2a-a0db-4aed-83d2-7f4ce3d4cea4 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:45.859231 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 356/718] 10.222.0.79 () {56 vars in 1124 bytes} [Wed Aug 31 12:16:45 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:16:45.866154 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb329e-fc72-4ca5-94ec-c0eb767f8b35 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:46.052259 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb329e-fc72-4ca5-94ec-c0eb767f8b35 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:46.090614 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c61c86-20cc-4759-b5ba-225f54b1f69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:46.091292 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c61c86-20cc-4759-b5ba-225f54b1f69b None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:46.091573 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c61c86-20cc-4759-b5ba-225f54b1f69b None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:46.091848 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c61c86-20cc-4759-b5ba-225f54b1f69b None admin] PATH_INFO: `/v3/services` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:46.092493 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c61c86-20cc-4759-b5ba-225f54b1f69b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:46.092800 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c61c86-20cc-4759-b5ba-225f54b1f69b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:46.094195 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c61c86-20cc-4759-b5ba-225f54b1f69b None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:46.099959 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 363/719] 10.222.0.79 () {56 vars in 1124 bytes} [Wed Aug 31 12:16:45 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:16:46.661886 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96acccd-317a-4090-a95e-e5bed6b3e93e None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:46.662622 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96acccd-317a-4090-a95e-e5bed6b3e93e None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:46.662622 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96acccd-317a-4090-a95e-e5bed6b3e93e None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:46.664710 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 357/720] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:16:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:16:46.676848 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a922b2-394e-40b8-a6f9-86a0519c0d38 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:46.677625 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a922b2-394e-40b8-a6f9-86a0519c0d38 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:46.677625 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a922b2-394e-40b8-a6f9-86a0519c0d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:46.704699 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-d7a922b2-394e-40b8-a6f9-86a0519c0d38 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:46.706609 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-d7a922b2-394e-40b8-a6f9-86a0519c0d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:46.742571 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:46.885206 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 364/721] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:16:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:16:47.172317 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96acccd-317a-4090-a95e-e5bed6b3e93e None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:47.195164 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:47.218124 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928dbc5c-756d-4b9c-a868-0e69fb8c89ab None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:47.218798 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928dbc5c-756d-4b9c-a868-0e69fb8c89ab None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:47.219312 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928dbc5c-756d-4b9c-a868-0e69fb8c89ab None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:47.221319 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 365/722] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:16:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:16:47.227282 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252a6cb-db2c-444c-81fc-71a438b863c3 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:47.227893 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252a6cb-db2c-444c-81fc-71a438b863c3 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:47.228360 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252a6cb-db2c-444c-81fc-71a438b863c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:47.256896 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-9252a6cb-db2c-444c-81fc-71a438b863c3 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:47.259384 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-9252a6cb-db2c-444c-81fc-71a438b863c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:47.368371 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96acccd-317a-4090-a95e-e5bed6b3e93e None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:47.395353 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 366/723] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:16:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 12:16:47.456955 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee70e52-ecea-4436-a6fe-b5244459b759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:47.458555 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee70e52-ecea-4436-a6fe-b5244459b759 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:47.459393 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee70e52-ecea-4436-a6fe-b5244459b759 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:47.460166 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee70e52-ecea-4436-a6fe-b5244459b759 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:47.489577 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee70e52-ecea-4436-a6fe-b5244459b759 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:16:47.494839 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-5ee70e52-ecea-4436-a6fe-b5244459b759 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:16:47.494839 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:47.494839 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:47.494839 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:47.494839 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:47.494839 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:47.494839 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:47.494839 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:47.494839 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:47.494839 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:47.494839 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:47.494839 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:47.494839 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:16:47.494839 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:16:47.494839 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:16:47.494839 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:16:47.497124 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:16:47.497124 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:16:47.497124 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:16:47.497124 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:16:47.497124 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:47.497124 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:47.497124 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:47.497124 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:47.497124 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:47.497124 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:47.497124 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:47.497124 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:47.497124 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:47.497124 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:47.497124 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:47.497124 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:47.498766 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:47.498766 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:47.498766 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:47.498766 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:47.498766 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:16:47.498766 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:16:47.498766 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:16:47.498766 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:16:47.498766 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:16:47.498766 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:16:47.498766 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:16:47.498766 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:16:47.498766 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 358/724] 10.222.0.79 () {56 vars in 1096 bytes} [Wed Aug 31 12:16:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:47.511022 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9252a6cb-db2c-444c-81fc-71a438b863c3 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:47.672656 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:47.706217 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9252a6cb-db2c-444c-81fc-71a438b863c3 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:47.760618 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c6ac8b-cc52-46e1-ace9-509f5001343c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:47.761260 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c6ac8b-cc52-46e1-ace9-509f5001343c None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:47.761538 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c6ac8b-cc52-46e1-ace9-509f5001343c None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:47.761793 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c6ac8b-cc52-46e1-ace9-509f5001343c None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:47.762491 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c6ac8b-cc52-46e1-ace9-509f5001343c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:47.762814 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c6ac8b-cc52-46e1-ace9-509f5001343c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:47.764280 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c6ac8b-cc52-46e1-ace9-509f5001343c None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:47.781483 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 367/725] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 12:16:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:47.791074 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee70e52-ecea-4436-a6fe-b5244459b759 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:47.821892 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c6ac8b-cc52-46e1-ace9-509f5001343c None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:47.914342 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:47.940754 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee70e52-ecea-4436-a6fe-b5244459b759 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:47.981771 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93db1742-4968-4d05-ab3d-4218f8c6d276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:47.983372 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db1742-4968-4d05-ab3d-4218f8c6d276 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:47.984944 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db1742-4968-4d05-ab3d-4218f8c6d276 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:47.985736 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db1742-4968-4d05-ab3d-4218f8c6d276 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:48.005934 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93db1742-4968-4d05-ab3d-4218f8c6d276 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:48.007625 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93db1742-4968-4d05-ab3d-4218f8c6d276 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:48.028194 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-93db1742-4968-4d05-ab3d-4218f8c6d276 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:48.028194 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:48.028194 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:48.028194 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:48.028194 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:48.028194 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:48.028194 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:48.028194 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:48.028194 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:48.028194 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:48.028194 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:48.028194 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:48.028194 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:16:48.028194 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:16:48.028194 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:16:48.028194 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:16:48.030082 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:48.030082 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:48.030082 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:48.030082 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:48.030082 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:48.030082 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:48.030082 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:48.030082 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:48.030082 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:48.030082 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:48.030082 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:48.030082 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:48.030082 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:48.030082 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:48.030082 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:48.030082 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:48.030082 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:16:48.032449 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:16:48.032449 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:48.032449 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:16:48.034325 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 359/726] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:16:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:48.035847 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e78d0d5-c07b-4e08-96a7-4306f30c6fd7 None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:48.036163 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e78d0d5-c07b-4e08-96a7-4306f30c6fd7 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:48.036440 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e78d0d5-c07b-4e08-96a7-4306f30c6fd7 None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:48.038204 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 360/727] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:16:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:16:48.039793 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e78d0d5-c07b-4e08-96a7-4306f30c6fd7 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:48.048021 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c6ac8b-cc52-46e1-ace9-509f5001343c None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:48.118727 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8260067-c26b-4a3d-96b3-e31bbd99b734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:48.120185 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8260067-c26b-4a3d-96b3-e31bbd99b734 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:48.121015 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8260067-c26b-4a3d-96b3-e31bbd99b734 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:48.121896 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8260067-c26b-4a3d-96b3-e31bbd99b734 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:48.143283 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8260067-c26b-4a3d-96b3-e31bbd99b734 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:16:48.149075 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:48.158723 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-c8260067-c26b-4a3d-96b3-e31bbd99b734 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:16:48.158723 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:48.158723 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:48.158723 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:48.158723 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:48.158723 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:48.158723 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:48.158723 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:48.158723 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:48.158723 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:48.158723 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:48.158723 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:48.158723 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:16:48.158723 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:16:48.158723 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:16:48.158723 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:16:48.160612 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:16:48.160612 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:16:48.160612 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:16:48.160612 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:16:48.160612 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:48.160612 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:48.160612 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:48.160612 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:48.160612 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:48.160612 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:48.160612 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:48.160612 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:48.160612 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:48.160612 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:48.160612 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:48.160612 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:48.162238 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:48.162238 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:48.162238 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:48.162238 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:48.162238 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:16:48.162238 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:16:48.162238 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:16:48.162238 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:16:48.162238 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:16:48.162238 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:16:48.162238 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:16:48.162238 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:16:48.166747 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e78d0d5-c07b-4e08-96a7-4306f30c6fd7 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:48.169702 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 368/728] 10.222.0.79 () {56 vars in 1096 bytes} [Wed Aug 31 12:16:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:48.171451 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d11f1-4855-436b-8018-a2cbcf55764c None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:48.171798 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d11f1-4855-436b-8018-a2cbcf55764c None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:48.172086 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d11f1-4855-436b-8018-a2cbcf55764c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:48.195589 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-8e1d11f1-4855-436b-8018-a2cbcf55764c None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:48.196838 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-8e1d11f1-4855-436b-8018-a2cbcf55764c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:48.236410 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:48.251117 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d882a2e6-353d-493d-a709-a9a530484f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:48.252680 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882a2e6-353d-493d-a709-a9a530484f99 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:48.253424 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882a2e6-353d-493d-a709-a9a530484f99 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:48.254172 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882a2e6-353d-493d-a709-a9a530484f99 None admin] PATH_INFO: `/v3/domains` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:48.256715 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d882a2e6-353d-493d-a709-a9a530484f99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:48.258835 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d882a2e6-353d-493d-a709-a9a530484f99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:48.262442 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d882a2e6-353d-493d-a709-a9a530484f99 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:48.293588 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 361/729] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 12:16:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:48.295853 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d882a2e6-353d-493d-a709-a9a530484f99 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:48.299229 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 369/730] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:16:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:16:48.300310 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1d11f1-4855-436b-8018-a2cbcf55764c None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:48.520618 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d882a2e6-353d-493d-a709-a9a530484f99 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:48.521342 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1d11f1-4855-436b-8018-a2cbcf55764c None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:48.562127 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:48.571301 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf7883d-e3bb-4ddf-a2cb-ee897ceb7bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:48.572451 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7883d-e3bb-4ddf-a2cb-ee897ceb7bce None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:48.573245 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7883d-e3bb-4ddf-a2cb-ee897ceb7bce None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:48.573722 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7883d-e3bb-4ddf-a2cb-ee897ceb7bce None admin] PATH_INFO: `/v3/users/swift` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:48.584106 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf7883d-e3bb-4ddf-a2cb-ee897ceb7bce None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:48.586710 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf7883d-e3bb-4ddf-a2cb-ee897ceb7bce None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:48.588063 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683cd960-f83e-4dfc-90ca-7eaf16d17ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:48.589111 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683cd960-f83e-4dfc-90ca-7eaf16d17ddf None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:48.589663 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683cd960-f83e-4dfc-90ca-7eaf16d17ddf None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:48.590125 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683cd960-f83e-4dfc-90ca-7eaf16d17ddf None admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:48.591395 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683cd960-f83e-4dfc-90ca-7eaf16d17ddf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:48.591924 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683cd960-f83e-4dfc-90ca-7eaf16d17ddf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:48.594583 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683cd960-f83e-4dfc-90ca-7eaf16d17ddf None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:48.603388 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-0cf7883d-e3bb-4ddf-a2cb-ee897ceb7bce None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 12:16:48.603388 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:48.603388 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:48.603388 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:48.603388 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:48.603388 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:48.603388 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:48.603388 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:48.603388 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:48.603388 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:48.603388 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:48.603388 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:48.603388 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:16:48.603388 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:16:48.603388 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:16:48.603388 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:16:48.604378 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:48.604378 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:48.604378 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:16:48.604378 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:16:48.604378 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:16:48.604378 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:16:48.604378 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:48.604378 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:48.604378 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:48.604378 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:48.604378 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:48.604378 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:48.604378 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:48.604378 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:48.604378 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:48.604378 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:48.604378 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:48.604378 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:48.605323 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:48.605323 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:48.605323 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:16:48.605323 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:16:48.605323 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:16:48.605323 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:16:48.605323 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:16:48.605323 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:16:48.605323 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 12:16:48.605323 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:16:48.608196 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 370/731] 10.222.0.79 () {56 vars in 1096 bytes} [Wed Aug 31 12:16:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:48.610077 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8746eb9e-3726-4cbc-9876-f27828484202 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:48.610538 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8746eb9e-3726-4cbc-9876-f27828484202 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:48.610977 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8746eb9e-3726-4cbc-9876-f27828484202 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:48.612861 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 371/732] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:16:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:16:48.613772 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8746eb9e-3726-4cbc-9876-f27828484202 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:48.621001 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 362/733] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 12:16:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:48.622682 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683cd960-f83e-4dfc-90ca-7eaf16d17ddf None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:48.703969 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:48.746441 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8746eb9e-3726-4cbc-9876-f27828484202 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:48.770159 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683cd960-f83e-4dfc-90ca-7eaf16d17ddf None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:48.789358 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5a3414-5dc9-444d-a4ba-aee75bdadbc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:48.789903 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5a3414-5dc9-444d-a4ba-aee75bdadbc7 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:48.790188 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5a3414-5dc9-444d-a4ba-aee75bdadbc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:48.790894 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5a3414-5dc9-444d-a4ba-aee75bdadbc7 None admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:48.791572 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5a3414-5dc9-444d-a4ba-aee75bdadbc7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:48.792111 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5a3414-5dc9-444d-a4ba-aee75bdadbc7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:48.794731 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5a3414-5dc9-444d-a4ba-aee75bdadbc7 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:48.816413 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f41fae-96ed-4668-80cb-8600a97142c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:48.817416 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f41fae-96ed-4668-80cb-8600a97142c9 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:48.817820 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f41fae-96ed-4668-80cb-8600a97142c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:48.818234 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f41fae-96ed-4668-80cb-8600a97142c9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:48.834960 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 372/734] 10.222.0.79 () {56 vars in 1135 bytes} [Wed Aug 31 12:16:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:48.834960 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224b59f1-94f5-471b-86c9-034bd2f2c136 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:48.834960 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224b59f1-94f5-471b-86c9-034bd2f2c136 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:48.834960 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224b59f1-94f5-471b-86c9-034bd2f2c136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:48.837866 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f41fae-96ed-4668-80cb-8600a97142c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:16:48.844319 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-98f41fae-96ed-4668-80cb-8600a97142c9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:16:48.844319 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:48.844319 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:48.844319 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:48.844319 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:48.844319 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:48.844319 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:48.844319 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:48.844319 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:48.844319 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:48.844319 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:48.844319 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:48.844319 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:16:48.844319 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:16:48.844319 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:16:48.844319 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:16:48.846166 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:16:48.846166 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:16:48.846166 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:16:48.846166 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:16:48.846166 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:48.846166 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:48.846166 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:48.846166 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:48.846166 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:48.846166 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:48.846166 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:48.846166 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:48.846166 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:48.846166 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:48.846166 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:48.846166 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:48.848058 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:48.848058 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:48.848058 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:48.848058 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:48.848058 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:16:48.848058 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:16:48.848058 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:16:48.848058 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:16:48.848058 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:16:48.848058 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:16:48.848058 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:16:48.848058 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:16:48.848058 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 363/735] 10.222.0.79 () {56 vars in 1102 bytes} [Wed Aug 31 12:16:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:48.848058 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f41fae-96ed-4668-80cb-8600a97142c9 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:48.870310 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-224b59f1-94f5-471b-86c9-034bd2f2c136 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:48.872463 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-224b59f1-94f5-471b-86c9-034bd2f2c136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:48.927107 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:48.960062 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 373/736] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:16:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:16:48.961869 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224b59f1-94f5-471b-86c9-034bd2f2c136 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:49.013887 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f41fae-96ed-4668-80cb-8600a97142c9 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:49.034178 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:49.077725 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e698db30-8eae-411d-9b4f-8ae65e7fd798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:49.078290 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e698db30-8eae-411d-9b4f-8ae65e7fd798 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:49.078569 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e698db30-8eae-411d-9b4f-8ae65e7fd798 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:49.078838 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e698db30-8eae-411d-9b4f-8ae65e7fd798 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:49.096364 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e698db30-8eae-411d-9b4f-8ae65e7fd798 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:49.099051 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e698db30-8eae-411d-9b4f-8ae65e7fd798 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:49.138239 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-e698db30-8eae-411d-9b4f-8ae65e7fd798 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:49.138239 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:49.138239 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:49.138239 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:49.138239 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:49.138239 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:49.138239 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:49.138239 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:49.138239 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:49.138239 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:49.138239 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:49.138239 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:49.138239 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:16:49.138239 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:16:49.138239 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:16:49.138239 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:16:49.139334 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:49.139334 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:49.139334 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:49.139334 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:49.139334 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:49.139334 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:49.139334 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:49.139334 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:49.139334 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:49.139334 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:49.139334 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:49.139334 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:49.139334 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:49.139334 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:49.139334 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:49.139334 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:49.139334 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:16:49.140260 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:16:49.140260 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:49.140260 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:16:49.140439 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 364/737] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:16:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:49.141963 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e698db30-8eae-411d-9b4f-8ae65e7fd798 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:49.164201 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224b59f1-94f5-471b-86c9-034bd2f2c136 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:49.209920 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caaa87b-059f-47e2-9f1b-5ea5d3e8dcfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:49.211112 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caaa87b-059f-47e2-9f1b-5ea5d3e8dcfd None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:49.211640 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caaa87b-059f-47e2-9f1b-5ea5d3e8dcfd None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:49.211911 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caaa87b-059f-47e2-9f1b-5ea5d3e8dcfd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:49.275394 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:49.301787 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caaa87b-059f-47e2-9f1b-5ea5d3e8dcfd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:49.303308 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caaa87b-059f-47e2-9f1b-5ea5d3e8dcfd None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:49.343836 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e698db30-8eae-411d-9b4f-8ae65e7fd798 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:49.390145 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7da19f-2f1b-47e8-8504-cf9fe3148667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:49.391051 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7da19f-2f1b-47e8-8504-cf9fe3148667 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:49.391466 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7da19f-2f1b-47e8-8504-cf9fe3148667 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:49.391909 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7da19f-2f1b-47e8-8504-cf9fe3148667 None admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:49.393032 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7da19f-2f1b-47e8-8504-cf9fe3148667 None admin] RBAC: Adding query filter params (name=service) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:49.393532 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7da19f-2f1b-47e8-8504-cf9fe3148667 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:49.396111 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7da19f-2f1b-47e8-8504-cf9fe3148667 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:49.409434 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 365/738] 10.222.0.79 () {56 vars in 1103 bytes} [Wed Aug 31 12:16:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:49.411050 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc773a0-e3f4-4ad7-b7b3-fce2a1aa9923 None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:49.411339 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc773a0-e3f4-4ad7-b7b3-fce2a1aa9923 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:49.411613 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc773a0-e3f4-4ad7-b7b3-fce2a1aa9923 None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:49.412929 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 366/739] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:16:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:16:49.414214 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc773a0-e3f4-4ad7-b7b3-fce2a1aa9923 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:49.452329 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 374/740] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 12:16:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:16:49.453313 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caaa87b-059f-47e2-9f1b-5ea5d3e8dcfd None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:49.460748 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:49.555568 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:49.563895 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc773a0-e3f4-4ad7-b7b3-fce2a1aa9923 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:49.583291 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caaa87b-059f-47e2-9f1b-5ea5d3e8dcfd None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:49.609760 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d36edb-dd7b-4793-9c40-4aff5a4b79ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:49.610423 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d36edb-dd7b-4793-9c40-4aff5a4b79ec None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:49.610786 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d36edb-dd7b-4793-9c40-4aff5a4b79ec None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:49.611276 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d36edb-dd7b-4793-9c40-4aff5a4b79ec None admin] PATH_INFO: `/v3/domains` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:49.612327 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d36edb-dd7b-4793-9c40-4aff5a4b79ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:49.612825 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d36edb-dd7b-4793-9c40-4aff5a4b79ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:49.615096 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d36edb-dd7b-4793-9c40-4aff5a4b79ec None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:49.631115 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 367/741] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 12:16:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:49.633472 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d36edb-dd7b-4793-9c40-4aff5a4b79ec None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:49.636301 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150a62ca-7d07-4e39-924b-dc34dd1f7ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:49.637156 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a62ca-7d07-4e39-924b-dc34dd1f7ea6 None admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:49.637682 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a62ca-7d07-4e39-924b-dc34dd1f7ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:49.638179 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a62ca-7d07-4e39-924b-dc34dd1f7ea6 None admin] PATH_INFO: `/v3/services` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:49.639122 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150a62ca-7d07-4e39-924b-dc34dd1f7ea6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:49.640765 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150a62ca-7d07-4e39-924b-dc34dd1f7ea6 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:49.662717 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 375/742] 10.222.0.79 () {60 vars in 1141 bytes} [Wed Aug 31 12:16:49 2022] POST /identity/v3/services => generated 240 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:16:49.664815 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a722a-8f26-41ec-900e-9e104f925fb2 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:49.665308 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a722a-8f26-41ec-900e-9e104f925fb2 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:49.665687 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a722a-8f26-41ec-900e-9e104f925fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:49.690195 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-705a722a-8f26-41ec-900e-9e104f925fb2 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:49.691895 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-705a722a-8f26-41ec-900e-9e104f925fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:49.799157 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:49.818904 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 376/743] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:16:49 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:16:49.818904 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705a722a-8f26-41ec-900e-9e104f925fb2 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:49.826365 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d36edb-dd7b-4793-9c40-4aff5a4b79ec None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:49.902491 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a770a59-ceb3-4b81-b697-4b5318a19d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:49.903382 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a770a59-ceb3-4b81-b697-4b5318a19d80 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:49.903732 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a770a59-ceb3-4b81-b697-4b5318a19d80 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:49.904498 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a770a59-ceb3-4b81-b697-4b5318a19d80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:49.923319 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a770a59-ceb3-4b81-b697-4b5318a19d80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:49.925723 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a770a59-ceb3-4b81-b697-4b5318a19d80 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:49.933111 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:49.957540 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-3a770a59-ceb3-4b81-b697-4b5318a19d80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:49.957540 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:49.957540 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:49.957540 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:49.957540 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:49.957540 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:49.957540 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:49.957540 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:49.957540 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:49.957540 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:49.957540 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:49.957540 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:49.957540 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:16:49.957540 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:16:49.957540 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:16:49.957540 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:16:49.958591 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:49.958591 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:49.958591 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:49.958591 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:49.958591 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:49.958591 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:49.958591 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:49.958591 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:49.958591 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:49.958591 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:49.958591 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:49.958591 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:49.958591 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:49.958591 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:49.958591 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:49.958591 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:49.958591 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:16:49.959787 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:16:49.959787 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:49.959787 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:16:49.962997 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 368/744] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:16:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:49.964354 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a770a59-ceb3-4b81-b697-4b5318a19d80 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:50.017253 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705a722a-8f26-41ec-900e-9e104f925fb2 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:50.060615 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc463c2-dc64-4195-98a7-673f6b887015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:50.061625 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc463c2-dc64-4195-98a7-673f6b887015 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:50.062182 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc463c2-dc64-4195-98a7-673f6b887015 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:50.062630 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc463c2-dc64-4195-98a7-673f6b887015 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:50.082079 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc463c2-dc64-4195-98a7-673f6b887015 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:50.085072 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc463c2-dc64-4195-98a7-673f6b887015 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:50.117229 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-8cc463c2-dc64-4195-98a7-673f6b887015 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:50.117229 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:50.117229 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:50.117229 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:50.117229 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:50.117229 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:50.117229 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:50.117229 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:50.117229 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:50.117229 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:50.117229 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:50.117229 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:50.117229 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:16:50.117229 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:16:50.117229 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:16:50.117229 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:16:50.118266 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:50.118266 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:50.118266 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:50.118266 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:50.118266 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:50.118266 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:50.118266 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:50.118266 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:50.118266 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:50.118266 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:50.118266 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:50.118266 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:50.118266 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:50.118266 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:50.118266 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:50.118266 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:50.118266 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:16:50.119220 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:16:50.119220 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:50.119220 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:16:50.120639 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 377/745] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:16:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:50.121633 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc463c2-dc64-4195-98a7-673f6b887015 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:50.173216 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a770a59-ceb3-4b81-b697-4b5318a19d80 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:50.240381 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f54c8e-18d6-4dce-8f1c-ae020e73a2dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:50.241387 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f54c8e-18d6-4dce-8f1c-ae020e73a2dd None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:50.242645 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f54c8e-18d6-4dce-8f1c-ae020e73a2dd None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:50.243124 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f54c8e-18d6-4dce-8f1c-ae020e73a2dd None admin] PATH_INFO: `/v3/users/nova` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:50.260457 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f54c8e-18d6-4dce-8f1c-ae020e73a2dd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:50.263126 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f54c8e-18d6-4dce-8f1c-ae020e73a2dd None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:50.267005 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:50.290793 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-a2f54c8e-18d6-4dce-8f1c-ae020e73a2dd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 12:16:50.290793 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:50.290793 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:50.290793 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:50.290793 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:50.290793 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:50.290793 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:50.290793 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:50.290793 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:50.290793 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:50.290793 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:50.290793 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:50.290793 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:16:50.290793 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:16:50.290793 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:16:50.290793 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:16:50.291972 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:50.291972 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:50.291972 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:16:50.291972 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:16:50.291972 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:16:50.291972 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:16:50.291972 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:50.291972 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:50.291972 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:50.291972 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:50.291972 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:50.291972 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:50.291972 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:50.291972 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:50.291972 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:50.291972 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:50.291972 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:50.291972 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:50.293149 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:50.293149 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:50.293149 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:16:50.293149 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:16:50.293149 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:16:50.293149 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:16:50.293149 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:16:50.293149 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:16:50.293149 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 12:16:50.293149 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:16:50.298917 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 369/746] 10.222.0.79 () {56 vars in 1093 bytes} [Wed Aug 31 12:16:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:50.299918 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f54c8e-18d6-4dce-8f1c-ae020e73a2dd None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:50.386317 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc463c2-dc64-4195-98a7-673f6b887015 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:50.417254 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:50.455403 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7049c3-52a9-4c74-992e-c648c1f6f22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:50.456434 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7049c3-52a9-4c74-992e-c648c1f6f22c None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:50.456917 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7049c3-52a9-4c74-992e-c648c1f6f22c None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:50.457400 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7049c3-52a9-4c74-992e-c648c1f6f22c None admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:50.458480 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7049c3-52a9-4c74-992e-c648c1f6f22c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:50.459057 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7049c3-52a9-4c74-992e-c648c1f6f22c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:50.462147 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7049c3-52a9-4c74-992e-c648c1f6f22c None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:50.466423 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f54c8e-18d6-4dce-8f1c-ae020e73a2dd None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:50.488178 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 378/747] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 12:16:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:50.490116 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7049c3-52a9-4c74-992e-c648c1f6f22c None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:50.526080 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fabeb50-e6fa-412d-a63d-fb893ea08d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:50.526701 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fabeb50-e6fa-412d-a63d-fb893ea08d31 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:50.527029 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fabeb50-e6fa-412d-a63d-fb893ea08d31 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:50.527297 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fabeb50-e6fa-412d-a63d-fb893ea08d31 None admin] PATH_INFO: `/v3/domains` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:50.527989 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fabeb50-e6fa-412d-a63d-fb893ea08d31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:50.528285 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fabeb50-e6fa-412d-a63d-fb893ea08d31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:50.529698 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fabeb50-e6fa-412d-a63d-fb893ea08d31 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:50.545238 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 370/748] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 12:16:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:50.546116 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fabeb50-e6fa-412d-a63d-fb893ea08d31 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:50.630896 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:50.658127 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7049c3-52a9-4c74-992e-c648c1f6f22c None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:50.692460 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fabeb50-e6fa-412d-a63d-fb893ea08d31 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:50.702136 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66d297c-ed4e-4660-83a8-4774970eeb8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:50.702711 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d297c-ed4e-4660-83a8-4774970eeb8f None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:50.703011 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d297c-ed4e-4660-83a8-4774970eeb8f None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:50.703686 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d297c-ed4e-4660-83a8-4774970eeb8f None admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:50.704459 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66d297c-ed4e-4660-83a8-4774970eeb8f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:50.705116 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66d297c-ed4e-4660-83a8-4774970eeb8f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:50.706617 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66d297c-ed4e-4660-83a8-4774970eeb8f None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:50.733420 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 379/749] 10.222.0.79 () {56 vars in 1133 bytes} [Wed Aug 31 12:16:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:50.735440 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66d297c-ed4e-4660-83a8-4774970eeb8f None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:50.747830 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f1bfab-800e-4028-9f5b-b70a6ba49986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:50.748852 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f1bfab-800e-4028-9f5b-b70a6ba49986 None admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:50.749359 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f1bfab-800e-4028-9f5b-b70a6ba49986 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:50.749835 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f1bfab-800e-4028-9f5b-b70a6ba49986 None admin] PATH_INFO: `/v3/services` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:50.750718 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f1bfab-800e-4028-9f5b-b70a6ba49986 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:50.752403 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f1bfab-800e-4028-9f5b-b70a6ba49986 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:50.786246 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 371/750] 10.222.0.79 () {60 vars in 1141 bytes} [Wed Aug 31 12:16:50 2022] POST /identity/v3/services => generated 251 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:16:50.786246 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f1bfab-800e-4028-9f5b-b70a6ba49986 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:50.841132 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:50.995615 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66d297c-ed4e-4660-83a8-4774970eeb8f None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:50.998225 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f1bfab-800e-4028-9f5b-b70a6ba49986 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:51.020030 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:51.046983 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc469fdc-6737-4645-b25b-f31f770c3e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:51.047637 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc469fdc-6737-4645-b25b-f31f770c3e94 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:51.047914 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc469fdc-6737-4645-b25b-f31f770c3e94 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:51.048185 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc469fdc-6737-4645-b25b-f31f770c3e94 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:51.058761 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc469fdc-6737-4645-b25b-f31f770c3e94 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:51.059974 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc469fdc-6737-4645-b25b-f31f770c3e94 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:51.076984 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-cc469fdc-6737-4645-b25b-f31f770c3e94 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:16:51.076984 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:51.076984 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:51.076984 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:51.076984 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:51.076984 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:51.076984 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:51.076984 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:51.076984 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:51.076984 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:51.076984 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:51.076984 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:51.076984 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:16:51.076984 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:16:51.076984 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:16:51.078803 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:16:51.078803 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:51.078803 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:51.078803 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:51.078803 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:51.078803 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:51.078803 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:51.078803 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:51.078803 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:51.078803 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:51.078803 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:51.078803 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:51.078803 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:51.078803 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:51.078803 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:51.078803 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:51.078803 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:51.080460 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:16:51.080460 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:16:51.080460 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:16:51.080460 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:16:51.080460 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:16:51.080460 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:16:51.080460 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:16:51.080460 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:16:51.080460 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 372/751] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 12:16:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:51.080460 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc469fdc-6737-4645-b25b-f31f770c3e94 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:51.085058 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866b9845-5cc7-4024-aaae-772378adda74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:51.087634 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b9845-5cc7-4024-aaae-772378adda74 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:51.088295 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b9845-5cc7-4024-aaae-772378adda74 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:51.089032 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b9845-5cc7-4024-aaae-772378adda74 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:51.105856 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866b9845-5cc7-4024-aaae-772378adda74 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:51.108468 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866b9845-5cc7-4024-aaae-772378adda74 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:51.131098 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-866b9845-5cc7-4024-aaae-772378adda74 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 12:16:51.131098 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:51.131098 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:51.131098 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:51.131098 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:51.131098 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:51.131098 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:51.131098 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:51.131098 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:51.131098 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:51.131098 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:51.131098 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:51.131098 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:16:51.131098 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:16:51.131098 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:16:51.131098 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:16:51.132752 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:51.132752 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:51.132752 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:16:51.132752 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:16:51.132752 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:16:51.132752 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:16:51.132752 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:51.132752 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:51.132752 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:51.132752 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:51.132752 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:51.132752 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:51.132752 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:51.132752 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:51.132752 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:51.132752 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:51.132752 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:51.132752 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:51.133950 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:51.133950 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:51.133950 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:16:51.133950 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:16:51.133950 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:16:51.133950 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:16:51.133950 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:16:51.133950 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:16:51.133950 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 12:16:51.133950 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:16:51.139345 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 380/752] 10.222.0.79 () {56 vars in 1117 bytes} [Wed Aug 31 12:16:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 405 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:51.140732 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866b9845-5cc7-4024-aaae-772378adda74 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:51.278460 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc469fdc-6737-4645-b25b-f31f770c3e94 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:51.325308 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563271d2-2714-49ea-8967-299a6382581d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:51.325991 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563271d2-2714-49ea-8967-299a6382581d None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:51.326261 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563271d2-2714-49ea-8967-299a6382581d None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:51.326540 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563271d2-2714-49ea-8967-299a6382581d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:51.343106 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563271d2-2714-49ea-8967-299a6382581d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:51.345742 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:51.347246 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563271d2-2714-49ea-8967-299a6382581d None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:51.355200 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866b9845-5cc7-4024-aaae-772378adda74 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:51.388644 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-563271d2-2714-49ea-8967-299a6382581d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:51.388644 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:51.388644 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:51.388644 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:51.388644 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:51.388644 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:51.388644 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:51.388644 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:51.388644 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:51.388644 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:51.388644 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:51.388644 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:51.388644 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:16:51.388644 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:16:51.388644 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:16:51.388644 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:16:51.390512 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:51.390512 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:51.390512 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:51.390512 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:51.390512 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:51.390512 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:51.390512 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:51.390512 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:51.390512 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:51.390512 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:51.390512 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:51.390512 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:51.390512 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:51.390512 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:51.390512 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:51.390512 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:51.390512 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:16:51.392347 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:16:51.392347 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:51.392347 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:16:51.396923 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164dbe9b-7742-4f21-a7b2-8fa50c0c64ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:51.397566 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164dbe9b-7742-4f21-a7b2-8fa50c0c64ce None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:51.398647 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164dbe9b-7742-4f21-a7b2-8fa50c0c64ce None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:51.399009 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164dbe9b-7742-4f21-a7b2-8fa50c0c64ce None admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:51.401050 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164dbe9b-7742-4f21-a7b2-8fa50c0c64ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:51.401050 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164dbe9b-7742-4f21-a7b2-8fa50c0c64ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:51.401538 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164dbe9b-7742-4f21-a7b2-8fa50c0c64ce None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:51.407071 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 373/753] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:16:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:51.409123 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563271d2-2714-49ea-8967-299a6382581d None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:51.415725 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 381/754] 10.222.0.79 () {56 vars in 1148 bytes} [Wed Aug 31 12:16:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:51.416925 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164dbe9b-7742-4f21-a7b2-8fa50c0c64ce None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:51.458541 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:51.556203 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563271d2-2714-49ea-8967-299a6382581d None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:51.596280 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488585df-69be-4035-83f9-ec0f6addc899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:51.597095 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488585df-69be-4035-83f9-ec0f6addc899 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:51.597363 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488585df-69be-4035-83f9-ec0f6addc899 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:51.597710 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488585df-69be-4035-83f9-ec0f6addc899 None admin] PATH_INFO: `/v3/users` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:51.598913 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488585df-69be-4035-83f9-ec0f6addc899 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:51.598913 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488585df-69be-4035-83f9-ec0f6addc899 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:51.600262 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488585df-69be-4035-83f9-ec0f6addc899 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:51.617037 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164dbe9b-7742-4f21-a7b2-8fa50c0c64ce None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:51.627165 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 374/755] 10.222.0.79 () {56 vars in 1149 bytes} [Wed Aug 31 12:16:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:51.628148 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488585df-69be-4035-83f9-ec0f6addc899 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:51.688153 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8154c11-96fa-4072-90de-ca608c87dd89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:51.689848 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8154c11-96fa-4072-90de-ca608c87dd89 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:51.690780 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8154c11-96fa-4072-90de-ca608c87dd89 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:51.691610 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8154c11-96fa-4072-90de-ca608c87dd89 None admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:51.693100 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8154c11-96fa-4072-90de-ca608c87dd89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:51.693963 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8154c11-96fa-4072-90de-ca608c87dd89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:51.697085 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8154c11-96fa-4072-90de-ca608c87dd89 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:51.726604 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:51.727080 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 382/756] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 12:16:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:51.728746 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8154c11-96fa-4072-90de-ca608c87dd89 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:51.747561 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488585df-69be-4035-83f9-ec0f6addc899 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:51.763617 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:51.790054 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ed6ae-4756-4006-935a-0b256320f0eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:51.791104 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ed6ae-4756-4006-935a-0b256320f0eb None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:51.791587 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ed6ae-4756-4006-935a-0b256320f0eb None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:51.792056 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ed6ae-4756-4006-935a-0b256320f0eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:51.793006 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06ed6ae-4756-4006-935a-0b256320f0eb None admin] RBAC: Adding query filter params (role.id=a332ef951db949b0bad7019fbd28a1b9, scope.project.id=a94f4957f2a047cc844342e1c7c74ca5, user.id=4896540cc14f40b08d05ade32cfd0f37) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:51.793515 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06ed6ae-4756-4006-935a-0b256320f0eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:51.795226 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06ed6ae-4756-4006-935a-0b256320f0eb None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:51.801993 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 375/757] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 12:16:51 2022] GET /identity/v3/role_assignments?user.id=4896540cc14f40b08d05ade32cfd0f37&scope.project.id=a94f4957f2a047cc844342e1c7c74ca5&role.id=a332ef951db949b0bad7019fbd28a1b9 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:51.803254 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ed6ae-4756-4006-935a-0b256320f0eb None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:51.942975 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8154c11-96fa-4072-90de-ca608c87dd89 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:51.994884 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ed6ae-4756-4006-935a-0b256320f0eb None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:52.011305 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f73ae5-ba50-4fa1-9cd2-1157afe37569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:52.012734 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f73ae5-ba50-4fa1-9cd2-1157afe37569 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:52.012926 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f73ae5-ba50-4fa1-9cd2-1157afe37569 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:52.013394 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f73ae5-ba50-4fa1-9cd2-1157afe37569 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:52.063677 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406ad3a2-fc77-4af3-af61-676c3509dc02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:52.065082 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ad3a2-fc77-4af3-af61-676c3509dc02 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:52.065588 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ad3a2-fc77-4af3-af61-676c3509dc02 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:52.066062 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ad3a2-fc77-4af3-af61-676c3509dc02 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:52.079234 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406ad3a2-fc77-4af3-af61-676c3509dc02 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:52.081136 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406ad3a2-fc77-4af3-af61-676c3509dc02 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:52.106285 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-406ad3a2-fc77-4af3-af61-676c3509dc02 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:16:52.106285 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:52.106285 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:52.106285 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:52.106285 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:52.106285 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:52.106285 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:52.106285 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:52.106285 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:52.106285 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:52.106285 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:52.106285 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:52.106285 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:16:52.106285 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:16:52.106285 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:16:52.107327 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:16:52.107327 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:52.107327 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:52.107327 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:52.107327 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:52.107327 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:52.107327 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:52.107327 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:52.107327 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:52.107327 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:52.107327 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:52.107327 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:52.107327 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:52.107327 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:52.107327 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:52.107327 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:52.107327 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:52.108236 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:16:52.108236 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:16:52.108236 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:16:52.108236 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:16:52.108236 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:16:52.108236 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:16:52.108236 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:16:52.108236 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:16:52.108236 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 376/758] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 12:16:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:52.125347 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406ad3a2-fc77-4af3-af61-676c3509dc02 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:52.150791 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:52.166106 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f73ae5-ba50-4fa1-9cd2-1157afe37569 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:52.168798 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f73ae5-ba50-4fa1-9cd2-1157afe37569 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:52.197729 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:52.368998 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 383/759] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 12:16:51 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 641 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 12:16:52.379146 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f73ae5-ba50-4fa1-9cd2-1157afe37569 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:52.384579 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406ad3a2-fc77-4af3-af61-676c3509dc02 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:52.465459 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553c3a34-84ac-4c0c-8d53-d76ae7b783c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:52.466097 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553c3a34-84ac-4c0c-8d53-d76ae7b783c5 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:52.466372 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553c3a34-84ac-4c0c-8d53-d76ae7b783c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:52.466639 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553c3a34-84ac-4c0c-8d53-d76ae7b783c5 None admin] PATH_INFO: `/v3/projects` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:52.467382 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553c3a34-84ac-4c0c-8d53-d76ae7b783c5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:52.467687 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553c3a34-84ac-4c0c-8d53-d76ae7b783c5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:52.469255 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553c3a34-84ac-4c0c-8d53-d76ae7b783c5 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:52.485216 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 377/760] 10.222.0.79 () {56 vars in 1148 bytes} [Wed Aug 31 12:16:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:52.486757 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c9ed1-06a0-43a2-a01a-9b1b88201c7a None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:52.487072 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c9ed1-06a0-43a2-a01a-9b1b88201c7a None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:52.487346 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c9ed1-06a0-43a2-a01a-9b1b88201c7a None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:52.493425 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 378/761] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:16:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:16:52.494600 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836c9ed1-06a0-43a2-a01a-9b1b88201c7a None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:52.578414 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:52.619157 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836c9ed1-06a0-43a2-a01a-9b1b88201c7a None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:52.657623 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14434199-e913-44ef-868f-86a4e9c2ece3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:52.658691 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14434199-e913-44ef-868f-86a4e9c2ece3 None admin] REQUEST_METHOD: `PUT` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:52.659210 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14434199-e913-44ef-868f-86a4e9c2ece3 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:52.659717 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14434199-e913-44ef-868f-86a4e9c2ece3 None admin] PATH_INFO: `/v3/projects/a94f4957f2a047cc844342e1c7c74ca5/users/62401c8e1457450590f4147e0665265a/roles/a332ef951db949b0bad7019fbd28a1b9` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:52.661914 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14434199-e913-44ef-868f-86a4e9c2ece3 None admin] RBAC: Authorizing `identity:create_grant(project_id=a94f4957f2a047cc844342e1c7c74ca5, user_id=62401c8e1457450590f4147e0665265a, role_id=a332ef951db949b0bad7019fbd28a1b9)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:52.664220 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14434199-e913-44ef-868f-86a4e9c2ece3 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:52.671538 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f73ae5-ba50-4fa1-9cd2-1157afe37569 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:52.681559 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 379/762] 10.222.0.79 () {58 vars in 1439 bytes} [Wed Aug 31 12:16:52 2022] PUT /identity/v3/projects/a94f4957f2a047cc844342e1c7c74ca5/users/62401c8e1457450590f4147e0665265a/roles/a332ef951db949b0bad7019fbd28a1b9 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:16:52.683448 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245bf416-242c-403a-a739-7b42f47d4cd4 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:52.684018 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245bf416-242c-403a-a739-7b42f47d4cd4 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:52.684581 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245bf416-242c-403a-a739-7b42f47d4cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:52.689322 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:52.707061 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-245bf416-242c-403a-a739-7b42f47d4cd4 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:52.708808 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-245bf416-242c-403a-a739-7b42f47d4cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:52.718209 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa72ab6-1df1-451c-b291-23aeca4d5acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:52.718880 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa72ab6-1df1-451c-b291-23aeca4d5acd None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:52.719210 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa72ab6-1df1-451c-b291-23aeca4d5acd None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:52.719482 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa72ab6-1df1-451c-b291-23aeca4d5acd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:52.732923 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa72ab6-1df1-451c-b291-23aeca4d5acd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:52.734574 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa72ab6-1df1-451c-b291-23aeca4d5acd None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:52.751869 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-ffa72ab6-1df1-451c-b291-23aeca4d5acd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:52.751869 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:52.751869 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:52.751869 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:52.751869 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:52.751869 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:52.751869 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:52.751869 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:52.751869 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:52.751869 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:52.751869 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:52.751869 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:52.751869 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:16:52.751869 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:16:52.751869 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:16:52.751869 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:16:52.752895 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:52.752895 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:52.752895 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:52.752895 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:52.752895 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:52.752895 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:52.752895 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:52.752895 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:52.752895 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:52.752895 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:52.752895 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:52.752895 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:52.752895 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:52.752895 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:52.752895 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:52.752895 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:52.752895 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:16:52.753833 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:16:52.753833 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:52.753833 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:16:52.753833 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 384/763] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:16:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 376 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:52.759651 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa72ab6-1df1-451c-b291-23aeca4d5acd None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:52.802650 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 380/764] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:16:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:16:52.877461 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa72ab6-1df1-451c-b291-23aeca4d5acd None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:52.917784 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7725f64a-3296-4abc-bfce-fe90047545ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:52.918407 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7725f64a-3296-4abc-bfce-fe90047545ac None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:52.918679 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7725f64a-3296-4abc-bfce-fe90047545ac None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:52.918989 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7725f64a-3296-4abc-bfce-fe90047545ac None admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:52.919632 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7725f64a-3296-4abc-bfce-fe90047545ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:52.919928 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7725f64a-3296-4abc-bfce-fe90047545ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:52.921614 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7725f64a-3296-4abc-bfce-fe90047545ac None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:52.936028 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 385/765] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 12:16:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:52.942231 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245bf416-242c-403a-a739-7b42f47d4cd4 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:53.054988 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:53.115659 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245bf416-242c-403a-a739-7b42f47d4cd4 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:53.177897 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638dad9d-536d-4b1e-9810-8363c3052401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:53.179465 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638dad9d-536d-4b1e-9810-8363c3052401 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:53.179909 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638dad9d-536d-4b1e-9810-8363c3052401 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:53.180463 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638dad9d-536d-4b1e-9810-8363c3052401 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:53.193155 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638dad9d-536d-4b1e-9810-8363c3052401 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:53.196615 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638dad9d-536d-4b1e-9810-8363c3052401 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:53.201604 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7725f64a-3296-4abc-bfce-fe90047545ac None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:53.231073 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-638dad9d-536d-4b1e-9810-8363c3052401 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:16:53.231073 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:53.231073 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:53.231073 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:53.231073 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:53.231073 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:53.231073 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:53.231073 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:53.231073 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:53.231073 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:53.231073 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:53.231073 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:53.231073 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:16:53.231073 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:16:53.231073 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:16:53.232455 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:16:53.232455 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:53.232455 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:53.232455 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:53.232455 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:53.232455 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:53.232455 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:53.232455 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:53.232455 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:53.232455 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:53.232455 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:53.232455 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:53.232455 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:53.232455 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:53.232455 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:53.232455 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:53.232455 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:53.234028 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:16:53.234028 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:16:53.234028 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:16:53.234028 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:16:53.234028 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:16:53.234028 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:16:53.234028 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:16:53.234028 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:16:53.244135 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 381/766] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 12:16:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:16:53.245113 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638dad9d-536d-4b1e-9810-8363c3052401 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:53.262916 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:53.392729 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638dad9d-536d-4b1e-9810-8363c3052401 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:53.423941 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:53.434840 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f8a437-4dc1-42f8-8809-76a41f02fb9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:53.435499 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f8a437-4dc1-42f8-8809-76a41f02fb9b None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:53.435793 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f8a437-4dc1-42f8-8809-76a41f02fb9b None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:53.436074 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f8a437-4dc1-42f8-8809-76a41f02fb9b None admin] PATH_INFO: `/v3/projects` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:53.437080 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f8a437-4dc1-42f8-8809-76a41f02fb9b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:53.437495 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f8a437-4dc1-42f8-8809-76a41f02fb9b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:53.439104 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f8a437-4dc1-42f8-8809-76a41f02fb9b None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:53.458430 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 382/767] 10.222.0.79 () {56 vars in 1148 bytes} [Wed Aug 31 12:16:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:53.471959 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f8a437-4dc1-42f8-8809-76a41f02fb9b None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:53.530978 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7725f64a-3296-4abc-bfce-fe90047545ac None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:53.575175 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001c0e53-2603-4612-9cee-eed952a47ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:53.575857 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001c0e53-2603-4612-9cee-eed952a47ad2 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:53.576144 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001c0e53-2603-4612-9cee-eed952a47ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:53.576411 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001c0e53-2603-4612-9cee-eed952a47ad2 None admin] PATH_INFO: `/v3/services/network` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:53.577039 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001c0e53-2603-4612-9cee-eed952a47ad2 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:53.579307 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001c0e53-2603-4612-9cee-eed952a47ad2 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:53.593065 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-001c0e53-2603-4612-9cee-eed952a47ad2 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 12:16:53.593065 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:53.593065 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 12:16:53.593065 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 12:16:53.593065 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 12:16:53.593065 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 12:16:53.593065 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 12:16:53.593065 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:16:53.593065 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 12:16:53.593065 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:16:53.593065 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:16:53.593065 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:16:53.593065 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:53.593065 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:53.593065 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:53.593065 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:53.593065 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:53.595162 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:53.595162 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:53.595162 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:53.595162 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:53.595162 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:53.595162 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:53.595162 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 12:16:53.595162 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 12:16:53.595162 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 12:16:53.595162 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 12:16:53.595162 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:53.595162 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:53.595162 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:53.595162 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:53.595162 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:53.595162 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:53.596774 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:53.596774 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:53.596774 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:53.596774 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:53.596774 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:53.596774 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:53.596774 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:53.596774 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:53.596774 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:53.596774 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:53.596774 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 12:16:53.596774 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:16:53.596774 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 12:16:53.596774 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:16:53.596774 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 386/768] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 12:16:53 2022] GET /identity/v3/services/network => generated 88 bytes in 395 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:16:53.604948 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001c0e53-2603-4612-9cee-eed952a47ad2 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:53.743934 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:53.761886 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001c0e53-2603-4612-9cee-eed952a47ad2 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:53.831695 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f8a437-4dc1-42f8-8809-76a41f02fb9b None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:53.877926 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80df1ef-8165-4ccc-ad5c-8bab76ff514f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:53.879418 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80df1ef-8165-4ccc-ad5c-8bab76ff514f None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:53.880144 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80df1ef-8165-4ccc-ad5c-8bab76ff514f None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:53.880751 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80df1ef-8165-4ccc-ad5c-8bab76ff514f None admin] PATH_INFO: `/v3/services` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:53.882278 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80df1ef-8165-4ccc-ad5c-8bab76ff514f None admin] RBAC: Adding query filter params (name=network) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:53.883289 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80df1ef-8165-4ccc-ad5c-8bab76ff514f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:53.886325 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80df1ef-8165-4ccc-ad5c-8bab76ff514f None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:53.896129 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 387/769] 10.222.0.79 () {56 vars in 1112 bytes} [Wed Aug 31 12:16:53 2022] GET /identity/v3/services?name=network => generated 124 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:53.899491 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927bd85d-1a6e-4b80-bb28-21507e86d892 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:53.900359 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927bd85d-1a6e-4b80-bb28-21507e86d892 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:53.901115 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927bd85d-1a6e-4b80-bb28-21507e86d892 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:53.904449 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 388/770] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:16:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:16:53.905650 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927bd85d-1a6e-4b80-bb28-21507e86d892 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:53.934007 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf4a415-dc88-4d5e-bf9c-d603f1fd15ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:53.935411 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4a415-dc88-4d5e-bf9c-d603f1fd15ec None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:53.936385 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4a415-dc88-4d5e-bf9c-d603f1fd15ec None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:53.937223 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4a415-dc88-4d5e-bf9c-d603f1fd15ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:53.939291 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf4a415-dc88-4d5e-bf9c-d603f1fd15ec None admin] RBAC: Adding query filter params (role.id=37fee7a104964826a0762987a1531a9a, scope.project.id=a94f4957f2a047cc844342e1c7c74ca5, user.id=149aa48acd504354a1d021885ca51334) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:53.940344 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf4a415-dc88-4d5e-bf9c-d603f1fd15ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:53.943001 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf4a415-dc88-4d5e-bf9c-d603f1fd15ec None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:53.955346 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 383/771] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 12:16:53 2022] GET /identity/v3/role_assignments?user.id=149aa48acd504354a1d021885ca51334&scope.project.id=a94f4957f2a047cc844342e1c7c74ca5&role.id=37fee7a104964826a0762987a1531a9a => generated 259 bytes in 484 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:53.964792 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c85c792-5b65-476b-8255-1708a912b99c None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:53.965791 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c85c792-5b65-476b-8255-1708a912b99c None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:53.966580 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c85c792-5b65-476b-8255-1708a912b99c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:54.033097 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-8c85c792-5b65-476b-8255-1708a912b99c None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:54.036087 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-8c85c792-5b65-476b-8255-1708a912b99c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:54.142705 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:54.190196 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927bd85d-1a6e-4b80-bb28-21507e86d892 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:54.218929 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 384/772] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:16:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:16:54.275866 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688e3953-d038-4bab-9650-f95bc2161b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:54.276924 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e3953-d038-4bab-9650-f95bc2161b64 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:54.277429 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e3953-d038-4bab-9650-f95bc2161b64 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:54.277906 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e3953-d038-4bab-9650-f95bc2161b64 None admin] PATH_INFO: `/v3/services` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:54.279167 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688e3953-d038-4bab-9650-f95bc2161b64 None admin] RBAC: Adding query filter params (type=network) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:54.279700 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688e3953-d038-4bab-9650-f95bc2161b64 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:54.282596 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688e3953-d038-4bab-9650-f95bc2161b64 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:54.295601 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 389/773] 10.222.0.79 () {56 vars in 1112 bytes} [Wed Aug 31 12:16:53 2022] GET /identity/v3/services?type=network => generated 350 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:54.305172 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c85c792-5b65-476b-8255-1708a912b99c None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:54.521583 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c85c792-5b65-476b-8255-1708a912b99c None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:54.600484 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce4317f-3200-4719-8cc6-5a9ff7eade7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:54.601797 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4317f-3200-4719-8cc6-5a9ff7eade7e None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:54.602019 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4317f-3200-4719-8cc6-5a9ff7eade7e None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:54.602473 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4317f-3200-4719-8cc6-5a9ff7eade7e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:54.603799 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce4317f-3200-4719-8cc6-5a9ff7eade7e None admin] RBAC: Adding query filter params (interface=public, service_id=9236413f09684c4e8159ac77a37a6d7b, region_id=RegionOne) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:54.604337 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce4317f-3200-4719-8cc6-5a9ff7eade7e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:54.606811 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce4317f-3200-4719-8cc6-5a9ff7eade7e None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:54.626268 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 385/774] 10.222.0.79 () {56 vars in 1251 bytes} [Wed Aug 31 12:16:54 2022] GET /identity/v3/endpoints?service_id=9236413f09684c4e8159ac77a37a6d7b&interface=public®ion_id=RegionOne => generated 194 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:54.632981 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688e3953-d038-4bab-9650-f95bc2161b64 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:54.685597 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:54.841976 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688e3953-d038-4bab-9650-f95bc2161b64 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:54.887381 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641b705-088e-420b-b5f4-e84fde959938 None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:54.887585 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641b705-088e-420b-b5f4-e84fde959938 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:54.887863 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641b705-088e-420b-b5f4-e84fde959938 None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:54.890888 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 386/775] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:16:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:16:54.895547 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6365d33f-1bd7-489b-95b4-c0c24c414595 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:54.895856 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6365d33f-1bd7-489b-95b4-c0c24c414595 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:54.896103 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6365d33f-1bd7-489b-95b4-c0c24c414595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:54.913277 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9321b4d6-7be6-4801-97b5-2da5f22c2cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:54.913942 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9321b4d6-7be6-4801-97b5-2da5f22c2cd7 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:54.913942 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9321b4d6-7be6-4801-97b5-2da5f22c2cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:54.914652 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9321b4d6-7be6-4801-97b5-2da5f22c2cd7 None admin] PATH_INFO: `/v3/services` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:54.915290 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9321b4d6-7be6-4801-97b5-2da5f22c2cd7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:54.916733 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9321b4d6-7be6-4801-97b5-2da5f22c2cd7 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:54.925631 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-6365d33f-1bd7-489b-95b4-c0c24c414595 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:54.926890 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-6365d33f-1bd7-489b-95b4-c0c24c414595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:54.931478 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 390/776] 10.222.0.79 () {56 vars in 1087 bytes} [Wed Aug 31 12:16:54 2022] GET /identity/v3/services => generated 772 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:54.970595 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9321b4d6-7be6-4801-97b5-2da5f22c2cd7 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:54.991340 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:55.048766 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 387/777] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:16:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 12:16:55.122767 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:55.144295 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9321b4d6-7be6-4801-97b5-2da5f22c2cd7 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:55.183839 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa924eaf-6b38-4e4c-a43b-e8edcee382b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:55.184494 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa924eaf-6b38-4e4c-a43b-e8edcee382b1 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:55.184774 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa924eaf-6b38-4e4c-a43b-e8edcee382b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:55.185046 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa924eaf-6b38-4e4c-a43b-e8edcee382b1 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:55.185635 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa924eaf-6b38-4e4c-a43b-e8edcee382b1 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:55.187066 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa924eaf-6b38-4e4c-a43b-e8edcee382b1 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:55.197358 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-fa924eaf-6b38-4e4c-a43b-e8edcee382b1 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 12:16:55.197358 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:55.197358 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 12:16:55.197358 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 12:16:55.197358 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 12:16:55.197358 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 12:16:55.197358 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 12:16:55.197358 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:16:55.197358 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 12:16:55.197358 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:16:55.197358 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:16:55.197358 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:16:55.197358 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:55.197358 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:55.197358 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:55.197358 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:55.197358 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:55.198575 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:55.198575 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:55.198575 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:55.198575 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:55.198575 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:55.198575 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:55.198575 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 12:16:55.198575 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 12:16:55.198575 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 12:16:55.198575 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 12:16:55.198575 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:55.198575 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:55.198575 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:55.198575 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:55.198575 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:55.198575 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:55.199709 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:55.199709 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:55.199709 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:55.199709 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:55.199709 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:55.199709 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:55.199709 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:55.199709 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:55.199709 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:55.199709 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:55.199709 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 12:16:55.199709 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:16:55.199709 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 12:16:55.199709 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:16:55.199709 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 391/778] 10.222.0.79 () {56 vars in 1129 bytes} [Wed Aug 31 12:16:54 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:55.208382 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6365d33f-1bd7-489b-95b4-c0c24c414595 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:55.404603 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa924eaf-6b38-4e4c-a43b-e8edcee382b1 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:55.430900 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6365d33f-1bd7-489b-95b4-c0c24c414595 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:55.539312 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c0106c-1cef-499a-9d0c-a65cd3e4f4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:55.540284 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c0106c-1cef-499a-9d0c-a65cd3e4f4f8 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:55.540731 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c0106c-1cef-499a-9d0c-a65cd3e4f4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:55.541165 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c0106c-1cef-499a-9d0c-a65cd3e4f4f8 None admin] PATH_INFO: `/v3/services` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:55.542226 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c0106c-1cef-499a-9d0c-a65cd3e4f4f8 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:55.542688 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c0106c-1cef-499a-9d0c-a65cd3e4f4f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:55.550094 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c0106c-1cef-499a-9d0c-a65cd3e4f4f8 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:55.562265 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 388/779] 10.222.0.79 () {56 vars in 1124 bytes} [Wed Aug 31 12:16:55 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:55.572748 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c0106c-1cef-499a-9d0c-a65cd3e4f4f8 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:55.645996 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:55.664763 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa924eaf-6b38-4e4c-a43b-e8edcee382b1 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:55.730812 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c0106c-1cef-499a-9d0c-a65cd3e4f4f8 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:55.753402 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574671fd-7f05-45b8-8935-c3b4bc835f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:55.755084 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574671fd-7f05-45b8-8935-c3b4bc835f9e None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:55.756015 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574671fd-7f05-45b8-8935-c3b4bc835f9e None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:55.757761 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574671fd-7f05-45b8-8935-c3b4bc835f9e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:55.773803 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ef12e3-16c4-4ee3-9725-aa7341642a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:55.774632 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef12e3-16c4-4ee3-9725-aa7341642a86 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:55.774945 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef12e3-16c4-4ee3-9725-aa7341642a86 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:55.775219 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef12e3-16c4-4ee3-9725-aa7341642a86 None admin] PATH_INFO: `/v3/services` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:55.775875 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ef12e3-16c4-4ee3-9725-aa7341642a86 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:55.776184 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ef12e3-16c4-4ee3-9725-aa7341642a86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:55.777616 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ef12e3-16c4-4ee3-9725-aa7341642a86 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:55.778060 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574671fd-7f05-45b8-8935-c3b4bc835f9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:16:55.785109 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 389/780] 10.222.0.79 () {56 vars in 1124 bytes} [Wed Aug 31 12:16:55 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:16:55.786622 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9602fd-d935-450a-898e-71a7e9db49c6 None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:55.786965 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9602fd-d935-450a-898e-71a7e9db49c6 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:55.787245 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9602fd-d935-450a-898e-71a7e9db49c6 None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:55.789489 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-574671fd-7f05-45b8-8935-c3b4bc835f9e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:16:55.789489 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:55.789489 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:55.789489 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:55.789489 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:55.789489 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:55.789489 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:55.789489 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:55.789489 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:55.789489 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:55.789489 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:55.789489 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:55.789489 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:16:55.789489 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:16:55.789489 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:16:55.789489 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:16:55.790472 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:16:55.790472 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:16:55.790472 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:16:55.790472 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:16:55.790472 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:55.790472 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:55.790472 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:55.790472 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:55.790472 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:55.790472 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:55.790472 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:55.790472 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:55.790472 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:55.790472 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:55.790472 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:55.790472 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:55.791356 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:55.791356 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:55.791356 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:55.791356 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:55.791356 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:16:55.791356 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:16:55.791356 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:16:55.791356 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:16:55.791356 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:16:55.791356 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:16:55.791356 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:16:55.791356 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:16:55.793537 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 390/782] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:16:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:16:55.794513 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9602fd-d935-450a-898e-71a7e9db49c6 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:55.798990 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 392/782] 10.222.0.79 () {56 vars in 1096 bytes} [Wed Aug 31 12:16:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 388 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:16:55.801132 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a0e971-09d3-4412-ac45-fe9369ce76d2 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:55.801481 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a0e971-09d3-4412-ac45-fe9369ce76d2 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:55.801737 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a0e971-09d3-4412-ac45-fe9369ce76d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:55.821025 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:55.829492 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-83a0e971-09d3-4412-ac45-fe9369ce76d2 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:55.831513 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-83a0e971-09d3-4412-ac45-fe9369ce76d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:55.983399 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 393/783] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:16:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:16:55.985531 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a0e971-09d3-4412-ac45-fe9369ce76d2 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:56.004422 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:56.026474 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9602fd-d935-450a-898e-71a7e9db49c6 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:56.150303 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6125e97-8630-4804-82b0-214b134cfe4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:56.151520 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6125e97-8630-4804-82b0-214b134cfe4c None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:56.151984 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6125e97-8630-4804-82b0-214b134cfe4c None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:56.152456 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6125e97-8630-4804-82b0-214b134cfe4c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:56.153805 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6125e97-8630-4804-82b0-214b134cfe4c None admin] RBAC: Adding query filter params (interface=public, service_id=5a18f994e3aa438888d58dfed5b22c00, region_id=RegionOne) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:56.154352 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6125e97-8630-4804-82b0-214b134cfe4c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:56.157364 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6125e97-8630-4804-82b0-214b134cfe4c None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:56.177596 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 391/784] 10.222.0.79 () {56 vars in 1251 bytes} [Wed Aug 31 12:16:55 2022] GET /identity/v3/endpoints?service_id=5a18f994e3aa438888d58dfed5b22c00&interface=public®ion_id=RegionOne => generated 194 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:56.182047 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6125e97-8630-4804-82b0-214b134cfe4c None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:56.372899 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a0e971-09d3-4412-ac45-fe9369ce76d2 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:56.374213 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6125e97-8630-4804-82b0-214b134cfe4c None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:56.452097 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadf2ad6-00df-4bc9-965b-bf29ccf1e09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:56.453113 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadf2ad6-00df-4bc9-965b-bf29ccf1e09e None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:56.453555 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadf2ad6-00df-4bc9-965b-bf29ccf1e09e None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:56.454000 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadf2ad6-00df-4bc9-965b-bf29ccf1e09e None admin] PATH_INFO: `/v3/services` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:56.454939 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadf2ad6-00df-4bc9-965b-bf29ccf1e09e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:56.457127 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadf2ad6-00df-4bc9-965b-bf29ccf1e09e None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:56.462806 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0f8205-e63d-443c-a6b1-b66807a6f223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:56.464891 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f8205-e63d-443c-a6b1-b66807a6f223 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:56.465721 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f8205-e63d-443c-a6b1-b66807a6f223 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:56.466569 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f8205-e63d-443c-a6b1-b66807a6f223 None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:56.467859 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0f8205-e63d-443c-a6b1-b66807a6f223 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:56.468802 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0f8205-e63d-443c-a6b1-b66807a6f223 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:56.470479 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0f8205-e63d-443c-a6b1-b66807a6f223 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:56.476292 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:56.486587 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 394/785] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 12:16:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 502 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:56.486948 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 392/786] 10.222.0.79 () {56 vars in 1087 bytes} [Wed Aug 31 12:16:56 2022] GET /identity/v3/services => generated 772 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:56.493815 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadf2ad6-00df-4bc9-965b-bf29ccf1e09e None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:56.543370 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:56.619146 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadf2ad6-00df-4bc9-965b-bf29ccf1e09e None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:56.660904 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2751c28e-817f-49e0-a78d-be1da60e7c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:56.661471 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2751c28e-817f-49e0-a78d-be1da60e7c51 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:56.661753 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2751c28e-817f-49e0-a78d-be1da60e7c51 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:56.662029 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2751c28e-817f-49e0-a78d-be1da60e7c51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:56.675638 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2751c28e-817f-49e0-a78d-be1da60e7c51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:56.677162 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2751c28e-817f-49e0-a78d-be1da60e7c51 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:56.695277 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-2751c28e-817f-49e0-a78d-be1da60e7c51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:56.695277 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:56.695277 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:56.695277 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:56.695277 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:56.695277 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:56.695277 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:56.695277 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:56.695277 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:56.695277 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:56.695277 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:56.695277 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:56.695277 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:16:56.695277 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:16:56.695277 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:16:56.695277 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:16:56.697813 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:56.697813 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:56.697813 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:56.697813 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:56.697813 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:56.697813 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:56.697813 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:56.697813 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:56.697813 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:56.697813 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:56.697813 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:56.697813 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:56.697813 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:56.697813 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:56.697813 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:56.697813 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:56.697813 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:16:56.699751 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:16:56.699751 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:56.699751 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:16:56.699751 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 393/787] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:16:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:56.703085 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2751c28e-817f-49e0-a78d-be1da60e7c51 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:56.703885 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0f8205-e63d-443c-a6b1-b66807a6f223 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:56.831620 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:56.868550 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2751c28e-817f-49e0-a78d-be1da60e7c51 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:56.903300 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0f8205-e63d-443c-a6b1-b66807a6f223 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:56.932647 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1be5ed-6203-4f39-9634-7d7aa7d274f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:56.933572 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1be5ed-6203-4f39-9634-7d7aa7d274f8 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:56.934072 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1be5ed-6203-4f39-9634-7d7aa7d274f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:56.934552 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1be5ed-6203-4f39-9634-7d7aa7d274f8 None admin] PATH_INFO: `/v3/domains` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:56.936059 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1be5ed-6203-4f39-9634-7d7aa7d274f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:56.936694 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1be5ed-6203-4f39-9634-7d7aa7d274f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:56.939687 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1be5ed-6203-4f39-9634-7d7aa7d274f8 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:56.949399 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8757ee-8373-4859-9a96-0cb8ea51e232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:56.950148 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8757ee-8373-4859-9a96-0cb8ea51e232 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:56.950434 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8757ee-8373-4859-9a96-0cb8ea51e232 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:56.950709 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8757ee-8373-4859-9a96-0cb8ea51e232 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:56.964327 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 394/788] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 12:16:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:56.966421 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41323b3-d45f-4481-be26-6b469347a994 None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:56.966903 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41323b3-d45f-4481-be26-6b469347a994 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:56.967354 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41323b3-d45f-4481-be26-6b469347a994 None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:56.970410 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 395/789] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:16:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:16:56.971490 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8757ee-8373-4859-9a96-0cb8ea51e232 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:16:56.971820 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41323b3-d45f-4481-be26-6b469347a994 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:56.979724 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-4d8757ee-8373-4859-9a96-0cb8ea51e232 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:16:56.979724 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:56.979724 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:56.979724 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:56.979724 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:56.979724 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:56.979724 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:56.979724 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:56.979724 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:56.979724 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:56.979724 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:56.979724 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:56.979724 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:16:56.979724 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:16:56.979724 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:16:56.979724 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:16:56.980800 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:16:56.980800 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:16:56.980800 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:16:56.980800 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:16:56.980800 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:56.980800 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:56.980800 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:56.980800 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:56.980800 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:56.980800 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:56.980800 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:56.980800 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:56.980800 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:56.980800 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:56.980800 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:56.980800 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:56.981654 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:56.981654 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:56.981654 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:56.981654 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:56.981654 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:16:56.981654 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:16:56.981654 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:16:56.981654 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:16:56.981654 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:16:56.981654 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:16:56.981654 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:16:56.981654 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:16:56.982313 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 395/790] 10.222.0.79 () {56 vars in 1096 bytes} [Wed Aug 31 12:16:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:56.988972 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f74d63b-5df5-49bf-81f9-a17af35741a0 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:56.989466 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f74d63b-5df5-49bf-81f9-a17af35741a0 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:56.989950 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f74d63b-5df5-49bf-81f9-a17af35741a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:57.026725 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-3f74d63b-5df5-49bf-81f9-a17af35741a0 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:57.028868 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-3f74d63b-5df5-49bf-81f9-a17af35741a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:57.131311 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:57.155306 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 396/791] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:16:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:16:57.156696 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f74d63b-5df5-49bf-81f9-a17af35741a0 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:57.163074 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41323b3-d45f-4481-be26-6b469347a994 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:57.240060 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2037f8-0fbe-4d13-bdd6-1fd345d13b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:57.242317 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2037f8-0fbe-4d13-bdd6-1fd345d13b10 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:57.243287 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2037f8-0fbe-4d13-bdd6-1fd345d13b10 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:57.244203 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2037f8-0fbe-4d13-bdd6-1fd345d13b10 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:57.248898 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:57.264014 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2037f8-0fbe-4d13-bdd6-1fd345d13b10 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:57.267474 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2037f8-0fbe-4d13-bdd6-1fd345d13b10 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:57.297700 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-bd2037f8-0fbe-4d13-bdd6-1fd345d13b10 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 12:16:57.297700 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:57.297700 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:57.297700 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:57.297700 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:57.297700 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:57.297700 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:57.297700 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:57.297700 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:57.297700 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:57.297700 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:57.297700 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:57.297700 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:16:57.297700 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:16:57.297700 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:16:57.297700 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:16:57.299578 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:57.299578 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:57.299578 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:16:57.299578 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:16:57.299578 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:16:57.299578 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:16:57.299578 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:57.299578 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:57.299578 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:57.299578 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:57.299578 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:57.299578 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:57.299578 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:57.299578 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:57.299578 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:57.299578 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:57.299578 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:57.299578 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:57.301505 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:57.301505 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:57.301505 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:16:57.301505 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:16:57.301505 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:16:57.301505 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:16:57.301505 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:16:57.301505 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:16:57.301505 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 12:16:57.301505 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:16:57.302603 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f74d63b-5df5-49bf-81f9-a17af35741a0 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:57.307711 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 396/792] 10.222.0.79 () {56 vars in 1096 bytes} [Wed Aug 31 12:16:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:16:57.318537 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2037f8-0fbe-4d13-bdd6-1fd345d13b10 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:57.417348 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541c5e48-dcf3-4e2c-b69c-0c60ac3d29a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:57.418914 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c5e48-dcf3-4e2c-b69c-0c60ac3d29a7 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:57.419696 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c5e48-dcf3-4e2c-b69c-0c60ac3d29a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:57.420634 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c5e48-dcf3-4e2c-b69c-0c60ac3d29a7 None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:57.422159 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541c5e48-dcf3-4e2c-b69c-0c60ac3d29a7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:57.423073 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541c5e48-dcf3-4e2c-b69c-0c60ac3d29a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:57.432157 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541c5e48-dcf3-4e2c-b69c-0c60ac3d29a7 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:57.457111 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2037f8-0fbe-4d13-bdd6-1fd345d13b10 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:57.466039 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 397/793] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 12:16:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:57.473494 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541c5e48-dcf3-4e2c-b69c-0c60ac3d29a7 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:57.505865 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a880e-1b47-4030-8610-65fac3041cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:57.506841 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a880e-1b47-4030-8610-65fac3041cc1 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:57.508612 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a880e-1b47-4030-8610-65fac3041cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:57.509116 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a880e-1b47-4030-8610-65fac3041cc1 None admin] PATH_INFO: `/v3/users` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:57.510080 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6a880e-1b47-4030-8610-65fac3041cc1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:57.510608 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6a880e-1b47-4030-8610-65fac3041cc1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:57.512848 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6a880e-1b47-4030-8610-65fac3041cc1 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:57.539946 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 397/794] 10.222.0.79 () {56 vars in 1135 bytes} [Wed Aug 31 12:16:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:57.542610 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a880e-1b47-4030-8610-65fac3041cc1 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:57.607746 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:57.665110 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:57.667824 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a880e-1b47-4030-8610-65fac3041cc1 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:57.712359 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10faa7a2-335b-4e86-ad04-327874045f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:57.713383 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10faa7a2-335b-4e86-ad04-327874045f6c None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:57.714128 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10faa7a2-335b-4e86-ad04-327874045f6c None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:57.714640 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10faa7a2-335b-4e86-ad04-327874045f6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:57.728884 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10faa7a2-335b-4e86-ad04-327874045f6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:57.731342 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10faa7a2-335b-4e86-ad04-327874045f6c None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:57.750911 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-10faa7a2-335b-4e86-ad04-327874045f6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:57.750911 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:57.750911 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:57.750911 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:57.750911 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:57.750911 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:57.750911 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:57.750911 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:57.750911 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:57.750911 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:57.750911 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:57.750911 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:57.750911 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:16:57.750911 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:16:57.750911 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:16:57.750911 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:16:57.751977 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:57.751977 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:57.751977 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:57.751977 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:57.751977 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:57.751977 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:57.751977 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:57.751977 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:57.751977 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:57.751977 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:57.751977 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:57.751977 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:57.751977 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:57.751977 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:57.751977 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:57.751977 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:57.751977 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:16:57.752895 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:16:57.752895 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:57.752895 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:16:57.755756 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 398/795] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:16:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:16:57.763844 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10faa7a2-335b-4e86-ad04-327874045f6c None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:57.889982 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10faa7a2-335b-4e86-ad04-327874045f6c None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:57.893697 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541c5e48-dcf3-4e2c-b69c-0c60ac3d29a7 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:57.899613 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:57.933381 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e165dd7b-4b7a-411f-b20b-78a1c2d64597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:57.934885 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e165dd7b-4b7a-411f-b20b-78a1c2d64597 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:57.935397 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e165dd7b-4b7a-411f-b20b-78a1c2d64597 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:57.935885 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e165dd7b-4b7a-411f-b20b-78a1c2d64597 None admin] PATH_INFO: `/v3/domains` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:57.937059 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e165dd7b-4b7a-411f-b20b-78a1c2d64597 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:57.937629 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e165dd7b-4b7a-411f-b20b-78a1c2d64597 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:57.939471 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e165dd7b-4b7a-411f-b20b-78a1c2d64597 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:57.955156 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 399/796] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 12:16:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:16:57.956408 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e165dd7b-4b7a-411f-b20b-78a1c2d64597 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:57.997819 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861314ec-50ba-4167-92f1-e7d55d485f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:57.999064 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861314ec-50ba-4167-92f1-e7d55d485f76 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:57.999547 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861314ec-50ba-4167-92f1-e7d55d485f76 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:58.000144 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861314ec-50ba-4167-92f1-e7d55d485f76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:58.026967 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861314ec-50ba-4167-92f1-e7d55d485f76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:58.032204 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861314ec-50ba-4167-92f1-e7d55d485f76 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:58.069307 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-861314ec-50ba-4167-92f1-e7d55d485f76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:58.069307 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:58.069307 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:58.069307 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:58.069307 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:58.069307 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:58.069307 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:58.069307 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:58.069307 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:58.069307 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:58.069307 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:58.069307 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:58.069307 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:16:58.069307 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:16:58.069307 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:16:58.069307 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:16:58.071143 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:58.071143 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:58.071143 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:58.071143 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:58.071143 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:58.071143 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:58.071143 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:58.071143 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:58.071143 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:58.071143 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:58.071143 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:58.071143 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:58.071143 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:58.071143 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:58.071143 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:58.071143 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:58.071143 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:16:58.072106 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:16:58.072106 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:58.072106 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:16:58.078584 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 398/797] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:16:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 601 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:58.078584 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861314ec-50ba-4167-92f1-e7d55d485f76 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:58.094329 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e165dd7b-4b7a-411f-b20b-78a1c2d64597 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:58.137249 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ec0d92-835f-4cd5-848c-6a42b91ea35d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:58.138284 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec0d92-835f-4cd5-848c-6a42b91ea35d None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:58.138774 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec0d92-835f-4cd5-848c-6a42b91ea35d None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:58.139732 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec0d92-835f-4cd5-848c-6a42b91ea35d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:58.154327 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ec0d92-835f-4cd5-848c-6a42b91ea35d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:16:58.160358 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-c3ec0d92-835f-4cd5-848c-6a42b91ea35d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:16:58.160358 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:58.160358 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:58.160358 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:58.160358 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:58.160358 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:58.160358 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:58.160358 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:58.160358 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:58.160358 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:58.160358 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:58.160358 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:58.160358 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:16:58.160358 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:16:58.160358 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:16:58.160358 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:16:58.161325 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:16:58.161325 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:16:58.161325 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:16:58.161325 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:16:58.161325 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:58.161325 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:58.161325 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:58.161325 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:58.161325 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:58.161325 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:58.161325 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:58.161325 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:58.161325 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:58.161325 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:58.161325 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:58.161325 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:58.162188 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:58.162188 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:58.162188 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:58.162188 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:58.162188 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:16:58.162188 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:16:58.162188 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:16:58.162188 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:16:58.162188 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:16:58.162188 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:16:58.162188 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:16:58.162188 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:16:58.165696 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 400/798] 10.222.0.79 () {56 vars in 1102 bytes} [Wed Aug 31 12:16:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:58.166752 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ec0d92-835f-4cd5-848c-6a42b91ea35d None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:58.197341 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:58.301416 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ec0d92-835f-4cd5-848c-6a42b91ea35d None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:58.328365 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861314ec-50ba-4167-92f1-e7d55d485f76 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:58.331613 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:58.349518 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ab143d-3579-4231-a7b9-a8164030bf26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:58.352957 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab143d-3579-4231-a7b9-a8164030bf26 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:58.354184 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab143d-3579-4231-a7b9-a8164030bf26 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:58.354642 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab143d-3579-4231-a7b9-a8164030bf26 None admin] PATH_INFO: `/v3/domains` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:58.355865 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ab143d-3579-4231-a7b9-a8164030bf26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:58.356492 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ab143d-3579-4231-a7b9-a8164030bf26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:58.359465 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ab143d-3579-4231-a7b9-a8164030bf26 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:58.374509 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 401/799] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 12:16:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:58.375657 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ab143d-3579-4231-a7b9-a8164030bf26 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:58.396974 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0950689b-b8a2-4214-95ac-a7d5a954bcd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:58.398177 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950689b-b8a2-4214-95ac-a7d5a954bcd2 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:58.398642 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950689b-b8a2-4214-95ac-a7d5a954bcd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:58.399120 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950689b-b8a2-4214-95ac-a7d5a954bcd2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:58.411818 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0950689b-b8a2-4214-95ac-a7d5a954bcd2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:58.414664 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0950689b-b8a2-4214-95ac-a7d5a954bcd2 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:58.435323 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-0950689b-b8a2-4214-95ac-a7d5a954bcd2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:16:58.435323 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:58.435323 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:58.435323 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:58.435323 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:58.435323 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:58.435323 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:58.435323 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:58.435323 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:58.435323 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:58.435323 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:58.435323 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:58.435323 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:16:58.435323 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:16:58.435323 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:16:58.437273 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:16:58.437273 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:58.437273 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:58.437273 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:58.437273 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:58.437273 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:58.437273 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:58.437273 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:58.437273 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:58.437273 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:58.437273 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:58.437273 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:58.437273 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:58.437273 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:58.437273 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:58.437273 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:58.437273 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:58.439366 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:16:58.439366 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:16:58.439366 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:16:58.439366 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:16:58.439366 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:16:58.439366 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:16:58.439366 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:16:58.439366 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:16:58.439366 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 399/800] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 12:16:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:58.442031 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba5681-a813-4e80-9a27-6954236ff1ae None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:58.442819 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba5681-a813-4e80-9a27-6954236ff1ae None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:58.445977 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba5681-a813-4e80-9a27-6954236ff1ae None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:58.451877 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 400/801] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:16:58 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:16:58.452942 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eba5681-a813-4e80-9a27-6954236ff1ae None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:58.522522 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:58.558377 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ab143d-3579-4231-a7b9-a8164030bf26 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:58.596424 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eba5681-a813-4e80-9a27-6954236ff1ae None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:58.613205 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dc4585-a720-4bc4-a2d2-d9990910d7fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:58.614240 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc4585-a720-4bc4-a2d2-d9990910d7fd None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:58.614711 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc4585-a720-4bc4-a2d2-d9990910d7fd None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:58.615336 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc4585-a720-4bc4-a2d2-d9990910d7fd None admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:58.617188 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dc4585-a720-4bc4-a2d2-d9990910d7fd None admin] RBAC: Adding query filter params (name=service) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:58.617700 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dc4585-a720-4bc4-a2d2-d9990910d7fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:58.620276 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dc4585-a720-4bc4-a2d2-d9990910d7fd None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:58.636026 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 402/802] 10.222.0.79 () {56 vars in 1103 bytes} [Wed Aug 31 12:16:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:58.637400 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dc4585-a720-4bc4-a2d2-d9990910d7fd None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:58.659870 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c2981e-ccf1-47b6-a305-b7c914d2c933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:58.661000 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2981e-ccf1-47b6-a305-b7c914d2c933 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:58.662095 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2981e-ccf1-47b6-a305-b7c914d2c933 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:58.662476 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2981e-ccf1-47b6-a305-b7c914d2c933 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:58.677163 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c2981e-ccf1-47b6-a305-b7c914d2c933 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:58.680504 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c2981e-ccf1-47b6-a305-b7c914d2c933 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:58.703668 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-f0c2981e-ccf1-47b6-a305-b7c914d2c933 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 12:16:58.703668 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:58.703668 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:58.703668 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:58.703668 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:58.703668 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:58.703668 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:58.703668 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:58.703668 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:58.703668 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:58.703668 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:58.703668 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:58.703668 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:16:58.703668 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:16:58.703668 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:16:58.703668 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:16:58.704726 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:58.704726 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:58.704726 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:16:58.704726 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:16:58.704726 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:16:58.704726 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:16:58.704726 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:58.704726 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:58.704726 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:58.704726 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:58.704726 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:58.704726 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:58.704726 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:58.704726 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:58.704726 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:58.704726 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:58.704726 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:58.704726 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:58.705661 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:58.705661 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:58.705661 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:16:58.705661 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:16:58.705661 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:16:58.705661 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:16:58.705661 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:16:58.705661 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:16:58.705661 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 12:16:58.705661 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:16:58.706220 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 401/803] 10.222.0.79 () {56 vars in 1093 bytes} [Wed Aug 31 12:16:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:58.708321 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c40e1-74ef-4e54-8413-9ddc92feb401 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:58.708792 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c40e1-74ef-4e54-8413-9ddc92feb401 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:58.709292 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c40e1-74ef-4e54-8413-9ddc92feb401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:58.740464 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-041c40e1-74ef-4e54-8413-9ddc92feb401 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:58.743123 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-041c40e1-74ef-4e54-8413-9ddc92feb401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:58.772004 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:58.794779 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dc4585-a720-4bc4-a2d2-d9990910d7fd None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:58.834385 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e741a9-f736-4855-bf30-16fc8630da6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:58.835781 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e741a9-f736-4855-bf30-16fc8630da6e None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:58.836203 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e741a9-f736-4855-bf30-16fc8630da6e None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:58.836755 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e741a9-f736-4855-bf30-16fc8630da6e None admin] PATH_INFO: `/v3/projects` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:58.837843 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e741a9-f736-4855-bf30-16fc8630da6e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:58.838159 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e741a9-f736-4855-bf30-16fc8630da6e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:58.839678 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e741a9-f736-4855-bf30-16fc8630da6e None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:58.854026 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 403/804] 10.222.0.79 () {56 vars in 1148 bytes} [Wed Aug 31 12:16:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:58.854720 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e741a9-f736-4855-bf30-16fc8630da6e None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:58.866002 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:58.877544 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 402/805] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:16:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:16:58.878889 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c40e1-74ef-4e54-8413-9ddc92feb401 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:59.015565 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e741a9-f736-4855-bf30-16fc8630da6e None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:59.031367 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c40e1-74ef-4e54-8413-9ddc92feb401 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:59.075386 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417af2b7-ac18-4f03-8a30-d41eb68fea33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:59.076078 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417af2b7-ac18-4f03-8a30-d41eb68fea33 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:59.076358 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417af2b7-ac18-4f03-8a30-d41eb68fea33 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:59.076627 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417af2b7-ac18-4f03-8a30-d41eb68fea33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:59.076794 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f8d73d-cde6-41b9-a95c-9903a79451b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:59.077749 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f8d73d-cde6-41b9-a95c-9903a79451b4 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:59.078161 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f8d73d-cde6-41b9-a95c-9903a79451b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:59.078522 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f8d73d-cde6-41b9-a95c-9903a79451b4 None admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:59.079603 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f8d73d-cde6-41b9-a95c-9903a79451b4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:59.080117 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f8d73d-cde6-41b9-a95c-9903a79451b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:59.081806 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f8d73d-cde6-41b9-a95c-9903a79451b4 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:59.089403 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417af2b7-ac18-4f03-8a30-d41eb68fea33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:59.090787 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417af2b7-ac18-4f03-8a30-d41eb68fea33 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:59.105520 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 403/806] 10.222.0.79 () {56 vars in 1133 bytes} [Wed Aug 31 12:16:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:59.106897 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f8d73d-cde6-41b9-a95c-9903a79451b4 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:59.108146 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-417af2b7-ac18-4f03-8a30-d41eb68fea33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:59.108146 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:59.108146 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:59.108146 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:59.108146 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:59.108146 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:59.108146 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:59.108146 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:59.108146 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:59.108146 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:59.108146 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:59.108146 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:59.108146 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:16:59.108146 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:16:59.108146 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:16:59.108146 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:16:59.110225 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:59.110225 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:59.110225 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:59.110225 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:59.110225 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:59.110225 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:59.110225 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:59.110225 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:59.110225 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:59.110225 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:59.110225 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:59.110225 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:59.110225 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:59.110225 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:59.110225 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:59.110225 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:59.110225 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:16:59.112362 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:16:59.112362 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:16:59.112362 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:16:59.118722 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 404/807] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:16:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:59.119798 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417af2b7-ac18-4f03-8a30-d41eb68fea33 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:59.130233 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:59.190683 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:59.239687 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f8d73d-cde6-41b9-a95c-9903a79451b4 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:59.243217 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417af2b7-ac18-4f03-8a30-d41eb68fea33 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:59.286460 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce3908e-5874-4c5e-8898-4a87064d80f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:59.286887 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717f87c7-929b-4ca9-9303-640982c60c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:59.287344 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3908e-5874-4c5e-8898-4a87064d80f1 None admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:59.287691 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3908e-5874-4c5e-8898-4a87064d80f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:59.288030 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3908e-5874-4c5e-8898-4a87064d80f1 None admin] PATH_INFO: `/v3/projects/a94f4957f2a047cc844342e1c7c74ca5/users/4896540cc14f40b08d05ade32cfd0f37/roles/a332ef951db949b0bad7019fbd28a1b9` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:59.288882 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f87c7-929b-4ca9-9303-640982c60c43 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:59.289348 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f87c7-929b-4ca9-9303-640982c60c43 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:59.289808 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f87c7-929b-4ca9-9303-640982c60c43 None admin] PATH_INFO: `/v3/domains` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:59.290667 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717f87c7-929b-4ca9-9303-640982c60c43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:59.291182 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717f87c7-929b-4ca9-9303-640982c60c43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:59.291881 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce3908e-5874-4c5e-8898-4a87064d80f1 None admin] RBAC: Authorizing `identity:create_grant(project_id=a94f4957f2a047cc844342e1c7c74ca5, user_id=4896540cc14f40b08d05ade32cfd0f37, role_id=a332ef951db949b0bad7019fbd28a1b9)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:59.293006 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717f87c7-929b-4ca9-9303-640982c60c43 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:59.293988 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce3908e-5874-4c5e-8898-4a87064d80f1 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:59.315313 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 405/808] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 12:16:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:59.317895 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717f87c7-929b-4ca9-9303-640982c60c43 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:59.320410 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 404/809] 10.222.0.79 () {58 vars in 1439 bytes} [Wed Aug 31 12:16:59 2022] PUT /identity/v3/projects/a94f4957f2a047cc844342e1c7c74ca5/users/4896540cc14f40b08d05ade32cfd0f37/roles/a332ef951db949b0bad7019fbd28a1b9 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:16:59.322216 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce3908e-5874-4c5e-8898-4a87064d80f1 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:59.457170 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:59.517385 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717f87c7-929b-4ca9-9303-640982c60c43 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:59.521222 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce3908e-5874-4c5e-8898-4a87064d80f1 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:59.541238 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:59.566279 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4d2922-1866-454f-ad85-c507dba493b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:59.566948 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d2922-1866-454f-ad85-c507dba493b0 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:59.567231 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d2922-1866-454f-ad85-c507dba493b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:59.567492 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d2922-1866-454f-ad85-c507dba493b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:59.568413 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149d854a-17ec-4c80-8614-a73ebcc66859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:59.569060 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d854a-17ec-4c80-8614-a73ebcc66859 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:59.569334 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d854a-17ec-4c80-8614-a73ebcc66859 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:59.569693 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d854a-17ec-4c80-8614-a73ebcc66859 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:59.583592 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149d854a-17ec-4c80-8614-a73ebcc66859 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:59.587224 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149d854a-17ec-4c80-8614-a73ebcc66859 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:59.610408 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-149d854a-17ec-4c80-8614-a73ebcc66859 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 12:16:59.610408 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:59.610408 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:59.610408 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:59.610408 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:59.610408 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:59.610408 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:59.610408 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:59.610408 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:59.610408 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:59.610408 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:59.610408 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:59.610408 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:16:59.610408 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:16:59.610408 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:16:59.610408 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:16:59.612086 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:59.612086 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:59.612086 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:16:59.612086 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:16:59.612086 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:16:59.612086 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:16:59.612086 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:59.612086 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:59.612086 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:59.612086 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:59.612086 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:59.612086 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:59.612086 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:59.612086 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:59.612086 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:59.612086 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:59.612086 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:59.612086 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:59.613121 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:59.613121 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:59.613121 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:16:59.613121 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:16:59.613121 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:16:59.613121 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:16:59.613121 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:16:59.613121 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:16:59.613121 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 12:16:59.613121 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:16:59.613121 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 405/810] 10.222.0.79 () {56 vars in 1117 bytes} [Wed Aug 31 12:16:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:59.614795 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32040631-e09c-4c6a-b37a-43c448e874f8 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:59.615315 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32040631-e09c-4c6a-b37a-43c448e874f8 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:59.615792 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32040631-e09c-4c6a-b37a-43c448e874f8 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:59.623522 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 406/811] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:16:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:16:59.623522 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32040631-e09c-4c6a-b37a-43c448e874f8 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:59.654876 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4d2922-1866-454f-ad85-c507dba493b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:59.656497 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4d2922-1866-454f-ad85-c507dba493b0 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:59.805567 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32040631-e09c-4c6a-b37a-43c448e874f8 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:59.841942 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:59.849675 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1f0619-19b6-4f36-80bf-99eeaf9f209f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:59.850507 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f0619-19b6-4f36-80bf-99eeaf9f209f None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:59.851459 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f0619-19b6-4f36-80bf-99eeaf9f209f None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:59.851793 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f0619-19b6-4f36-80bf-99eeaf9f209f None admin] PATH_INFO: `/v3/services/network` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:59.852507 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1f0619-19b6-4f36-80bf-99eeaf9f209f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:59.854027 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1f0619-19b6-4f36-80bf-99eeaf9f209f None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:59.864099 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-2e1f0619-19b6-4f36-80bf-99eeaf9f209f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 12:16:59.864099 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:59.864099 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 12:16:59.864099 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 12:16:59.864099 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 12:16:59.864099 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 12:16:59.864099 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 12:16:59.864099 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:16:59.864099 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 12:16:59.864099 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:16:59.864099 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:16:59.864099 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:16:59.864099 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:16:59.864099 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:16:59.864099 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:16:59.864099 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:16:59.864099 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:16:59.875705 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:16:59.875705 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:16:59.875705 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:16:59.875705 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:16:59.875705 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:16:59.875705 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:16:59.875705 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 12:16:59.875705 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 12:16:59.875705 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 12:16:59.875705 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 12:16:59.875705 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:16:59.875705 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:16:59.875705 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:16:59.875705 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:16:59.875705 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:16:59.875705 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:16:59.877824 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:16:59.877824 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:16:59.877824 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:16:59.877824 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:16:59.877824 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:16:59.877824 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:16:59.877824 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:16:59.877824 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:16:59.877824 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:16:59.877824 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:16:59.877824 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 12:16:59.877824 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:16:59.877824 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 12:16:59.877824 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:16:59.877824 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 407/812] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 12:16:59 2022] GET /identity/v3/services/network => generated 88 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:16:59.880187 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1f0619-19b6-4f36-80bf-99eeaf9f209f None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:59.921713 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 406/813] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 12:16:59 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 600 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 12:16:59.921713 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e0ae69-9c80-4f44-82b9-1d3da1d184ad None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:59.921713 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e0ae69-9c80-4f44-82b9-1d3da1d184ad None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:59.921713 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e0ae69-9c80-4f44-82b9-1d3da1d184ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:59.941911 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-54e0ae69-9c80-4f44-82b9-1d3da1d184ad None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:59.943718 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-54e0ae69-9c80-4f44-82b9-1d3da1d184ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:59.960075 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:59.993317 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1f0619-19b6-4f36-80bf-99eeaf9f209f None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:00.052678 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3527674f-e3f9-42c5-a43a-eccd242041ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:00.053484 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 407/814] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:16:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:17:00.055460 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e0ae69-9c80-4f44-82b9-1d3da1d184ad None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:00.056002 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3527674f-e3f9-42c5-a43a-eccd242041ad None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:00.056674 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3527674f-e3f9-42c5-a43a-eccd242041ad None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:00.057329 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3527674f-e3f9-42c5-a43a-eccd242041ad None admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:00.058879 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3527674f-e3f9-42c5-a43a-eccd242041ad None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:00.059561 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3527674f-e3f9-42c5-a43a-eccd242041ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:00.061836 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3527674f-e3f9-42c5-a43a-eccd242041ad None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:00.099421 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 408/815] 10.222.0.79 () {56 vars in 1149 bytes} [Wed Aug 31 12:16:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:00.099421 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3527674f-e3f9-42c5-a43a-eccd242041ad None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:00.184376 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:00.265529 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e0ae69-9c80-4f44-82b9-1d3da1d184ad None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:00.266035 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3527674f-e3f9-42c5-a43a-eccd242041ad None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:00.329140 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1350c84d-680b-4f85-8f27-0bd6a8b4aa5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:00.330460 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350c84d-680b-4f85-8f27-0bd6a8b4aa5b None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:00.331188 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350c84d-680b-4f85-8f27-0bd6a8b4aa5b None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:00.331658 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350c84d-680b-4f85-8f27-0bd6a8b4aa5b None admin] PATH_INFO: `/v3/services` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:00.332896 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1350c84d-680b-4f85-8f27-0bd6a8b4aa5b None admin] RBAC: Adding query filter params (name=network) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:00.333409 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1350c84d-680b-4f85-8f27-0bd6a8b4aa5b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:00.334631 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9dff8e-65de-4109-9536-cffa2d8b4b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:00.336766 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1350c84d-680b-4f85-8f27-0bd6a8b4aa5b None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:00.337367 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9dff8e-65de-4109-9536-cffa2d8b4b9b None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:00.338100 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9dff8e-65de-4109-9536-cffa2d8b4b9b None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:00.338772 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9dff8e-65de-4109-9536-cffa2d8b4b9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:00.358914 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9dff8e-65de-4109-9536-cffa2d8b4b9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:00.360589 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 408/816] 10.222.0.79 () {56 vars in 1112 bytes} [Wed Aug 31 12:17:00 2022] GET /identity/v3/services?name=network => generated 124 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:00.362112 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1350c84d-680b-4f85-8f27-0bd6a8b4aa5b None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:00.362841 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9dff8e-65de-4109-9536-cffa2d8b4b9b None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:00.392908 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-8e9dff8e-65de-4109-9536-cffa2d8b4b9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:17:00.392908 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:00.392908 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:17:00.392908 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:17:00.392908 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:17:00.392908 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:17:00.392908 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:17:00.392908 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:17:00.392908 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:17:00.392908 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:17:00.392908 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:17:00.392908 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:17:00.392908 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:17:00.392908 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:17:00.392908 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:17:00.392908 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:17:00.395383 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:17:00.395383 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:17:00.395383 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:17:00.395383 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:17:00.395383 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:17:00.395383 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:17:00.395383 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:17:00.395383 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:17:00.395383 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:17:00.395383 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:17:00.395383 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:17:00.395383 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:17:00.395383 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:17:00.395383 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:17:00.395383 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:17:00.395383 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:17:00.395383 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:17:00.397463 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:17:00.397463 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:17:00.397463 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:17:00.400695 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 409/817] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:17:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:17:00.402614 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9dff8e-65de-4109-9536-cffa2d8b4b9b None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:00.409437 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:00.541987 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1350c84d-680b-4f85-8f27-0bd6a8b4aa5b None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:00.574982 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9dff8e-65de-4109-9536-cffa2d8b4b9b None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:00.579233 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:00.597028 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f2e494-e8bd-4b13-a027-8c22628974ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:00.597854 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f2e494-e8bd-4b13-a027-8c22628974ed None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:00.598138 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f2e494-e8bd-4b13-a027-8c22628974ed None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:00.598417 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f2e494-e8bd-4b13-a027-8c22628974ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:00.610428 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f2e494-e8bd-4b13-a027-8c22628974ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:00.611957 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f2e494-e8bd-4b13-a027-8c22628974ed None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:00.628058 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-41f2e494-e8bd-4b13-a027-8c22628974ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:17:00.628058 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:00.628058 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:17:00.628058 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:17:00.628058 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:17:00.628058 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:17:00.628058 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:17:00.628058 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:17:00.628058 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:17:00.628058 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:17:00.628058 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:17:00.628058 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:17:00.628058 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:17:00.628058 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:17:00.628058 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:17:00.628058 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:17:00.629083 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:17:00.629083 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:17:00.629083 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:17:00.629083 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:17:00.629083 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:17:00.629083 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:17:00.629083 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:17:00.629083 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:17:00.629083 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:17:00.629083 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:17:00.629083 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:17:00.629083 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:17:00.629083 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:17:00.629083 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:17:00.629083 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:17:00.629083 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:17:00.629083 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:17:00.629993 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:17:00.629993 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:17:00.629993 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:17:00.629993 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 409/818] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:17:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:17:00.629993 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f2e494-e8bd-4b13-a027-8c22628974ed None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:00.649092 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13429339-c1a2-4a21-b0ef-6097978752c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:00.650801 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13429339-c1a2-4a21-b0ef-6097978752c8 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:00.651268 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13429339-c1a2-4a21-b0ef-6097978752c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:00.651941 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13429339-c1a2-4a21-b0ef-6097978752c8 None admin] PATH_INFO: `/v3/services` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:00.653282 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13429339-c1a2-4a21-b0ef-6097978752c8 None admin] RBAC: Adding query filter params (type=network) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:00.653745 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13429339-c1a2-4a21-b0ef-6097978752c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:00.655347 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13429339-c1a2-4a21-b0ef-6097978752c8 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:00.667406 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 410/819] 10.222.0.79 () {56 vars in 1112 bytes} [Wed Aug 31 12:17:00 2022] GET /identity/v3/services?type=network => generated 350 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:00.667406 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13429339-c1a2-4a21-b0ef-6097978752c8 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:00.723435 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:00.773397 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f2e494-e8bd-4b13-a027-8c22628974ed None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:00.802424 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13429339-c1a2-4a21-b0ef-6097978752c8 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:00.816739 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61433a1-9595-472a-b4f8-bcc4c4433cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:00.817905 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61433a1-9595-472a-b4f8-bcc4c4433cdc None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:00.819168 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61433a1-9595-472a-b4f8-bcc4c4433cdc None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:00.819746 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61433a1-9595-472a-b4f8-bcc4c4433cdc None admin] PATH_INFO: `/v3/domains` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:00.820604 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61433a1-9595-472a-b4f8-bcc4c4433cdc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:00.821060 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61433a1-9595-472a-b4f8-bcc4c4433cdc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:00.822607 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61433a1-9595-472a-b4f8-bcc4c4433cdc None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:00.841674 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 410/820] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 12:17:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:00.843587 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61433a1-9595-472a-b4f8-bcc4c4433cdc None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:00.852054 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737a485a-714b-4aae-bb40-898f13d2948e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:00.852714 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737a485a-714b-4aae-bb40-898f13d2948e None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:00.853011 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737a485a-714b-4aae-bb40-898f13d2948e None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:00.853349 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737a485a-714b-4aae-bb40-898f13d2948e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:00.853853 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737a485a-714b-4aae-bb40-898f13d2948e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:00.855263 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737a485a-714b-4aae-bb40-898f13d2948e None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:00.872932 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-737a485a-714b-4aae-bb40-898f13d2948e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 12:17:00.872932 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:00.872932 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 12:17:00.872932 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 12:17:00.872932 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 12:17:00.872932 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 12:17:00.872932 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 12:17:00.872932 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:17:00.872932 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 12:17:00.872932 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:17:00.872932 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:17:00.872932 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:17:00.872932 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:00.872932 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:17:00.872932 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:17:00.872932 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:17:00.872932 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:17:00.874948 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:17:00.874948 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:17:00.874948 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:17:00.874948 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:17:00.874948 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:17:00.874948 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:17:00.874948 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 12:17:00.874948 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 12:17:00.874948 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 12:17:00.874948 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 12:17:00.874948 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:17:00.874948 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:17:00.874948 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:17:00.874948 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:17:00.874948 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:17:00.874948 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:17:00.876602 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:17:00.876602 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:17:00.876602 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:17:00.876602 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:17:00.876602 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:17:00.876602 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:17:00.876602 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:17:00.876602 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:17:00.876602 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:17:00.876602 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:17:00.876602 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 12:17:00.876602 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:17:00.876602 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 12:17:00.876602 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:17:00.876602 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 411/821] 10.222.0.79 () {56 vars in 1129 bytes} [Wed Aug 31 12:17:00 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:17:00.878107 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737a485a-714b-4aae-bb40-898f13d2948e None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:00.936878 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:00.999552 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61433a1-9595-472a-b4f8-bcc4c4433cdc None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:01.044735 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:01.045448 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737a485a-714b-4aae-bb40-898f13d2948e None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:01.066304 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3970cc58-b013-4343-8468-a23412f5cd4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:01.067062 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970cc58-b013-4343-8468-a23412f5cd4d None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:01.067355 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970cc58-b013-4343-8468-a23412f5cd4d None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:01.067637 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970cc58-b013-4343-8468-a23412f5cd4d None admin] PATH_INFO: `/v3/domains` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:01.068319 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3970cc58-b013-4343-8468-a23412f5cd4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:01.068621 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3970cc58-b013-4343-8468-a23412f5cd4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:01.070068 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3970cc58-b013-4343-8468-a23412f5cd4d None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:01.083483 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 411/822] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 12:17:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:01.084357 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3970cc58-b013-4343-8468-a23412f5cd4d None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:01.101289 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43e159f-c69c-4a5e-adde-a212fb29e143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:01.102260 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e159f-c69c-4a5e-adde-a212fb29e143 None admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:01.102739 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e159f-c69c-4a5e-adde-a212fb29e143 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:01.103258 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e159f-c69c-4a5e-adde-a212fb29e143 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:01.104460 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43e159f-c69c-4a5e-adde-a212fb29e143 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:01.107101 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43e159f-c69c-4a5e-adde-a212fb29e143 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:01.143509 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 412/823] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:17:00 2022] POST /identity/v3/endpoints => generated 337 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:17:01.144967 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43e159f-c69c-4a5e-adde-a212fb29e143 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:01.271987 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3970cc58-b013-4343-8468-a23412f5cd4d None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:01.314305 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:01.360149 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71551af8-e3ae-486a-a768-1a27165b04ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:01.361684 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71551af8-e3ae-486a-a768-1a27165b04ec None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:01.362457 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71551af8-e3ae-486a-a768-1a27165b04ec None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:01.363276 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71551af8-e3ae-486a-a768-1a27165b04ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:01.368360 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43e159f-c69c-4a5e-adde-a212fb29e143 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:01.377909 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71551af8-e3ae-486a-a768-1a27165b04ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:01.381421 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71551af8-e3ae-486a-a768-1a27165b04ec None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:01.406786 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-71551af8-e3ae-486a-a768-1a27165b04ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:17:01.406786 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:01.406786 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:17:01.406786 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:17:01.406786 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:17:01.406786 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:17:01.406786 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:17:01.406786 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:17:01.406786 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:17:01.406786 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:17:01.406786 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:17:01.406786 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:17:01.406786 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:17:01.406786 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:17:01.406786 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:17:01.408585 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:17:01.408585 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:17:01.408585 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:17:01.408585 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:17:01.408585 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:17:01.408585 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:17:01.408585 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:17:01.408585 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:17:01.408585 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:17:01.408585 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:17:01.408585 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:17:01.408585 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:17:01.408585 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:17:01.408585 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:17:01.408585 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:17:01.408585 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:17:01.408585 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:17:01.411869 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:17:01.411869 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:17:01.411869 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:17:01.411869 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:17:01.411869 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:17:01.411869 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:17:01.411869 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:17:01.411869 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:17:01.411869 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 412/824] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 12:17:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:17:01.411869 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71551af8-e3ae-486a-a768-1a27165b04ec None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:01.457535 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd105785-49bd-42a4-976b-a58f482c3707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:01.457535 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd105785-49bd-42a4-976b-a58f482c3707 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:01.457535 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd105785-49bd-42a4-976b-a58f482c3707 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:01.458071 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd105785-49bd-42a4-976b-a58f482c3707 None admin] PATH_INFO: `/v3/services` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:01.458898 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd105785-49bd-42a4-976b-a58f482c3707 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:01.462130 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd105785-49bd-42a4-976b-a58f482c3707 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:01.463299 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd105785-49bd-42a4-976b-a58f482c3707 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:01.472813 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 413/825] 10.222.0.79 () {56 vars in 1124 bytes} [Wed Aug 31 12:17:01 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:01.473991 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd105785-49bd-42a4-976b-a58f482c3707 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:01.508063 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:01.650586 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71551af8-e3ae-486a-a768-1a27165b04ec None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:01.693475 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd105785-49bd-42a4-976b-a58f482c3707 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:01.709513 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169cf082-f708-4987-afa3-41aa0b6a1448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:01.711043 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169cf082-f708-4987-afa3-41aa0b6a1448 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:01.711335 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169cf082-f708-4987-afa3-41aa0b6a1448 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:01.712045 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169cf082-f708-4987-afa3-41aa0b6a1448 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:01.719422 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169cf082-f708-4987-afa3-41aa0b6a1448 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:01.720879 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169cf082-f708-4987-afa3-41aa0b6a1448 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:01.733742 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-169cf082-f708-4987-afa3-41aa0b6a1448 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:17:01.733742 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:01.733742 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:17:01.733742 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:17:01.733742 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:17:01.733742 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:17:01.733742 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:17:01.733742 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:17:01.733742 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:17:01.733742 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:17:01.733742 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:17:01.733742 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:17:01.733742 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:17:01.733742 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:17:01.733742 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:17:01.735834 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:17:01.735834 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:17:01.735834 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:17:01.735834 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:17:01.735834 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:17:01.735834 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:17:01.735834 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:17:01.735834 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:17:01.735834 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:17:01.735834 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:17:01.735834 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:17:01.735834 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:17:01.735834 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:17:01.735834 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:17:01.735834 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:17:01.735834 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:17:01.735834 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:17:01.737953 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:17:01.737953 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:17:01.737953 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:17:01.737953 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:17:01.737953 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:17:01.737953 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:17:01.737953 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:17:01.737953 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:17:01.737953 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 413/826] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 12:17:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:17:01.737953 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169cf082-f708-4987-afa3-41aa0b6a1448 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:01.744386 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2391dffb-667b-460a-af6c-313ac4be784f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:01.745108 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2391dffb-667b-460a-af6c-313ac4be784f None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:01.745396 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2391dffb-667b-460a-af6c-313ac4be784f None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:01.745663 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2391dffb-667b-460a-af6c-313ac4be784f None admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:01.746365 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2391dffb-667b-460a-af6c-313ac4be784f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:01.746667 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2391dffb-667b-460a-af6c-313ac4be784f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:01.748156 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2391dffb-667b-460a-af6c-313ac4be784f None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:01.761719 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 414/827] 10.222.0.79 () {56 vars in 1148 bytes} [Wed Aug 31 12:17:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:01.763046 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54721859-6708-4c24-87b9-5759f78b2208 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:01.763318 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54721859-6708-4c24-87b9-5759f78b2208 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:01.763584 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54721859-6708-4c24-87b9-5759f78b2208 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:01.764971 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 415/828] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:17:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:17:01.765586 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54721859-6708-4c24-87b9-5759f78b2208 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:01.777607 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:01.873942 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:01.878090 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169cf082-f708-4987-afa3-41aa0b6a1448 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:01.907713 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54721859-6708-4c24-87b9-5759f78b2208 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:01.921479 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c75f52-bd8e-4a79-b2f2-a677d787ecd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:01.922445 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c75f52-bd8e-4a79-b2f2-a677d787ecd1 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:01.922792 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c75f52-bd8e-4a79-b2f2-a677d787ecd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:01.923170 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c75f52-bd8e-4a79-b2f2-a677d787ecd1 None admin] PATH_INFO: `/v3/services` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:01.923950 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c75f52-bd8e-4a79-b2f2-a677d787ecd1 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:01.924311 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c75f52-bd8e-4a79-b2f2-a677d787ecd1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:01.925847 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c75f52-bd8e-4a79-b2f2-a677d787ecd1 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:01.933404 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 414/829] 10.222.0.79 () {56 vars in 1124 bytes} [Wed Aug 31 12:17:01 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:01.935014 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c75f52-bd8e-4a79-b2f2-a677d787ecd1 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:01.950752 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414c0975-571e-43d6-bd2c-96ee2cddea6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:01.951444 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c0975-571e-43d6-bd2c-96ee2cddea6c None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:01.951718 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c0975-571e-43d6-bd2c-96ee2cddea6c None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:01.952055 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c0975-571e-43d6-bd2c-96ee2cddea6c None admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:01.953042 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414c0975-571e-43d6-bd2c-96ee2cddea6c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:01.953396 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414c0975-571e-43d6-bd2c-96ee2cddea6c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:01.955277 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414c0975-571e-43d6-bd2c-96ee2cddea6c None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:01.970379 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 416/830] 10.222.0.79 () {56 vars in 1148 bytes} [Wed Aug 31 12:17:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:01.972019 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931c7f2-b86d-4a5d-b296-5d886e3bc46d None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:01.972373 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931c7f2-b86d-4a5d-b296-5d886e3bc46d None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:01.972651 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931c7f2-b86d-4a5d-b296-5d886e3bc46d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:01.994486 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-e931c7f2-b86d-4a5d-b296-5d886e3bc46d None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:01.996072 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-e931c7f2-b86d-4a5d-b296-5d886e3bc46d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:02.084386 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:02.088880 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c75f52-bd8e-4a79-b2f2-a677d787ecd1 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:02.093173 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 417/831] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:17:01 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:17:02.094667 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e931c7f2-b86d-4a5d-b296-5d886e3bc46d None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:02.137291 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735c4e36-5202-4070-91f8-20e3054c2366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:02.137917 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c4e36-5202-4070-91f8-20e3054c2366 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:02.138971 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c4e36-5202-4070-91f8-20e3054c2366 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:02.139350 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c4e36-5202-4070-91f8-20e3054c2366 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:02.140033 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735c4e36-5202-4070-91f8-20e3054c2366 None admin] RBAC: Adding query filter params (role.id=a332ef951db949b0bad7019fbd28a1b9, scope.project.id=a94f4957f2a047cc844342e1c7c74ca5, user.id=62401c8e1457450590f4147e0665265a) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:02.140338 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735c4e36-5202-4070-91f8-20e3054c2366 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:02.142100 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735c4e36-5202-4070-91f8-20e3054c2366 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:02.163019 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 415/832] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 12:17:01 2022] GET /identity/v3/role_assignments?user.id=62401c8e1457450590f4147e0665265a&scope.project.id=a94f4957f2a047cc844342e1c7c74ca5&role.id=a332ef951db949b0bad7019fbd28a1b9 => generated 608 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:02.163019 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735c4e36-5202-4070-91f8-20e3054c2366 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:02.217078 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:02.328634 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e931c7f2-b86d-4a5d-b296-5d886e3bc46d None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:02.390572 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735c4e36-5202-4070-91f8-20e3054c2366 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:02.399288 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96594f55-5e3d-4eca-8962-404fe63c2e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:02.400455 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96594f55-5e3d-4eca-8962-404fe63c2e3e None admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:02.401028 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96594f55-5e3d-4eca-8962-404fe63c2e3e None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:02.401595 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96594f55-5e3d-4eca-8962-404fe63c2e3e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:02.402931 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96594f55-5e3d-4eca-8962-404fe63c2e3e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:02.405511 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96594f55-5e3d-4eca-8962-404fe63c2e3e None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:02.439086 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 418/833] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:17:02 2022] POST /identity/v3/endpoints => generated 346 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:17:02.469139 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96594f55-5e3d-4eca-8962-404fe63c2e3e None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:02.487551 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3347232e-089f-4b4f-9c19-c1d69d0dbb74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:02.488575 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347232e-089f-4b4f-9c19-c1d69d0dbb74 None admin] REQUEST_METHOD: `PUT` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:02.489357 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347232e-089f-4b4f-9c19-c1d69d0dbb74 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:02.489357 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347232e-089f-4b4f-9c19-c1d69d0dbb74 None admin] PATH_INFO: `/v3/projects/a94f4957f2a047cc844342e1c7c74ca5/users/149aa48acd504354a1d021885ca51334/roles/37fee7a104964826a0762987a1531a9a` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:02.518589 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3347232e-089f-4b4f-9c19-c1d69d0dbb74 None admin] RBAC: Authorizing `identity:create_grant(project_id=a94f4957f2a047cc844342e1c7c74ca5, user_id=149aa48acd504354a1d021885ca51334, role_id=37fee7a104964826a0762987a1531a9a)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:02.519892 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3347232e-089f-4b4f-9c19-c1d69d0dbb74 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:02.539284 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 416/834] 10.222.0.79 () {58 vars in 1439 bytes} [Wed Aug 31 12:17:02 2022] PUT /identity/v3/projects/a94f4957f2a047cc844342e1c7c74ca5/users/149aa48acd504354a1d021885ca51334/roles/37fee7a104964826a0762987a1531a9a => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:02.579874 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:02.655082 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96594f55-5e3d-4eca-8962-404fe63c2e3e None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:02.702917 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bdfc52-579e-4206-ad98-619b92af3063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:02.704597 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bdfc52-579e-4206-ad98-619b92af3063 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:02.705206 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bdfc52-579e-4206-ad98-619b92af3063 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:02.705800 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bdfc52-579e-4206-ad98-619b92af3063 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:02.721294 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bdfc52-579e-4206-ad98-619b92af3063 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:17:02.728764 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-f9bdfc52-579e-4206-ad98-619b92af3063 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:17:02.728764 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:02.728764 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:17:02.728764 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:17:02.728764 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:17:02.728764 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:17:02.728764 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:17:02.728764 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:17:02.728764 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:17:02.728764 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:17:02.728764 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:17:02.728764 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:17:02.728764 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:17:02.728764 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:17:02.728764 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:17:02.728764 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:17:02.729980 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:17:02.729980 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:17:02.729980 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:17:02.729980 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:17:02.729980 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:17:02.729980 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:17:02.729980 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:17:02.729980 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:17:02.729980 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:17:02.729980 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:17:02.729980 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:17:02.729980 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:17:02.729980 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:17:02.729980 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:17:02.729980 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:17:02.729980 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:17:02.731025 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:17:02.731025 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:17:02.731025 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:17:02.731025 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:17:02.731025 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:17:02.731025 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:17:02.731025 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:17:02.731025 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:17:02.731025 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:17:02.731025 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:17:02.731025 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:17:02.731025 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:17:02.738495 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 419/835] 10.222.0.79 () {56 vars in 1096 bytes} [Wed Aug 31 12:17:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:17:02.740790 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3347232e-089f-4b4f-9c19-c1d69d0dbb74 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:02.885012 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:02.929823 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3347232e-089f-4b4f-9c19-c1d69d0dbb74 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:02.989810 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209f2a3b-aa3c-4568-b260-bc7dce0f02dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:02.990722 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f2a3b-aa3c-4568-b260-bc7dce0f02dc None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:02.991266 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f2a3b-aa3c-4568-b260-bc7dce0f02dc None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:02.991740 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f2a3b-aa3c-4568-b260-bc7dce0f02dc None admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:02.992878 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209f2a3b-aa3c-4568-b260-bc7dce0f02dc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:02.993410 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209f2a3b-aa3c-4568-b260-bc7dce0f02dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:02.996019 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209f2a3b-aa3c-4568-b260-bc7dce0f02dc None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:03.012842 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 417/836] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 12:17:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:03.019340 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bdfc52-579e-4206-ad98-619b92af3063 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:03.140530 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bdfc52-579e-4206-ad98-619b92af3063 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:03.169129 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:03.183614 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf69101-cb79-40de-a1fa-c3a7ee39fb3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:03.184253 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf69101-cb79-40de-a1fa-c3a7ee39fb3b None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:03.184530 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf69101-cb79-40de-a1fa-c3a7ee39fb3b None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:03.184797 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf69101-cb79-40de-a1fa-c3a7ee39fb3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:03.196983 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf69101-cb79-40de-a1fa-c3a7ee39fb3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:03.198905 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf69101-cb79-40de-a1fa-c3a7ee39fb3b None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:03.223074 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-6bf69101-cb79-40de-a1fa-c3a7ee39fb3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:17:03.223074 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:03.223074 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:17:03.223074 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:17:03.223074 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:17:03.223074 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:17:03.223074 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:17:03.223074 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:17:03.223074 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:17:03.223074 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:17:03.223074 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:17:03.223074 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:17:03.223074 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:17:03.223074 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:17:03.223074 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:17:03.223074 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:17:03.224629 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:17:03.224629 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:17:03.224629 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:17:03.224629 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:17:03.224629 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:17:03.224629 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:17:03.224629 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:17:03.224629 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:17:03.224629 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:17:03.224629 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:17:03.224629 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:17:03.224629 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:17:03.224629 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:17:03.224629 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:17:03.224629 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:17:03.224629 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:17:03.224629 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:17:03.226112 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:17:03.226112 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:17:03.226112 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:17:03.230095 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 420/837] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:17:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:17:03.232236 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209f2a3b-aa3c-4568-b260-bc7dce0f02dc None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:03.422684 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209f2a3b-aa3c-4568-b260-bc7dce0f02dc None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:03.488321 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9251a1-f01e-4ed1-824c-2a2148d309eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:03.489340 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9251a1-f01e-4ed1-824c-2a2148d309eb None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:03.489818 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9251a1-f01e-4ed1-824c-2a2148d309eb None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:03.490294 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9251a1-f01e-4ed1-824c-2a2148d309eb None admin] PATH_INFO: `/v3/domains` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:03.492039 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9251a1-f01e-4ed1-824c-2a2148d309eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:03.492580 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9251a1-f01e-4ed1-824c-2a2148d309eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:03.495143 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9251a1-f01e-4ed1-824c-2a2148d309eb None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:03.499766 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:03.522564 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 418/838] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 12:17:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:17:03.534924 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf69101-cb79-40de-a1fa-c3a7ee39fb3b None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:03.655684 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf69101-cb79-40de-a1fa-c3a7ee39fb3b None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:03.695526 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631edd67-cf03-4fe0-8262-64a4a12bc999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:03.696174 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631edd67-cf03-4fe0-8262-64a4a12bc999 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:03.696432 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631edd67-cf03-4fe0-8262-64a4a12bc999 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:03.696730 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631edd67-cf03-4fe0-8262-64a4a12bc999 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:03.705258 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631edd67-cf03-4fe0-8262-64a4a12bc999 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:03.706717 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631edd67-cf03-4fe0-8262-64a4a12bc999 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:03.720347 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-631edd67-cf03-4fe0-8262-64a4a12bc999 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 12:17:03.720347 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:03.720347 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:17:03.720347 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:17:03.720347 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:17:03.720347 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:17:03.720347 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:17:03.720347 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:17:03.720347 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:17:03.720347 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:17:03.720347 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:17:03.720347 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:17:03.720347 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:17:03.720347 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:17:03.720347 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:17:03.720347 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:17:03.722258 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:17:03.722258 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:17:03.722258 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:17:03.722258 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:17:03.722258 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:17:03.722258 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:17:03.722258 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:17:03.722258 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:17:03.722258 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:17:03.722258 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:17:03.722258 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:17:03.722258 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:17:03.722258 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:17:03.722258 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:17:03.722258 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:17:03.722258 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:17:03.722258 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:17:03.722258 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:17:03.724184 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:17:03.724184 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:17:03.724184 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:17:03.724184 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:17:03.724184 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:17:03.724184 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:17:03.724184 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:17:03.724184 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:17:03.724184 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 12:17:03.724184 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:17:03.726896 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 421/839] 10.222.0.79 () {56 vars in 1096 bytes} [Wed Aug 31 12:17:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:17:03.728965 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9251a1-f01e-4ed1-824c-2a2148d309eb None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:03.910404 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9251a1-f01e-4ed1-824c-2a2148d309eb None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:03.974276 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491236bd-14e1-4c51-a773-3f063ae643cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:03.975706 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491236bd-14e1-4c51-a773-3f063ae643cf None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:03.976894 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491236bd-14e1-4c51-a773-3f063ae643cf None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:03.977607 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491236bd-14e1-4c51-a773-3f063ae643cf None admin] PATH_INFO: `/v3/users` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:03.979180 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491236bd-14e1-4c51-a773-3f063ae643cf None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:03.979918 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491236bd-14e1-4c51-a773-3f063ae643cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:03.982805 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491236bd-14e1-4c51-a773-3f063ae643cf None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:04.016557 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 419/840] 10.222.0.79 () {56 vars in 1135 bytes} [Wed Aug 31 12:17:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:04.024002 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631edd67-cf03-4fe0-8262-64a4a12bc999 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:04.067433 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:04.156204 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631edd67-cf03-4fe0-8262-64a4a12bc999 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:04.200368 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e6efb5-b151-4d07-b8e9-fef105287ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:04.201002 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e6efb5-b151-4d07-b8e9-fef105287ff2 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:04.201269 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e6efb5-b151-4d07-b8e9-fef105287ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:04.201530 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e6efb5-b151-4d07-b8e9-fef105287ff2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:04.289164 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e6efb5-b151-4d07-b8e9-fef105287ff2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:04.291134 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e6efb5-b151-4d07-b8e9-fef105287ff2 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:04.327405 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:04.464757 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 422/841] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 12:17:04 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 12:17:04.469461 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491236bd-14e1-4c51-a773-3f063ae643cf None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:04.584524 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:04.672979 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491236bd-14e1-4c51-a773-3f063ae643cf None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:04.741955 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4267b6c0-4a4a-44dd-b543-8ef0b78c7fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:04.743091 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4267b6c0-4a4a-44dd-b543-8ef0b78c7fa3 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:04.743594 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4267b6c0-4a4a-44dd-b543-8ef0b78c7fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:04.744085 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4267b6c0-4a4a-44dd-b543-8ef0b78c7fa3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:04.764111 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4267b6c0-4a4a-44dd-b543-8ef0b78c7fa3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:04.766834 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4267b6c0-4a4a-44dd-b543-8ef0b78c7fa3 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:04.800340 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-4267b6c0-4a4a-44dd-b543-8ef0b78c7fa3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:17:04.800340 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:04.800340 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:17:04.800340 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:17:04.800340 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:17:04.800340 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:17:04.800340 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:17:04.800340 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:17:04.800340 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:17:04.800340 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:17:04.800340 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:17:04.800340 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:17:04.800340 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:17:04.800340 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:17:04.800340 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:17:04.800340 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:17:04.801828 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:17:04.801828 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:17:04.801828 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:17:04.801828 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:17:04.801828 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:17:04.801828 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:17:04.801828 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:17:04.801828 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:17:04.801828 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:17:04.801828 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:17:04.801828 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:17:04.801828 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:17:04.801828 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:17:04.801828 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:17:04.801828 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:17:04.801828 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:17:04.801828 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:17:04.803386 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:17:04.803386 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:17:04.803386 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:17:04.803386 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 420/842] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:17:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:17:04.810903 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e6efb5-b151-4d07-b8e9-fef105287ff2 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:04.971304 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e6efb5-b151-4d07-b8e9-fef105287ff2 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:05.003898 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:05.015889 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b96374-b482-493c-8dae-d0b36a5b8314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:05.016701 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b96374-b482-493c-8dae-d0b36a5b8314 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:05.017108 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b96374-b482-493c-8dae-d0b36a5b8314 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:05.017392 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b96374-b482-493c-8dae-d0b36a5b8314 None admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:05.018307 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b96374-b482-493c-8dae-d0b36a5b8314 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:05.018739 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b96374-b482-493c-8dae-d0b36a5b8314 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:05.020652 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b96374-b482-493c-8dae-d0b36a5b8314 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:05.036873 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 423/843] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 12:17:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:17:05.046371 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4267b6c0-4a4a-44dd-b543-8ef0b78c7fa3 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:05.199209 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd428e-92ae-4bc6-a822-6d741a7756da None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:05.199867 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd428e-92ae-4bc6-a822-6d741a7756da None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:05.200350 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd428e-92ae-4bc6-a822-6d741a7756da None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:05.202268 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 424/844] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:17:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:17:05.208335 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab69f15-3a0d-4784-8f1e-e24d0abbef33 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:05.208961 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab69f15-3a0d-4784-8f1e-e24d0abbef33 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:05.209477 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab69f15-3a0d-4784-8f1e-e24d0abbef33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:05.234382 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-3ab69f15-3a0d-4784-8f1e-e24d0abbef33 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:05.236394 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-3ab69f15-3a0d-4784-8f1e-e24d0abbef33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:05.242998 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4267b6c0-4a4a-44dd-b543-8ef0b78c7fa3 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:05.256135 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:05.312698 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae69d5a-365f-4507-b782-d2194ed483d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:05.313732 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae69d5a-365f-4507-b782-d2194ed483d1 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:05.314202 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae69d5a-365f-4507-b782-d2194ed483d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:05.314660 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae69d5a-365f-4507-b782-d2194ed483d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:05.334520 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae69d5a-365f-4507-b782-d2194ed483d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:05.338306 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae69d5a-365f-4507-b782-d2194ed483d1 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:05.357692 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-eae69d5a-365f-4507-b782-d2194ed483d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:17:05.357692 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:05.357692 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:17:05.357692 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:17:05.357692 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:17:05.357692 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:17:05.357692 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:17:05.357692 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:17:05.357692 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:17:05.357692 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:17:05.357692 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:17:05.357692 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:17:05.357692 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:17:05.357692 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:17:05.357692 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:17:05.359796 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:17:05.359796 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:17:05.359796 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:17:05.359796 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:17:05.359796 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:17:05.359796 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:17:05.359796 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:17:05.359796 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:17:05.359796 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:17:05.359796 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:17:05.359796 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:17:05.359796 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:17:05.359796 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:17:05.359796 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:17:05.359796 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:17:05.359796 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:17:05.359796 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:17:05.363839 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:17:05.363839 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:17:05.363839 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:17:05.363839 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:17:05.363839 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:17:05.363839 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:17:05.363839 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:17:05.363839 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:17:05.363839 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 421/845] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 12:17:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:17:05.363839 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a981da06-9505-4275-84a0-87e109e33d02 None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:05.363839 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a981da06-9505-4275-84a0-87e109e33d02 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:05.366019 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a981da06-9505-4275-84a0-87e109e33d02 None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:05.371275 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 422/846] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:17:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:17:05.371527 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a981da06-9505-4275-84a0-87e109e33d02 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:05.399649 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 425/847] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:17:05 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 12:17:05.399649 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e10c756-e427-4698-9257-e9f70d8bebe9 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:05.399649 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e10c756-e427-4698-9257-e9f70d8bebe9 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:05.399649 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e10c756-e427-4698-9257-e9f70d8bebe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:05.430661 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-7e10c756-e427-4698-9257-e9f70d8bebe9 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:05.432971 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-7e10c756-e427-4698-9257-e9f70d8bebe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:05.550149 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a981da06-9505-4275-84a0-87e109e33d02 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:05.573538 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 426/848] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:17:05 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:17:05.634402 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496a7a43-4b20-43db-b378-60bdaf0e337e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:05.635644 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496a7a43-4b20-43db-b378-60bdaf0e337e None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:05.636120 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496a7a43-4b20-43db-b378-60bdaf0e337e None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:05.636594 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496a7a43-4b20-43db-b378-60bdaf0e337e None admin] PATH_INFO: `/v3/projects` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:05.637843 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496a7a43-4b20-43db-b378-60bdaf0e337e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:05.638398 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496a7a43-4b20-43db-b378-60bdaf0e337e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:05.641145 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496a7a43-4b20-43db-b378-60bdaf0e337e None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:05.665939 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 423/849] 10.222.0.79 () {56 vars in 1148 bytes} [Wed Aug 31 12:17:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:17:05.675758 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e10c756-e427-4698-9257-e9f70d8bebe9 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:05.773905 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:05.850190 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496a7a43-4b20-43db-b378-60bdaf0e337e None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:05.869915 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e10c756-e427-4698-9257-e9f70d8bebe9 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:05.903328 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:05.914219 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280a44a8-cd65-497d-adf7-7086bef8cb7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:05.915047 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a44a8-cd65-497d-adf7-7086bef8cb7e None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:05.915473 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a44a8-cd65-497d-adf7-7086bef8cb7e None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:05.915871 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a44a8-cd65-497d-adf7-7086bef8cb7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:05.916753 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280a44a8-cd65-497d-adf7-7086bef8cb7e None admin] RBAC: Adding query filter params (role.id=a332ef951db949b0bad7019fbd28a1b9, scope.project.id=a94f4957f2a047cc844342e1c7c74ca5, user.id=4896540cc14f40b08d05ade32cfd0f37) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:05.917184 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280a44a8-cd65-497d-adf7-7086bef8cb7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:05.918793 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280a44a8-cd65-497d-adf7-7086bef8cb7e None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:05.933461 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 427/850] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 12:17:05 2022] GET /identity/v3/role_assignments?user.id=4896540cc14f40b08d05ade32cfd0f37&scope.project.id=a94f4957f2a047cc844342e1c7c74ca5&role.id=a332ef951db949b0bad7019fbd28a1b9 => generated 608 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:05.933461 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b5518-7912-4e6f-be64-0a2c54ced112 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:05.933461 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b5518-7912-4e6f-be64-0a2c54ced112 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:05.933461 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b5518-7912-4e6f-be64-0a2c54ced112 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:05.933461 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 428/851] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:17:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:17:05.935969 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189b5518-7912-4e6f-be64-0a2c54ced112 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:06.044533 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496a7a43-4b20-43db-b378-60bdaf0e337e None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:06.086144 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189b5518-7912-4e6f-be64-0a2c54ced112 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:06.105327 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:06.109626 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee5c279-f59f-4d66-954c-4bab61ce8880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:06.111226 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5c279-f59f-4d66-954c-4bab61ce8880 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:06.111656 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5c279-f59f-4d66-954c-4bab61ce8880 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:06.112251 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5c279-f59f-4d66-954c-4bab61ce8880 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:06.113690 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee5c279-f59f-4d66-954c-4bab61ce8880 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:06.116736 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee5c279-f59f-4d66-954c-4bab61ce8880 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:06.131507 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-4ee5c279-f59f-4d66-954c-4bab61ce8880 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 12:17:06.131507 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:06.131507 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 12:17:06.131507 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 12:17:06.131507 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 12:17:06.131507 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 12:17:06.131507 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 12:17:06.131507 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:17:06.131507 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 12:17:06.131507 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:17:06.131507 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:17:06.131507 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:17:06.131507 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:06.131507 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:17:06.131507 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:17:06.131507 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:17:06.131507 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:17:06.133500 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:17:06.133500 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:17:06.133500 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:17:06.133500 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:17:06.133500 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:17:06.133500 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:17:06.133500 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 12:17:06.133500 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 12:17:06.133500 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 12:17:06.133500 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 12:17:06.133500 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:17:06.133500 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:17:06.133500 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:17:06.133500 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:17:06.133500 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:17:06.133500 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:17:06.137756 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:17:06.137756 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:17:06.137756 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:17:06.137756 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:17:06.137756 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:17:06.137756 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:17:06.137756 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:17:06.137756 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:17:06.137756 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:17:06.137756 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:17:06.137756 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 12:17:06.137756 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:17:06.137756 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 12:17:06.137756 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:17:06.137756 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 424/852] 10.222.0.79 () {56 vars in 1114 bytes} [Wed Aug 31 12:17:05 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:17:06.139583 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a45f6-ca03-4d15-8c59-331dfd13b379 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:06.139583 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a45f6-ca03-4d15-8c59-331dfd13b379 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:06.140262 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a45f6-ca03-4d15-8c59-331dfd13b379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:06.144905 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71847c45-94ce-4883-a021-129ef188d387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:06.145541 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71847c45-94ce-4883-a021-129ef188d387 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:06.146577 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71847c45-94ce-4883-a021-129ef188d387 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:06.146577 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71847c45-94ce-4883-a021-129ef188d387 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:06.148266 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71847c45-94ce-4883-a021-129ef188d387 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:06.150626 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71847c45-94ce-4883-a021-129ef188d387 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:06.166810 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-253a45f6-ca03-4d15-8c59-331dfd13b379 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:06.168075 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-253a45f6-ca03-4d15-8c59-331dfd13b379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:06.168708 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-71847c45-94ce-4883-a021-129ef188d387 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 12:17:06.168708 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:06.168708 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 12:17:06.168708 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 12:17:06.168708 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 12:17:06.168708 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 12:17:06.168708 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 12:17:06.168708 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:17:06.168708 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 12:17:06.168708 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:17:06.168708 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:17:06.168708 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:17:06.168708 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:06.168708 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:17:06.168708 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:17:06.168708 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:17:06.170664 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:17:06.170664 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:17:06.170664 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:17:06.170664 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:17:06.170664 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:17:06.170664 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:17:06.170664 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:17:06.170664 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 12:17:06.170664 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 12:17:06.170664 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 12:17:06.170664 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 12:17:06.170664 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:17:06.170664 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:17:06.170664 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:17:06.170664 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:17:06.170664 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:17:06.170664 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:17:06.172739 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:17:06.172739 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:17:06.172739 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:17:06.172739 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:17:06.172739 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:17:06.172739 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:17:06.172739 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:17:06.172739 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:17:06.172739 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:17:06.172739 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:17:06.172739 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 12:17:06.172739 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:17:06.172739 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 12:17:06.172739 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:17:06.172739 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 429/853] 10.222.0.79 () {56 vars in 1132 bytes} [Wed Aug 31 12:17:05 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:17:06.174549 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71847c45-94ce-4883-a021-129ef188d387 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:06.297413 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 425/854] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:17:06 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:17:06.299406 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253a45f6-ca03-4d15-8c59-331dfd13b379 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:06.345052 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:06.356926 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71847c45-94ce-4883-a021-129ef188d387 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:06.423775 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7968b688-5279-4447-942a-5679ea79e64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:06.425216 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7968b688-5279-4447-942a-5679ea79e64f None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:06.425936 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7968b688-5279-4447-942a-5679ea79e64f None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:06.426610 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7968b688-5279-4447-942a-5679ea79e64f None admin] PATH_INFO: `/v3/services` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:06.428065 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7968b688-5279-4447-942a-5679ea79e64f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:06.428897 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7968b688-5279-4447-942a-5679ea79e64f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:06.431861 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7968b688-5279-4447-942a-5679ea79e64f None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:06.447052 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 430/855] 10.222.0.79 () {56 vars in 1114 bytes} [Wed Aug 31 12:17:06 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:06.450797 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7968b688-5279-4447-942a-5679ea79e64f None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:06.470065 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253a45f6-ca03-4d15-8c59-331dfd13b379 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:06.509467 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:06.528661 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f52527-d566-4663-8864-9391be826901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:06.529576 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f52527-d566-4663-8864-9391be826901 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:06.530009 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f52527-d566-4663-8864-9391be826901 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:06.530427 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f52527-d566-4663-8864-9391be826901 None admin] PATH_INFO: `/v3/services` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:06.531596 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f52527-d566-4663-8864-9391be826901 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:06.532623 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f52527-d566-4663-8864-9391be826901 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:06.534524 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f52527-d566-4663-8864-9391be826901 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:06.543027 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 426/856] 10.222.0.79 () {56 vars in 1126 bytes} [Wed Aug 31 12:17:06 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:06.549685 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f52527-d566-4663-8864-9391be826901 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:06.596625 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7968b688-5279-4447-942a-5679ea79e64f None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:06.639930 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3da1052-eebb-4410-ba96-d7785dd3acf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:06.640479 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da1052-eebb-4410-ba96-d7785dd3acf2 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:06.640816 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da1052-eebb-4410-ba96-d7785dd3acf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:06.641224 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da1052-eebb-4410-ba96-d7785dd3acf2 None admin] PATH_INFO: `/v3/services` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:06.641997 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3da1052-eebb-4410-ba96-d7785dd3acf2 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:06.642325 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3da1052-eebb-4410-ba96-d7785dd3acf2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:06.644162 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3da1052-eebb-4410-ba96-d7785dd3acf2 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:06.650314 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 431/857] 10.222.0.79 () {56 vars in 1114 bytes} [Wed Aug 31 12:17:06 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:17:06.651637 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3da1052-eebb-4410-ba96-d7785dd3acf2 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:06.666220 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:06.688817 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f52527-d566-4663-8864-9391be826901 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:06.747334 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1712f513-67ae-40e3-b927-24708377144b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:06.748933 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1712f513-67ae-40e3-b927-24708377144b None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:06.750141 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1712f513-67ae-40e3-b927-24708377144b None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:06.750745 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1712f513-67ae-40e3-b927-24708377144b None admin] PATH_INFO: `/v3/services` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:06.752707 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1712f513-67ae-40e3-b927-24708377144b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:06.753317 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1712f513-67ae-40e3-b927-24708377144b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:06.756196 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1712f513-67ae-40e3-b927-24708377144b None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:06.771159 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 427/858] 10.222.0.79 () {56 vars in 1126 bytes} [Wed Aug 31 12:17:06 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:17:06.818909 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3da1052-eebb-4410-ba96-d7785dd3acf2 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:06.821060 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:06.894187 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41b39dd-a89d-4606-98c8-a31a047e4173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:06.895422 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b39dd-a89d-4606-98c8-a31a047e4173 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:06.896044 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b39dd-a89d-4606-98c8-a31a047e4173 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:06.896652 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b39dd-a89d-4606-98c8-a31a047e4173 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:06.917774 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41b39dd-a89d-4606-98c8-a31a047e4173 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:17:06.928053 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-e41b39dd-a89d-4606-98c8-a31a047e4173 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:17:06.928053 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:06.928053 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:17:06.928053 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:17:06.928053 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:17:06.928053 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:17:06.928053 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:17:06.928053 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:17:06.928053 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:17:06.928053 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:17:06.928053 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:17:06.928053 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:17:06.928053 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:17:06.928053 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:17:06.928053 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:17:06.928053 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:17:06.931391 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:17:06.931391 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:17:06.931391 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:17:06.931391 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:17:06.931391 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:17:06.931391 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:17:06.931391 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:17:06.931391 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:17:06.931391 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:17:06.931391 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:17:06.931391 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:17:06.931391 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:17:06.931391 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:17:06.931391 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:17:06.931391 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:17:06.931391 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:17:06.933359 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:17:06.933359 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:17:06.933359 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:17:06.933359 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:17:06.933359 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:17:06.933359 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:17:06.933359 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:17:06.933359 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:17:06.933359 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:17:06.933359 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:17:06.933359 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:17:06.933359 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:17:06.939697 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 432/859] 10.222.0.79 () {56 vars in 1102 bytes} [Wed Aug 31 12:17:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:17:06.948237 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1712f513-67ae-40e3-b927-24708377144b None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:07.111470 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1712f513-67ae-40e3-b927-24708377144b None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:07.156472 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c0e736-dd30-4fc3-8113-7ebccce7e6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:07.157026 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c0e736-dd30-4fc3-8113-7ebccce7e6bc None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:07.157306 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c0e736-dd30-4fc3-8113-7ebccce7e6bc None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:07.157575 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c0e736-dd30-4fc3-8113-7ebccce7e6bc None admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:07.158261 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c0e736-dd30-4fc3-8113-7ebccce7e6bc None admin] RBAC: Adding query filter params (name=service) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:07.158564 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c0e736-dd30-4fc3-8113-7ebccce7e6bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:07.159991 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c0e736-dd30-4fc3-8113-7ebccce7e6bc None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:07.170162 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 428/860] 10.222.0.79 () {56 vars in 1103 bytes} [Wed Aug 31 12:17:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:07.176229 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41b39dd-a89d-4606-98c8-a31a047e4173 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:07.293563 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41b39dd-a89d-4606-98c8-a31a047e4173 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:07.332792 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ba5c6f-df3e-4111-9542-8f3b70b0c847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:07.333446 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba5c6f-df3e-4111-9542-8f3b70b0c847 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:07.333724 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba5c6f-df3e-4111-9542-8f3b70b0c847 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:07.333990 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba5c6f-df3e-4111-9542-8f3b70b0c847 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:07.347284 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ba5c6f-df3e-4111-9542-8f3b70b0c847 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:07.348745 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ba5c6f-df3e-4111-9542-8f3b70b0c847 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:07.365432 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-62ba5c6f-df3e-4111-9542-8f3b70b0c847 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:17:07.365432 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:07.365432 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:17:07.365432 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:17:07.365432 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:17:07.365432 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:17:07.365432 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:17:07.365432 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:17:07.365432 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:17:07.365432 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:17:07.365432 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:17:07.365432 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:17:07.365432 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:17:07.365432 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:17:07.365432 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:17:07.365432 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:17:07.366770 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:17:07.366770 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:17:07.366770 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:17:07.366770 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:17:07.366770 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:17:07.366770 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:17:07.366770 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:17:07.366770 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:17:07.366770 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:17:07.366770 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:17:07.366770 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:17:07.366770 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:17:07.366770 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:17:07.366770 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:17:07.366770 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:17:07.366770 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:17:07.366770 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:17:07.367793 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:17:07.367793 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:17:07.367793 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:17:07.367793 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 433/861] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:17:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:17:07.374299 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c0e736-dd30-4fc3-8113-7ebccce7e6bc None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:07.407495 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:07.491005 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c0e736-dd30-4fc3-8113-7ebccce7e6bc None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:07.534003 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb47f1ea-bf78-4828-9f85-246249522ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:07.534626 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb47f1ea-bf78-4828-9f85-246249522ca0 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:07.534931 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb47f1ea-bf78-4828-9f85-246249522ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:07.535204 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb47f1ea-bf78-4828-9f85-246249522ca0 None admin] PATH_INFO: `/v3/domains` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:07.535861 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb47f1ea-bf78-4828-9f85-246249522ca0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:07.536163 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb47f1ea-bf78-4828-9f85-246249522ca0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:07.537787 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb47f1ea-bf78-4828-9f85-246249522ca0 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:07.552492 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 429/862] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 12:17:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:07.558616 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ba5c6f-df3e-4111-9542-8f3b70b0c847 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:07.577550 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:07.683400 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ba5c6f-df3e-4111-9542-8f3b70b0c847 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:07.723695 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887e46f0-b934-4c9c-a14c-7e55189905b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:07.724342 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e46f0-b934-4c9c-a14c-7e55189905b9 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:07.724617 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e46f0-b934-4c9c-a14c-7e55189905b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:07.724883 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e46f0-b934-4c9c-a14c-7e55189905b9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:07.734148 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887e46f0-b934-4c9c-a14c-7e55189905b9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:07.735638 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887e46f0-b934-4c9c-a14c-7e55189905b9 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:07.748865 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-887e46f0-b934-4c9c-a14c-7e55189905b9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 12:17:07.748865 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:07.748865 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:17:07.748865 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:17:07.748865 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:17:07.748865 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:17:07.748865 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:17:07.748865 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:17:07.748865 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:17:07.748865 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:17:07.748865 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:17:07.748865 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:17:07.748865 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:17:07.748865 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:17:07.748865 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:17:07.748865 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:17:07.749902 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:17:07.749902 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:17:07.749902 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:17:07.749902 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:17:07.749902 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:17:07.749902 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:17:07.749902 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:17:07.749902 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:17:07.749902 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:17:07.749902 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:17:07.749902 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:17:07.749902 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:17:07.749902 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:17:07.749902 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:17:07.749902 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:17:07.749902 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:17:07.749902 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:17:07.749902 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:17:07.750915 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:17:07.750915 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:17:07.750915 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:17:07.750915 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:17:07.750915 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:17:07.750915 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:17:07.750915 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:17:07.750915 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:17:07.750915 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 12:17:07.750915 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:17:07.750915 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 434/863] 10.222.0.79 () {56 vars in 1117 bytes} [Wed Aug 31 12:17:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:17:07.760011 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb47f1ea-bf78-4828-9f85-246249522ca0 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:07.876395 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:07.909905 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb47f1ea-bf78-4828-9f85-246249522ca0 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:07.946446 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9433f513-b8fe-4e26-84ea-f733d608044b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:07.947072 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9433f513-b8fe-4e26-84ea-f733d608044b None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:07.947353 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9433f513-b8fe-4e26-84ea-f733d608044b None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:07.947622 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9433f513-b8fe-4e26-84ea-f733d608044b None admin] PATH_INFO: `/v3/users` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:07.948365 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9433f513-b8fe-4e26-84ea-f733d608044b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:07.948669 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9433f513-b8fe-4e26-84ea-f733d608044b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:07.950285 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9433f513-b8fe-4e26-84ea-f733d608044b None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:07.970750 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 430/864] 10.222.0.79 () {56 vars in 1149 bytes} [Wed Aug 31 12:17:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:07.976757 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887e46f0-b934-4c9c-a14c-7e55189905b9 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:08.071606 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:08.102515 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887e46f0-b934-4c9c-a14c-7e55189905b9 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:08.103185 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15934c59-3196-40cd-93c5-defbde4229dd None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:08.103576 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15934c59-3196-40cd-93c5-defbde4229dd None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:08.103954 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15934c59-3196-40cd-93c5-defbde4229dd None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:08.105716 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 431/865] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:17:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:17:08.111237 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a957036b-fd00-4a38-b806-c402ff87e6ca None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:08.111632 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a957036b-fd00-4a38-b806-c402ff87e6ca None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:08.112178 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a957036b-fd00-4a38-b806-c402ff87e6ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:08.135160 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-a957036b-fd00-4a38-b806-c402ff87e6ca None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:08.137041 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-a957036b-fd00-4a38-b806-c402ff87e6ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:08.143963 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78767973-ccb5-4424-a508-dce15e8621a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:08.144582 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78767973-ccb5-4424-a508-dce15e8621a2 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:08.144857 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78767973-ccb5-4424-a508-dce15e8621a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:08.145124 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78767973-ccb5-4424-a508-dce15e8621a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:08.233495 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 432/866] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:17:08 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:17:08.253930 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78767973-ccb5-4424-a508-dce15e8621a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:08.255423 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78767973-ccb5-4424-a508-dce15e8621a2 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:08.342365 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:08.373749 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 435/867] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 12:17:07 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 12:17:08.380014 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a957036b-fd00-4a38-b806-c402ff87e6ca None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:08.451223 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:08.503091 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a957036b-fd00-4a38-b806-c402ff87e6ca None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:08.543421 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78767973-ccb5-4424-a508-dce15e8621a2 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:08.550942 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb40194-07f6-43e4-b27b-a2de2ffea8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:08.551635 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb40194-07f6-43e4-b27b-a2de2ffea8b4 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:08.551912 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb40194-07f6-43e4-b27b-a2de2ffea8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:08.552181 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb40194-07f6-43e4-b27b-a2de2ffea8b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:08.571152 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb40194-07f6-43e4-b27b-a2de2ffea8b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:08.573577 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb40194-07f6-43e4-b27b-a2de2ffea8b4 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:08.598123 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-eeb40194-07f6-43e4-b27b-a2de2ffea8b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:17:08.598123 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:08.598123 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:17:08.598123 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:17:08.598123 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:17:08.598123 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:17:08.598123 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:17:08.598123 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:17:08.598123 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:17:08.598123 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:17:08.598123 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:17:08.598123 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:17:08.598123 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:17:08.598123 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:17:08.598123 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:17:08.598123 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:17:08.599187 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:17:08.599187 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:17:08.599187 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:17:08.599187 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:17:08.599187 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:17:08.599187 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:17:08.599187 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:17:08.599187 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:17:08.599187 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:17:08.599187 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:17:08.599187 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:17:08.599187 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:17:08.599187 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:17:08.599187 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:17:08.599187 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:17:08.599187 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:17:08.599187 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:17:08.600150 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:17:08.600150 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:17:08.600150 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:17:08.601517 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 433/868] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:17:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:17:08.607577 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb40194-07f6-43e4-b27b-a2de2ffea8b4 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:08.673303 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78767973-ccb5-4424-a508-dce15e8621a2 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:08.717190 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35298240-b580-4baa-ba83-36b5b5bf7c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:08.717861 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35298240-b580-4baa-ba83-36b5b5bf7c80 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:08.718145 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35298240-b580-4baa-ba83-36b5b5bf7c80 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:08.718421 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35298240-b580-4baa-ba83-36b5b5bf7c80 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:08.719081 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35298240-b580-4baa-ba83-36b5b5bf7c80 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:08.721083 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35298240-b580-4baa-ba83-36b5b5bf7c80 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:08.731956 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-35298240-b580-4baa-ba83-36b5b5bf7c80 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 12:17:08.731956 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:08.731956 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 12:17:08.731956 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 12:17:08.731956 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 12:17:08.731956 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 12:17:08.731956 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 12:17:08.731956 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:17:08.731956 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 12:17:08.731956 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:17:08.731956 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:17:08.731956 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:17:08.731956 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:08.731956 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:17:08.731956 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:17:08.731956 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:17:08.731956 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:17:08.733280 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:17:08.733280 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:17:08.733280 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:17:08.733280 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:17:08.733280 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:17:08.733280 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:17:08.733280 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 12:17:08.733280 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 12:17:08.733280 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 12:17:08.733280 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 12:17:08.733280 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:17:08.733280 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:17:08.733280 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:17:08.733280 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:17:08.733280 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:17:08.733280 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:17:08.734215 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:17:08.734215 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:17:08.734215 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:17:08.734215 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:17:08.734215 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:17:08.734215 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:17:08.734215 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:17:08.734215 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:17:08.734215 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:17:08.734215 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:17:08.734215 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 12:17:08.734215 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:17:08.734215 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 12:17:08.734215 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:17:08.739943 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 436/869] 10.222.0.79 () {56 vars in 1126 bytes} [Wed Aug 31 12:17:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:17:08.740898 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb40194-07f6-43e4-b27b-a2de2ffea8b4 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:08.741083 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35298240-b580-4baa-ba83-36b5b5bf7c80 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:08.755600 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:08.785079 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf36a78-820f-4bd1-a20d-d7f0187edcf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:08.786144 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf36a78-820f-4bd1-a20d-d7f0187edcf6 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:08.786611 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf36a78-820f-4bd1-a20d-d7f0187edcf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:08.787188 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf36a78-820f-4bd1-a20d-d7f0187edcf6 None admin] PATH_INFO: `/v3/domains` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:08.788657 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf36a78-820f-4bd1-a20d-d7f0187edcf6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:08.789207 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf36a78-820f-4bd1-a20d-d7f0187edcf6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:08.791053 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf36a78-820f-4bd1-a20d-d7f0187edcf6 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:08.794250 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:08.812210 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 434/870] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 12:17:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:17:08.813667 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf36a78-820f-4bd1-a20d-d7f0187edcf6 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:08.885414 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35298240-b580-4baa-ba83-36b5b5bf7c80 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:08.927005 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470e5bda-f8f2-43e8-b93a-7729f433116e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:08.928041 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e5bda-f8f2-43e8-b93a-7729f433116e None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:08.928576 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e5bda-f8f2-43e8-b93a-7729f433116e None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:08.929663 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e5bda-f8f2-43e8-b93a-7729f433116e None admin] PATH_INFO: `/v3/services` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:08.930706 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470e5bda-f8f2-43e8-b93a-7729f433116e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:08.931263 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470e5bda-f8f2-43e8-b93a-7729f433116e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:08.932989 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470e5bda-f8f2-43e8-b93a-7729f433116e None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:08.943995 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 437/871] 10.222.0.79 () {56 vars in 1122 bytes} [Wed Aug 31 12:17:08 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:08.945501 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470e5bda-f8f2-43e8-b93a-7729f433116e None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:08.966684 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf36a78-820f-4bd1-a20d-d7f0187edcf6 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:09.032498 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6130b1-27e1-4711-84c0-279c98e18738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:09.033760 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6130b1-27e1-4711-84c0-279c98e18738 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:09.034266 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6130b1-27e1-4711-84c0-279c98e18738 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:09.034788 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6130b1-27e1-4711-84c0-279c98e18738 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:09.048277 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6130b1-27e1-4711-84c0-279c98e18738 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:09.050920 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6130b1-27e1-4711-84c0-279c98e18738 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:09.061163 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470e5bda-f8f2-43e8-b93a-7729f433116e None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:09.063050 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:09.075900 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-3a6130b1-27e1-4711-84c0-279c98e18738 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:17:09.075900 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:09.075900 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:17:09.075900 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:17:09.075900 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:17:09.075900 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:17:09.075900 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:17:09.075900 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:17:09.075900 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:17:09.075900 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:17:09.075900 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:17:09.075900 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:17:09.075900 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:17:09.075900 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:17:09.075900 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:17:09.076892 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:17:09.076892 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:17:09.076892 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:17:09.076892 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:17:09.076892 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:17:09.076892 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:17:09.076892 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:17:09.076892 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:17:09.076892 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:17:09.076892 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:17:09.076892 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:17:09.076892 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:17:09.076892 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:17:09.076892 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:17:09.076892 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:17:09.076892 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:17:09.076892 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:17:09.077776 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:17:09.077776 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:17:09.077776 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:17:09.077776 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:17:09.077776 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:17:09.077776 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:17:09.077776 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:17:09.077776 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:17:09.078211 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 435/872] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 12:17:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:17:09.080272 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46441348-0880-4b62-94ec-d71976822604 None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:09.080748 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46441348-0880-4b62-94ec-d71976822604 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:09.081205 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46441348-0880-4b62-94ec-d71976822604 None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:09.086894 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 436/873] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:17:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:17:09.086894 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46441348-0880-4b62-94ec-d71976822604 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:09.112697 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da8a0e3-1713-4ac1-a6f0-907a681a80ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:09.114160 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8a0e3-1713-4ac1-a6f0-907a681a80ef None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:09.114676 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8a0e3-1713-4ac1-a6f0-907a681a80ef None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:09.115240 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8a0e3-1713-4ac1-a6f0-907a681a80ef None admin] PATH_INFO: `/v3/services` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:09.116912 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da8a0e3-1713-4ac1-a6f0-907a681a80ef None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:09.117454 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da8a0e3-1713-4ac1-a6f0-907a681a80ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:09.120135 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da8a0e3-1713-4ac1-a6f0-907a681a80ef None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:09.126579 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 438/874] 10.222.0.79 () {56 vars in 1122 bytes} [Wed Aug 31 12:17:08 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:09.127902 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3080b4c1-66ff-4343-b512-30e196d1b9b9 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:09.128191 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3080b4c1-66ff-4343-b512-30e196d1b9b9 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:09.128463 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3080b4c1-66ff-4343-b512-30e196d1b9b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:09.155007 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:09.169459 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-3080b4c1-66ff-4343-b512-30e196d1b9b9 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:09.171730 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-3080b4c1-66ff-4343-b512-30e196d1b9b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:09.257073 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46441348-0880-4b62-94ec-d71976822604 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:09.303472 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 439/875] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:17:09 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:17:09.323724 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a48ba3-0267-4f07-b699-5d60d853942a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:09.324786 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a48ba3-0267-4f07-b699-5d60d853942a None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:09.325278 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a48ba3-0267-4f07-b699-5d60d853942a None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:09.325762 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a48ba3-0267-4f07-b699-5d60d853942a None admin] PATH_INFO: `/v3/projects` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:09.327089 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a48ba3-0267-4f07-b699-5d60d853942a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:09.327624 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a48ba3-0267-4f07-b699-5d60d853942a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:09.330331 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a48ba3-0267-4f07-b699-5d60d853942a None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:09.363661 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 437/876] 10.222.0.79 () {56 vars in 1148 bytes} [Wed Aug 31 12:17:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:09.375943 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3080b4c1-66ff-4343-b512-30e196d1b9b9 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:09.424156 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e74298-9d1c-4347-a460-dd810934699e None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:09.424547 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e74298-9d1c-4347-a460-dd810934699e None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:09.424743 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e74298-9d1c-4347-a460-dd810934699e None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:09.426363 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 438/877] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:17:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:17:09.431963 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b7a2a-b332-49ac-82aa-ec6282d0d006 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:09.432282 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b7a2a-b332-49ac-82aa-ec6282d0d006 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:09.432542 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b7a2a-b332-49ac-82aa-ec6282d0d006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:09.467304 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-6b2b7a2a-b332-49ac-82aa-ec6282d0d006 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:09.469739 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-6b2b7a2a-b332-49ac-82aa-ec6282d0d006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:09.526950 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:09.535969 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3080b4c1-66ff-4343-b512-30e196d1b9b9 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:09.567454 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 439/878] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:17:09 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 12:17:09.587503 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23083008-e259-42c9-9f30-931f04c24846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:09.588523 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23083008-e259-42c9-9f30-931f04c24846 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:09.588985 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23083008-e259-42c9-9f30-931f04c24846 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:09.589439 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23083008-e259-42c9-9f30-931f04c24846 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:09.590510 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23083008-e259-42c9-9f30-931f04c24846 None admin] RBAC: Adding query filter params (role.id=37fee7a104964826a0762987a1531a9a, scope.project.id=a94f4957f2a047cc844342e1c7c74ca5, user.id=149aa48acd504354a1d021885ca51334) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:09.591109 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23083008-e259-42c9-9f30-931f04c24846 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:09.592871 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23083008-e259-42c9-9f30-931f04c24846 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:09.601205 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 440/879] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 12:17:09 2022] GET /identity/v3/role_assignments?user.id=149aa48acd504354a1d021885ca51334&scope.project.id=a94f4957f2a047cc844342e1c7c74ca5&role.id=37fee7a104964826a0762987a1531a9a => generated 608 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:09.664374 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2b7a2a-b332-49ac-82aa-ec6282d0d006 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:09.691265 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:09.798066 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2b7a2a-b332-49ac-82aa-ec6282d0d006 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:09.839650 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4830e9f-b7a2-4b63-a156-146955a5f026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:09.840179 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4830e9f-b7a2-4b63-a156-146955a5f026 None admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:09.840458 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4830e9f-b7a2-4b63-a156-146955a5f026 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:09.840728 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4830e9f-b7a2-4b63-a156-146955a5f026 None admin] PATH_INFO: `/v3/services` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:09.841415 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4830e9f-b7a2-4b63-a156-146955a5f026 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:09.842824 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23083008-e259-42c9-9f30-931f04c24846 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:09.843066 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4830e9f-b7a2-4b63-a156-146955a5f026 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:09.863541 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 440/880] 10.222.0.79 () {60 vars in 1141 bytes} [Wed Aug 31 12:17:09 2022] POST /identity/v3/services => generated 269 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:17:10.064202 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23083008-e259-42c9-9f30-931f04c24846 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:10.145766 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198580be-671b-484d-89e7-c84fca02292a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:10.147381 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198580be-671b-484d-89e7-c84fca02292a None admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:10.148595 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198580be-671b-484d-89e7-c84fca02292a None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:10.149123 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198580be-671b-484d-89e7-c84fca02292a None admin] PATH_INFO: `/v3/services` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:10.150024 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198580be-671b-484d-89e7-c84fca02292a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:10.152519 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198580be-671b-484d-89e7-c84fca02292a None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:10.182636 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 441/881] 10.222.0.79 () {60 vars in 1141 bytes} [Wed Aug 31 12:17:09 2022] POST /identity/v3/services => generated 251 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:17:11.967860 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7898a9a9-d025-4fbd-8d54-4584d406aae4 None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:11.968516 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7898a9a9-d025-4fbd-8d54-4584d406aae4 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:11.968864 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7898a9a9-d025-4fbd-8d54-4584d406aae4 None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:11.972154 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 441/882] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:17:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:17:11.981606 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a54df-1642-4461-aa7d-7805b4f40c88 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:11.983124 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a54df-1642-4461-aa7d-7805b4f40c88 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:11.983896 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a54df-1642-4461-aa7d-7805b4f40c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:12.015239 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-1a9a54df-1642-4461-aa7d-7805b4f40c88 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:12.017702 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-1a9a54df-1642-4461-aa7d-7805b4f40c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:12.021143 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c1b8e-44ea-4a95-b0b4-c6c69d92c04e None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:12.021901 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c1b8e-44ea-4a95-b0b4-c6c69d92c04e None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:12.023220 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c1b8e-44ea-4a95-b0b4-c6c69d92c04e None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:12.025846 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 442/883] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:17:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:17:12.034368 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04938e2b-50a9-4d44-ad33-2f3ce18b3395 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:12.035289 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04938e2b-50a9-4d44-ad33-2f3ce18b3395 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:12.036020 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04938e2b-50a9-4d44-ad33-2f3ce18b3395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:12.039917 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:12.067381 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-04938e2b-50a9-4d44-ad33-2f3ce18b3395 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:12.070067 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-04938e2b-50a9-4d44-ad33-2f3ce18b3395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:12.162918 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 442/884] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:17:11 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:17:12.199932 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 443/885] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:17:12 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:17:12.496839 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d8742d-db59-4d3e-8cef-6ec431514120 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:12.497146 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d8742d-db59-4d3e-8cef-6ec431514120 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:12.498727 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d8742d-db59-4d3e-8cef-6ec431514120 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:12.498727 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 443/886] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:17:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:17:12.504700 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f09db23-a4cc-484f-a635-686d9d911f3c None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:12.505268 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f09db23-a4cc-484f-a635-686d9d911f3c None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:12.505724 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f09db23-a4cc-484f-a635-686d9d911f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:12.540355 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-7f09db23-a4cc-484f-a635-686d9d911f3c None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:12.541577 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-7f09db23-a4cc-484f-a635-686d9d911f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:12.545254 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:12.648608 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 444/887] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:17:12 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:17:12.716535 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d8742d-db59-4d3e-8cef-6ec431514120 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:12.750656 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f09db23-a4cc-484f-a635-686d9d911f3c None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:12.923707 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d8742d-db59-4d3e-8cef-6ec431514120 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:12.929682 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f09db23-a4cc-484f-a635-686d9d911f3c None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:12.972156 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c52120-9195-40ce-968c-428a43ac2d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:12.973133 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c52120-9195-40ce-968c-428a43ac2d40 None admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:12.973133 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c52120-9195-40ce-968c-428a43ac2d40 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:12.973644 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c52120-9195-40ce-968c-428a43ac2d40 None admin] PATH_INFO: `/v3/services` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:12.974269 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c52120-9195-40ce-968c-428a43ac2d40 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:12.976171 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c52120-9195-40ce-968c-428a43ac2d40 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:12.989725 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:12.993507 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a576126-1d27-4b63-bec8-20500777e200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:12.995584 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a576126-1d27-4b63-bec8-20500777e200 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:12.996891 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a576126-1d27-4b63-bec8-20500777e200 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:12.997643 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a576126-1d27-4b63-bec8-20500777e200 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:13.008432 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 445/888] 10.222.0.79 () {60 vars in 1141 bytes} [Wed Aug 31 12:17:12 2022] POST /identity/v3/services => generated 241 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:17:13.008432 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c5ab3-68c4-44c5-9306-307403ff1fab None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:13.008432 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c5ab3-68c4-44c5-9306-307403ff1fab None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:13.008432 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c5ab3-68c4-44c5-9306-307403ff1fab None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:13.010935 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 446/889] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:17:13 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:17:13.013014 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7c5ab3-68c4-44c5-9306-307403ff1fab None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:13.023425 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a576126-1d27-4b63-bec8-20500777e200 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:17:13.033579 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-5a576126-1d27-4b63-bec8-20500777e200 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 12:17:13.033579 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:13.033579 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:17:13.033579 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:17:13.033579 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:17:13.033579 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:17:13.033579 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:17:13.033579 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:17:13.033579 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:17:13.033579 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:17:13.033579 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:17:13.033579 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:17:13.033579 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:17:13.033579 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:17:13.033579 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:17:13.033579 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:17:13.034712 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:17:13.034712 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:17:13.034712 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:17:13.034712 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:17:13.034712 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:17:13.034712 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:17:13.034712 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:17:13.034712 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:17:13.034712 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:17:13.034712 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:17:13.034712 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:17:13.034712 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:17:13.034712 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:17:13.034712 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:17:13.034712 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:17:13.034712 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:17:13.035765 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:17:13.035765 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:17:13.035765 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:17:13.035765 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:17:13.035765 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:17:13.035765 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:17:13.035765 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:17:13.035765 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:17:13.035765 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:17:13.035765 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:17:13.035765 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 12:17:13.035765 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:17:13.035765 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 444/890] 10.222.0.79 () {56 vars in 1120 bytes} [Wed Aug 31 12:17:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:17:13.037569 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e2eed7-740c-4f47-8643-a1b5e6f525b9 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:13.038131 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e2eed7-740c-4f47-8643-a1b5e6f525b9 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:13.038663 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e2eed7-740c-4f47-8643-a1b5e6f525b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:13.059399 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:13.068041 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-69e2eed7-740c-4f47-8643-a1b5e6f525b9 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:13.069870 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-69e2eed7-740c-4f47-8643-a1b5e6f525b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:13.174671 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 445/891] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:17:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:17:13.176656 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e2eed7-740c-4f47-8643-a1b5e6f525b9 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:13.181752 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7c5ab3-68c4-44c5-9306-307403ff1fab None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:13.259856 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12b58b3-29ee-45ad-810a-fdc29520f62b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:13.260441 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b58b3-29ee-45ad-810a-fdc29520f62b None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:13.260719 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b58b3-29ee-45ad-810a-fdc29520f62b None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:13.260985 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b58b3-29ee-45ad-810a-fdc29520f62b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:13.261584 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12b58b3-29ee-45ad-810a-fdc29520f62b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:13.263118 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12b58b3-29ee-45ad-810a-fdc29520f62b None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:13.272930 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-e12b58b3-29ee-45ad-810a-fdc29520f62b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 12:17:13.272930 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:13.272930 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 12:17:13.272930 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 12:17:13.272930 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 12:17:13.272930 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 12:17:13.272930 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 12:17:13.272930 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:17:13.272930 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 12:17:13.272930 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:17:13.272930 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:17:13.272930 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:17:13.272930 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:13.272930 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:17:13.272930 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:17:13.272930 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:17:13.274754 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:17:13.274754 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:17:13.274754 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:17:13.274754 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:17:13.274754 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:17:13.274754 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:17:13.274754 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:17:13.274754 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 12:17:13.274754 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 12:17:13.274754 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 12:17:13.274754 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 12:17:13.274754 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:17:13.274754 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:17:13.274754 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:17:13.274754 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:17:13.274754 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:17:13.274754 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:17:13.278124 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:17:13.278124 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:17:13.278124 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:17:13.278124 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:17:13.278124 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:17:13.278124 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:17:13.278124 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:17:13.278124 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:17:13.278124 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:17:13.278124 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:17:13.278124 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 12:17:13.278124 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:17:13.278124 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 12:17:13.278124 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:17:13.278124 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 447/892] 10.222.0.79 () {56 vars in 1132 bytes} [Wed Aug 31 12:17:13 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:17:13.283446 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12b58b3-29ee-45ad-810a-fdc29520f62b None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:13.313842 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e2eed7-740c-4f47-8643-a1b5e6f525b9 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:13.348459 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:13.362960 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cd4b57-0ecd-4b11-bc96-c2c609b23614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:13.363600 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd4b57-0ecd-4b11-bc96-c2c609b23614 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:13.363880 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd4b57-0ecd-4b11-bc96-c2c609b23614 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:13.364154 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd4b57-0ecd-4b11-bc96-c2c609b23614 None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:13.364840 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cd4b57-0ecd-4b11-bc96-c2c609b23614 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:13.365142 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cd4b57-0ecd-4b11-bc96-c2c609b23614 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:13.367047 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cd4b57-0ecd-4b11-bc96-c2c609b23614 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:13.378143 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 446/893] 10.222.0.79 () {56 vars in 1115 bytes} [Wed Aug 31 12:17:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:13.383972 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cd4b57-0ecd-4b11-bc96-c2c609b23614 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:13.434722 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:13.502184 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12b58b3-29ee-45ad-810a-fdc29520f62b None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:13.572588 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea110b6-b1a1-4ba4-afdd-577451700193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:13.573934 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea110b6-b1a1-4ba4-afdd-577451700193 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:13.574683 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea110b6-b1a1-4ba4-afdd-577451700193 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:13.575349 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea110b6-b1a1-4ba4-afdd-577451700193 None admin] PATH_INFO: `/v3/services` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:13.576705 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea110b6-b1a1-4ba4-afdd-577451700193 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:13.577219 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea110b6-b1a1-4ba4-afdd-577451700193 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:13.579892 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea110b6-b1a1-4ba4-afdd-577451700193 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:13.589352 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cd4b57-0ecd-4b11-bc96-c2c609b23614 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:13.594839 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 448/894] 10.222.0.79 () {56 vars in 1126 bytes} [Wed Aug 31 12:17:13 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:17:13.594839 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea110b6-b1a1-4ba4-afdd-577451700193 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:13.653890 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29dc079-ff13-4843-ab0f-e04b2637e0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:13.655056 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29dc079-ff13-4843-ab0f-e04b2637e0aa None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:13.655488 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29dc079-ff13-4843-ab0f-e04b2637e0aa None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:13.655962 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29dc079-ff13-4843-ab0f-e04b2637e0aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:13.675936 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29dc079-ff13-4843-ab0f-e04b2637e0aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:13.679725 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29dc079-ff13-4843-ab0f-e04b2637e0aa None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:13.705627 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-b29dc079-ff13-4843-ab0f-e04b2637e0aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:17:13.705627 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:13.705627 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:17:13.705627 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:17:13.705627 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:17:13.705627 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:17:13.705627 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:17:13.705627 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:17:13.705627 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:17:13.705627 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:17:13.705627 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:17:13.705627 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:17:13.705627 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:17:13.705627 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:17:13.705627 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:17:13.705627 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:17:13.707581 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:17:13.707581 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:17:13.707581 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:17:13.707581 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:17:13.707581 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:17:13.707581 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:17:13.707581 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:17:13.707581 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:17:13.707581 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:17:13.707581 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:17:13.707581 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:17:13.707581 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:17:13.707581 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:17:13.707581 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:17:13.707581 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:17:13.707581 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:17:13.707581 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:17:13.709323 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:17:13.709323 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:17:13.709323 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:17:13.715615 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 447/895] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:17:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:17:13.717210 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29dc079-ff13-4843-ab0f-e04b2637e0aa None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:13.754468 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea110b6-b1a1-4ba4-afdd-577451700193 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:13.791340 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:13.797577 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:13.814936 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce7595-f3be-4bd4-8313-b09c7967bf54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:13.816048 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce7595-f3be-4bd4-8313-b09c7967bf54 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:13.816548 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce7595-f3be-4bd4-8313-b09c7967bf54 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:13.817039 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce7595-f3be-4bd4-8313-b09c7967bf54 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:13.818133 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ce7595-f3be-4bd4-8313-b09c7967bf54 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:13.820857 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ce7595-f3be-4bd4-8313-b09c7967bf54 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:13.839261 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-07ce7595-f3be-4bd4-8313-b09c7967bf54 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 12:17:13.839261 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:13.839261 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 12:17:13.839261 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 12:17:13.839261 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 12:17:13.839261 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 12:17:13.839261 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 12:17:13.839261 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:17:13.839261 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 12:17:13.839261 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:17:13.839261 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:17:13.839261 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:17:13.839261 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:13.839261 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:17:13.839261 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:17:13.839261 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:17:13.839261 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:17:13.840302 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:17:13.840302 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:17:13.840302 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:17:13.840302 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:17:13.840302 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:17:13.840302 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:17:13.840302 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 12:17:13.840302 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 12:17:13.840302 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 12:17:13.840302 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 12:17:13.840302 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:17:13.840302 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:17:13.840302 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:17:13.840302 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:17:13.840302 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:17:13.840302 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:17:13.841151 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:17:13.841151 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:17:13.841151 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:17:13.841151 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:17:13.841151 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:17:13.841151 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:17:13.841151 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:17:13.841151 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:17:13.841151 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:17:13.841151 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:17:13.841151 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 12:17:13.841151 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:17:13.841151 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 12:17:13.841151 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:17:13.841905 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 449/896] 10.222.0.79 () {56 vars in 1114 bytes} [Wed Aug 31 12:17:13 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:17:13.842911 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce7595-f3be-4bd4-8313-b09c7967bf54 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:13.890054 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29dc079-ff13-4843-ab0f-e04b2637e0aa None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:13.939042 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c200a254-3af2-4476-a7af-662f337a6734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:13.939668 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c200a254-3af2-4476-a7af-662f337a6734 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:13.939950 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c200a254-3af2-4476-a7af-662f337a6734 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:13.940216 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c200a254-3af2-4476-a7af-662f337a6734 None admin] PATH_INFO: `/v3/services` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:13.940868 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c200a254-3af2-4476-a7af-662f337a6734 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:13.941168 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c200a254-3af2-4476-a7af-662f337a6734 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:13.942587 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c200a254-3af2-4476-a7af-662f337a6734 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:13.956384 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 448/897] 10.222.0.79 () {56 vars in 1126 bytes} [Wed Aug 31 12:17:13 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:13.956384 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c200a254-3af2-4476-a7af-662f337a6734 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:14.014203 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce7595-f3be-4bd4-8313-b09c7967bf54 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:14.077461 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026f3f9-45ee-4d0f-bacb-dbf626bf90bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:14.078473 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026f3f9-45ee-4d0f-bacb-dbf626bf90bf None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:14.078778 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026f3f9-45ee-4d0f-bacb-dbf626bf90bf None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:14.079250 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026f3f9-45ee-4d0f-bacb-dbf626bf90bf None admin] PATH_INFO: `/v3/domains` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:14.081029 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f026f3f9-45ee-4d0f-bacb-dbf626bf90bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:14.081572 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f026f3f9-45ee-4d0f-bacb-dbf626bf90bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:14.083917 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f026f3f9-45ee-4d0f-bacb-dbf626bf90bf None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:14.096118 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c200a254-3af2-4476-a7af-662f337a6734 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:14.099116 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 450/898] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 12:17:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:14.105342 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026f3f9-45ee-4d0f-bacb-dbf626bf90bf None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:14.108370 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:14.147009 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47073c96-80d6-4855-9a01-bf4fe1851f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:14.147901 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47073c96-80d6-4855-9a01-bf4fe1851f89 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:14.148372 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47073c96-80d6-4855-9a01-bf4fe1851f89 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:14.148663 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47073c96-80d6-4855-9a01-bf4fe1851f89 None admin] PATH_INFO: `/v3/services` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:14.149306 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47073c96-80d6-4855-9a01-bf4fe1851f89 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:14.149616 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47073c96-80d6-4855-9a01-bf4fe1851f89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:14.151169 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47073c96-80d6-4855-9a01-bf4fe1851f89 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:14.156592 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 449/899] 10.222.0.79 () {56 vars in 1114 bytes} [Wed Aug 31 12:17:13 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:14.157367 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47073c96-80d6-4855-9a01-bf4fe1851f89 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:14.188957 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:14.278956 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026f3f9-45ee-4d0f-bacb-dbf626bf90bf None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:14.287198 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47073c96-80d6-4855-9a01-bf4fe1851f89 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:14.324898 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd129d3-2ecc-4a5d-a771-a0c7d9578b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:14.325956 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd129d3-2ecc-4a5d-a771-a0c7d9578b81 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:14.326271 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd129d3-2ecc-4a5d-a771-a0c7d9578b81 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:14.326643 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd129d3-2ecc-4a5d-a771-a0c7d9578b81 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:14.328012 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd129d3-2ecc-4a5d-a771-a0c7d9578b81 None admin] RBAC: Adding query filter params (interface=public, service_id=0cc9d2dc40a74a55a6f20e59855c62e8, region_id=RegionOne) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:14.328552 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd129d3-2ecc-4a5d-a771-a0c7d9578b81 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:14.331154 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd129d3-2ecc-4a5d-a771-a0c7d9578b81 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:14.342624 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 451/900] 10.222.0.79 () {56 vars in 1251 bytes} [Wed Aug 31 12:17:14 2022] GET /identity/v3/endpoints?service_id=0cc9d2dc40a74a55a6f20e59855c62e8&interface=public®ion_id=RegionOne => generated 194 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:14.344137 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd129d3-2ecc-4a5d-a771-a0c7d9578b81 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:14.346071 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315b04be-1c52-4b18-8dee-dac8b35ca578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:14.346911 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b04be-1c52-4b18-8dee-dac8b35ca578 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:14.347133 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b04be-1c52-4b18-8dee-dac8b35ca578 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:14.347406 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b04be-1c52-4b18-8dee-dac8b35ca578 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:14.364092 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315b04be-1c52-4b18-8dee-dac8b35ca578 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:14.365565 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315b04be-1c52-4b18-8dee-dac8b35ca578 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:14.380111 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-315b04be-1c52-4b18-8dee-dac8b35ca578 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 12:17:14.380111 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:14.380111 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:17:14.380111 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:17:14.380111 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:17:14.380111 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:17:14.380111 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:17:14.380111 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:17:14.380111 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:17:14.380111 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:17:14.380111 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:17:14.380111 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:17:14.380111 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:17:14.380111 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:17:14.380111 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:17:14.380111 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:17:14.382689 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:17:14.382689 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:17:14.382689 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:17:14.382689 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:17:14.382689 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:17:14.382689 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:17:14.382689 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:17:14.382689 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:17:14.382689 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:17:14.382689 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:17:14.382689 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:17:14.382689 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:17:14.382689 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:17:14.382689 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:17:14.382689 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:17:14.382689 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:17:14.382689 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:17:14.382689 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:17:14.384664 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:17:14.384664 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:17:14.384664 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:17:14.384664 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:17:14.384664 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:17:14.384664 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:17:14.384664 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:17:14.384664 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:17:14.384664 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 12:17:14.384664 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:17:14.384664 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 450/901] 10.222.0.79 () {56 vars in 1117 bytes} [Wed Aug 31 12:17:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:17:14.384664 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315b04be-1c52-4b18-8dee-dac8b35ca578 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:14.431955 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:14.504494 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd129d3-2ecc-4a5d-a771-a0c7d9578b81 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:14.528593 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:14.529225 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315b04be-1c52-4b18-8dee-dac8b35ca578 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:14.556986 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419c81f7-63aa-475a-bc08-712a2a4d5a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:14.558012 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c81f7-63aa-475a-bc08-712a2a4d5a1f None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:14.558318 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c81f7-63aa-475a-bc08-712a2a4d5a1f None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:14.558714 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c81f7-63aa-475a-bc08-712a2a4d5a1f None admin] PATH_INFO: `/v3/services` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:14.561272 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419c81f7-63aa-475a-bc08-712a2a4d5a1f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:14.561272 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419c81f7-63aa-475a-bc08-712a2a4d5a1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:14.562873 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419c81f7-63aa-475a-bc08-712a2a4d5a1f None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:14.573834 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 452/902] 10.222.0.79 () {56 vars in 1114 bytes} [Wed Aug 31 12:17:14 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:14.573834 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419c81f7-63aa-475a-bc08-712a2a4d5a1f None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:14.591055 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cd84ff-f727-4d0d-9b72-01636bd2a6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:14.592587 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cd84ff-f727-4d0d-9b72-01636bd2a6aa None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:14.594086 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cd84ff-f727-4d0d-9b72-01636bd2a6aa None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:14.594086 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cd84ff-f727-4d0d-9b72-01636bd2a6aa None admin] PATH_INFO: `/v3/services` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:14.594627 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cd84ff-f727-4d0d-9b72-01636bd2a6aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:14.596974 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cd84ff-f727-4d0d-9b72-01636bd2a6aa None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:14.615055 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 451/903] 10.222.0.79 () {56 vars in 1087 bytes} [Wed Aug 31 12:17:14 2022] GET /identity/v3/services => generated 1497 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:17:14.615055 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cd84ff-f727-4d0d-9b72-01636bd2a6aa None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:14.790239 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419c81f7-63aa-475a-bc08-712a2a4d5a1f None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:14.820575 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:14.834869 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cd84ff-f727-4d0d-9b72-01636bd2a6aa None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:14.841072 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bbb5db-bf79-4e28-86fe-935af4d5c902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:14.841956 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bbb5db-bf79-4e28-86fe-935af4d5c902 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:14.842229 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bbb5db-bf79-4e28-86fe-935af4d5c902 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:14.842493 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bbb5db-bf79-4e28-86fe-935af4d5c902 None admin] PATH_INFO: `/v3/users` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:14.843275 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bbb5db-bf79-4e28-86fe-935af4d5c902 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:14.843578 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bbb5db-bf79-4e28-86fe-935af4d5c902 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:14.845122 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bbb5db-bf79-4e28-86fe-935af4d5c902 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:14.870444 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 453/904] 10.222.0.79 () {56 vars in 1149 bytes} [Wed Aug 31 12:17:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:14.876880 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bbb5db-bf79-4e28-86fe-935af4d5c902 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:14.889821 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bd0439-af8a-438b-abc4-87e3183ca5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:14.890462 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bd0439-af8a-438b-abc4-87e3183ca5c1 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:14.890734 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bd0439-af8a-438b-abc4-87e3183ca5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:14.891090 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bd0439-af8a-438b-abc4-87e3183ca5c1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:14.891967 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bd0439-af8a-438b-abc4-87e3183ca5c1 None admin] RBAC: Adding query filter params (interface=public, service_id=709f8de65b2544b482deb75907f6f2a5, region_id=RegionOne) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:14.892614 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bd0439-af8a-438b-abc4-87e3183ca5c1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:14.893896 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bd0439-af8a-438b-abc4-87e3183ca5c1 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:14.903407 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 452/905] 10.222.0.79 () {56 vars in 1251 bytes} [Wed Aug 31 12:17:14 2022] GET /identity/v3/endpoints?service_id=709f8de65b2544b482deb75907f6f2a5&interface=public®ion_id=RegionOne => generated 194 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:14.909368 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bd0439-af8a-438b-abc4-87e3183ca5c1 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:14.922546 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:14.997684 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bbb5db-bf79-4e28-86fe-935af4d5c902 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:15.037744 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0b0384-2a7b-4113-9883-f6dd8f2ac4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:15.039227 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b0384-2a7b-4113-9883-f6dd8f2ac4f8 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:15.039227 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b0384-2a7b-4113-9883-f6dd8f2ac4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:15.042962 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b0384-2a7b-4113-9883-f6dd8f2ac4f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:15.093344 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bd0439-af8a-438b-abc4-87e3183ca5c1 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:15.117551 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0b0384-2a7b-4113-9883-f6dd8f2ac4f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:15.119092 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0b0384-2a7b-4113-9883-f6dd8f2ac4f8 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:15.156429 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:15.165109 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995d1601-4521-4076-bb20-c9170786323e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:15.167462 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d1601-4521-4076-bb20-c9170786323e None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:15.168317 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d1601-4521-4076-bb20-c9170786323e None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:15.168900 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d1601-4521-4076-bb20-c9170786323e None admin] PATH_INFO: `/v3/services` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:15.170357 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995d1601-4521-4076-bb20-c9170786323e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:15.173641 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995d1601-4521-4076-bb20-c9170786323e None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:15.197512 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 453/906] 10.222.0.79 () {56 vars in 1087 bytes} [Wed Aug 31 12:17:14 2022] GET /identity/v3/services => generated 1497 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 12:17:15.240780 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 454/907] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 12:17:14 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 12:17:15.250391 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995d1601-4521-4076-bb20-c9170786323e None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:15.290270 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:15.335396 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7388231-15c1-4d61-aaeb-8b37924ed89b None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:15.335856 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7388231-15c1-4d61-aaeb-8b37924ed89b None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:15.336226 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7388231-15c1-4d61-aaeb-8b37924ed89b None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:15.338427 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 455/908] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:17:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:17:15.347139 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a056c09-92bf-42fb-84d8-853656e952ce None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:15.347459 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a056c09-92bf-42fb-84d8-853656e952ce None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:15.347816 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a056c09-92bf-42fb-84d8-853656e952ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:15.373899 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-2a056c09-92bf-42fb-84d8-853656e952ce None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:15.375384 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-2a056c09-92bf-42fb-84d8-853656e952ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:15.391821 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995d1601-4521-4076-bb20-c9170786323e None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:15.453022 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe29c61b-03ea-4960-a4c4-85b77ec9988d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:15.454064 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe29c61b-03ea-4960-a4c4-85b77ec9988d None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:15.454552 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe29c61b-03ea-4960-a4c4-85b77ec9988d None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:15.455095 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe29c61b-03ea-4960-a4c4-85b77ec9988d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:15.469776 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe29c61b-03ea-4960-a4c4-85b77ec9988d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:15.471745 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe29c61b-03ea-4960-a4c4-85b77ec9988d None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:15.489347 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 456/909] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:17:15 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:17:15.498888 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-fe29c61b-03ea-4960-a4c4-85b77ec9988d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:17:15.498888 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:15.498888 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:17:15.498888 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:17:15.498888 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:17:15.498888 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:17:15.498888 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:17:15.498888 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:17:15.498888 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:17:15.498888 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:17:15.498888 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:17:15.498888 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:17:15.498888 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:17:15.498888 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:17:15.498888 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:17:15.498888 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:17:15.499939 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:17:15.499939 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:17:15.499939 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:17:15.499939 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:17:15.499939 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:17:15.499939 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:17:15.499939 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:17:15.499939 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:17:15.499939 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:17:15.499939 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:17:15.499939 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:17:15.499939 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:17:15.499939 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:17:15.499939 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:17:15.499939 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:17:15.499939 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:17:15.499939 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:17:15.500857 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:17:15.500857 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:17:15.500857 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:17:15.500857 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 454/910] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:17:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:17:15.502845 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a056c09-92bf-42fb-84d8-853656e952ce None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:15.584029 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:15.629679 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a056c09-92bf-42fb-84d8-853656e952ce None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:15.677072 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc59ba08-2470-4fd0-b0fe-7e2613a20d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:15.677749 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc59ba08-2470-4fd0-b0fe-7e2613a20d10 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:15.678093 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc59ba08-2470-4fd0-b0fe-7e2613a20d10 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:15.678387 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc59ba08-2470-4fd0-b0fe-7e2613a20d10 None admin] PATH_INFO: `/v3/domains` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:15.679188 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc59ba08-2470-4fd0-b0fe-7e2613a20d10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:15.679487 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc59ba08-2470-4fd0-b0fe-7e2613a20d10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:15.680883 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc59ba08-2470-4fd0-b0fe-7e2613a20d10 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:15.693889 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 457/911] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 12:17:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:15.704087 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe29c61b-03ea-4960-a4c4-85b77ec9988d None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:15.780778 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc59ba08-2470-4fd0-b0fe-7e2613a20d10 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:15.794878 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:15.824889 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe29c61b-03ea-4960-a4c4-85b77ec9988d None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:15.864871 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0854a15-5710-4652-820e-361d70295df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:15.865791 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0854a15-5710-4652-820e-361d70295df8 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:15.866982 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0854a15-5710-4652-820e-361d70295df8 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:15.867563 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0854a15-5710-4652-820e-361d70295df8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:15.875654 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0854a15-5710-4652-820e-361d70295df8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:15.878260 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0854a15-5710-4652-820e-361d70295df8 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:15.891228 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-d0854a15-5710-4652-820e-361d70295df8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:17:15.891228 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:15.891228 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:17:15.891228 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:17:15.891228 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:17:15.891228 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:17:15.891228 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:17:15.891228 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:17:15.891228 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:17:15.891228 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:17:15.891228 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:17:15.891228 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:17:15.891228 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:17:15.891228 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:17:15.891228 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:17:15.892411 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:17:15.892411 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:17:15.892411 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:17:15.892411 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:17:15.892411 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:17:15.892411 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:17:15.892411 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:17:15.892411 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:17:15.892411 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:17:15.892411 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:17:15.892411 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:17:15.892411 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:17:15.892411 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:17:15.892411 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:17:15.892411 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:17:15.892411 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:17:15.892411 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:17:15.893513 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:17:15.893513 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:17:15.893513 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:17:15.893513 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:17:15.893513 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:17:15.893513 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:17:15.893513 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:17:15.893513 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:17:15.895262 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 455/912] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 12:17:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:17:15.911922 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0854a15-5710-4652-820e-361d70295df8 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:15.917503 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc59ba08-2470-4fd0-b0fe-7e2613a20d10 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:15.953570 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:15.969773 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1e54ef-3583-41b5-9d58-8e70acc3ed99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:15.970831 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e54ef-3583-41b5-9d58-8e70acc3ed99 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:15.971581 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e54ef-3583-41b5-9d58-8e70acc3ed99 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:15.972017 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e54ef-3583-41b5-9d58-8e70acc3ed99 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:15.972748 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1e54ef-3583-41b5-9d58-8e70acc3ed99 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:15.974269 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1e54ef-3583-41b5-9d58-8e70acc3ed99 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:15.987683 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-4a1e54ef-3583-41b5-9d58-8e70acc3ed99 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 12:17:15.987683 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:15.987683 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 12:17:15.987683 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 12:17:15.987683 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 12:17:15.987683 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 12:17:15.987683 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 12:17:15.987683 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:17:15.987683 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 12:17:15.987683 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:17:15.987683 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:17:15.987683 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:17:15.987683 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:15.987683 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:17:15.987683 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:17:15.987683 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:17:15.987683 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:17:15.988933 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:17:15.988933 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:17:15.988933 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:17:15.988933 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:17:15.988933 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:17:15.988933 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:17:15.988933 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 12:17:15.988933 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 12:17:15.988933 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 12:17:15.988933 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 12:17:15.988933 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:17:15.988933 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:17:15.988933 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:17:15.988933 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:17:15.988933 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:17:15.988933 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:17:15.989960 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:17:15.989960 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:17:15.989960 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:17:15.989960 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:17:15.989960 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:17:15.989960 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:17:15.989960 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:17:15.989960 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:17:15.989960 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:17:15.989960 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:17:15.989960 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 12:17:15.989960 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:17:15.989960 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 12:17:15.989960 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:17:15.992663 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 458/913] 10.222.0.79 () {56 vars in 1126 bytes} [Wed Aug 31 12:17:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:17:15.998563 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1e54ef-3583-41b5-9d58-8e70acc3ed99 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:16.036212 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0854a15-5710-4652-820e-361d70295df8 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:16.079418 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c09310-3175-44cc-8c71-8c7a6a69605f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:16.080505 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c09310-3175-44cc-8c71-8c7a6a69605f None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:16.080987 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c09310-3175-44cc-8c71-8c7a6a69605f None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:16.081479 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c09310-3175-44cc-8c71-8c7a6a69605f None admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:16.082400 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c09310-3175-44cc-8c71-8c7a6a69605f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:16.083077 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c09310-3175-44cc-8c71-8c7a6a69605f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:16.084781 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c09310-3175-44cc-8c71-8c7a6a69605f None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:16.098971 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 456/914] 10.222.0.79 () {56 vars in 1148 bytes} [Wed Aug 31 12:17:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:16.099679 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:16.107732 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c09310-3175-44cc-8c71-8c7a6a69605f None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:16.131773 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1e54ef-3583-41b5-9d58-8e70acc3ed99 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:16.178013 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412811f0-b17f-4f0c-ac11-791eac538285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:16.178783 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412811f0-b17f-4f0c-ac11-791eac538285 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:16.179132 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412811f0-b17f-4f0c-ac11-791eac538285 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:16.179338 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412811f0-b17f-4f0c-ac11-791eac538285 None admin] PATH_INFO: `/v3/services` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:16.180017 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412811f0-b17f-4f0c-ac11-791eac538285 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:16.180372 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412811f0-b17f-4f0c-ac11-791eac538285 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:16.182389 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412811f0-b17f-4f0c-ac11-791eac538285 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:16.193606 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 459/915] 10.222.0.79 () {56 vars in 1122 bytes} [Wed Aug 31 12:17:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:16.196237 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412811f0-b17f-4f0c-ac11-791eac538285 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:16.237628 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c09310-3175-44cc-8c71-8c7a6a69605f None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:16.262929 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:16.275924 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a673258-7eba-4764-8b22-5b39a932560a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:16.276557 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a673258-7eba-4764-8b22-5b39a932560a None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:16.277024 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a673258-7eba-4764-8b22-5b39a932560a None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:16.277133 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a673258-7eba-4764-8b22-5b39a932560a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:16.277817 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a673258-7eba-4764-8b22-5b39a932560a None admin] RBAC: Adding query filter params (role.id=17ccc8cf2d4146ffa34cbd692c600ff7, scope.project.id=a94f4957f2a047cc844342e1c7c74ca5, user.id=149aa48acd504354a1d021885ca51334) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:16.278114 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a673258-7eba-4764-8b22-5b39a932560a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:16.279569 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a673258-7eba-4764-8b22-5b39a932560a None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:16.285774 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 457/916] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 12:17:16 2022] GET /identity/v3/role_assignments?user.id=149aa48acd504354a1d021885ca51334&scope.project.id=a94f4957f2a047cc844342e1c7c74ca5&role.id=17ccc8cf2d4146ffa34cbd692c600ff7 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:16.325802 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412811f0-b17f-4f0c-ac11-791eac538285 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:16.369858 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c698e7a-2c30-4eb1-8733-e7dba9ffa6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:16.370965 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c698e7a-2c30-4eb1-8733-e7dba9ffa6c5 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:16.371519 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c698e7a-2c30-4eb1-8733-e7dba9ffa6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:16.372124 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c698e7a-2c30-4eb1-8733-e7dba9ffa6c5 None admin] PATH_INFO: `/v3/services` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:16.373004 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c698e7a-2c30-4eb1-8733-e7dba9ffa6c5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:16.373542 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c698e7a-2c30-4eb1-8733-e7dba9ffa6c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:16.375207 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c698e7a-2c30-4eb1-8733-e7dba9ffa6c5 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:16.381718 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 460/917] 10.222.0.79 () {56 vars in 1122 bytes} [Wed Aug 31 12:17:16 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:16.388384 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a673258-7eba-4764-8b22-5b39a932560a None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:16.468562 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:16.515810 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a673258-7eba-4764-8b22-5b39a932560a None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:16.551696 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bcf639-093b-45dc-bc35-7bb2f9e44fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:16.552317 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bcf639-093b-45dc-bc35-7bb2f9e44fcb None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:16.552592 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bcf639-093b-45dc-bc35-7bb2f9e44fcb None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:16.552861 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bcf639-093b-45dc-bc35-7bb2f9e44fcb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:16.554093 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bcf639-093b-45dc-bc35-7bb2f9e44fcb None admin] RBAC: Adding query filter params (interface=public, service_id=56798a797f6641d3842ce10cf50aff60, region_id=RegionOne) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:16.554459 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bcf639-093b-45dc-bc35-7bb2f9e44fcb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:16.555858 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bcf639-093b-45dc-bc35-7bb2f9e44fcb None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:16.561881 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 458/918] 10.222.0.79 () {56 vars in 1251 bytes} [Wed Aug 31 12:17:16 2022] GET /identity/v3/endpoints?service_id=56798a797f6641d3842ce10cf50aff60&interface=public®ion_id=RegionOne => generated 194 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:16.568661 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c698e7a-2c30-4eb1-8733-e7dba9ffa6c5 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:16.696849 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c698e7a-2c30-4eb1-8733-e7dba9ffa6c5 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:16.720665 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:16.747599 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9bfd3e-cb77-4327-87a7-d720f10e79ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:16.748248 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9bfd3e-cb77-4327-87a7-d720f10e79ee None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:16.748533 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9bfd3e-cb77-4327-87a7-d720f10e79ee None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:16.748812 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9bfd3e-cb77-4327-87a7-d720f10e79ee None admin] PATH_INFO: `/v3/services` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:16.749434 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9bfd3e-cb77-4327-87a7-d720f10e79ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:16.751085 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9bfd3e-cb77-4327-87a7-d720f10e79ee None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:16.758229 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 461/919] 10.222.0.79 () {56 vars in 1087 bytes} [Wed Aug 31 12:17:16 2022] GET /identity/v3/services => generated 1497 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 12:17:17.007205 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9615aaa-2c2c-4cff-bf98-145dbb38ac30 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:17.007672 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9615aaa-2c2c-4cff-bf98-145dbb38ac30 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:17.008043 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9615aaa-2c2c-4cff-bf98-145dbb38ac30 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:17.009718 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 459/920] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:17:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:17:17.015445 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94315def-83a2-4e2a-b8ec-0ba39b65590b None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:17.015725 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94315def-83a2-4e2a-b8ec-0ba39b65590b None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:17.016002 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94315def-83a2-4e2a-b8ec-0ba39b65590b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:17.037349 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-94315def-83a2-4e2a-b8ec-0ba39b65590b None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:17.039568 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-94315def-83a2-4e2a-b8ec-0ba39b65590b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:17.142137 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 462/921] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:17:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:17:17.629652 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9615aaa-2c2c-4cff-bf98-145dbb38ac30 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:17.749338 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9615aaa-2c2c-4cff-bf98-145dbb38ac30 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:17.775380 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:17.788702 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f08b1d-0454-4225-9709-f142346bb46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:17.789345 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f08b1d-0454-4225-9709-f142346bb46f None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:17.789620 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f08b1d-0454-4225-9709-f142346bb46f None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:17.789887 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f08b1d-0454-4225-9709-f142346bb46f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:17.790476 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f08b1d-0454-4225-9709-f142346bb46f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:17.791906 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f08b1d-0454-4225-9709-f142346bb46f None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:17.801625 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-96f08b1d-0454-4225-9709-f142346bb46f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 12:17:17.801625 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:17.801625 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 12:17:17.801625 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 12:17:17.801625 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 12:17:17.801625 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 12:17:17.801625 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 12:17:17.801625 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:17:17.801625 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 12:17:17.801625 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:17:17.801625 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:17:17.801625 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:17:17.801625 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:17.801625 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:17:17.801625 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:17:17.801625 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:17:17.802632 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:17:17.802632 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:17:17.802632 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:17:17.802632 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:17:17.802632 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:17:17.802632 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:17:17.802632 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:17:17.802632 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 12:17:17.802632 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 12:17:17.802632 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 12:17:17.802632 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 12:17:17.802632 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:17:17.802632 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:17:17.802632 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:17:17.802632 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:17:17.802632 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:17:17.802632 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:17:17.803649 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:17:17.803649 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:17:17.803649 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:17:17.803649 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:17:17.803649 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:17:17.803649 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:17:17.803649 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:17:17.803649 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:17:17.803649 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:17:17.803649 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:17:17.803649 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 12:17:17.803649 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:17:17.803649 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 12:17:17.803649 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:17:17.803649 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 460/922] 10.222.0.79 () {56 vars in 1132 bytes} [Wed Aug 31 12:17:17 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:17:17.811732 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94315def-83a2-4e2a-b8ec-0ba39b65590b None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:17.871374 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f292a-399b-4b8f-b381-5d528321dc5c None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:17.871686 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f292a-399b-4b8f-b381-5d528321dc5c None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:17.871911 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f292a-399b-4b8f-b381-5d528321dc5c None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:17.873601 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 461/923] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:17:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:17:17.879135 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f96b4-de09-4b9b-a3d7-39baef48a6cb None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:17.879435 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f96b4-de09-4b9b-a3d7-39baef48a6cb None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:17.879685 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f96b4-de09-4b9b-a3d7-39baef48a6cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:17.900168 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-557f96b4-de09-4b9b-a3d7-39baef48a6cb None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:17.901058 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-557f96b4-de09-4b9b-a3d7-39baef48a6cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:17.931559 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94315def-83a2-4e2a-b8ec-0ba39b65590b None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:17.946070 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:17.976591 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9fa276-68fd-4605-83d5-95ba8f570f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:17.977426 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9fa276-68fd-4605-83d5-95ba8f570f09 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:17.977877 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9fa276-68fd-4605-83d5-95ba8f570f09 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:17.978335 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9fa276-68fd-4605-83d5-95ba8f570f09 None admin] PATH_INFO: `/v3/services` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:17.979699 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9fa276-68fd-4605-83d5-95ba8f570f09 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:17.980675 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9fa276-68fd-4605-83d5-95ba8f570f09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:17.983054 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9fa276-68fd-4605-83d5-95ba8f570f09 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:17.990359 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 462/925] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:17:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:17:17.996216 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 463/925] 10.222.0.79 () {56 vars in 1126 bytes} [Wed Aug 31 12:17:17 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:17.998188 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557f96b4-de09-4b9b-a3d7-39baef48a6cb None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:18.136461 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557f96b4-de09-4b9b-a3d7-39baef48a6cb None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:18.171257 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:18.179869 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc7a02f-82bd-4785-9b9d-d267cd05da51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:18.180499 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc7a02f-82bd-4785-9b9d-d267cd05da51 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:18.180971 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc7a02f-82bd-4785-9b9d-d267cd05da51 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:18.181265 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc7a02f-82bd-4785-9b9d-d267cd05da51 None admin] PATH_INFO: `/v3/services` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:18.182211 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc7a02f-82bd-4785-9b9d-d267cd05da51 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:18.183006 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc7a02f-82bd-4785-9b9d-d267cd05da51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:18.184900 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc7a02f-82bd-4785-9b9d-d267cd05da51 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:18.195021 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 463/926] 10.222.0.79 () {56 vars in 1126 bytes} [Wed Aug 31 12:17:17 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:17:18.196974 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9fa276-68fd-4605-83d5-95ba8f570f09 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:18.260203 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc7a02f-82bd-4785-9b9d-d267cd05da51 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:18.330096 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9fa276-68fd-4605-83d5-95ba8f570f09 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:18.373404 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e01c6ba-3330-476a-9dad-bdfcf8144f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:18.374027 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01c6ba-3330-476a-9dad-bdfcf8144f7b None admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:18.374295 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01c6ba-3330-476a-9dad-bdfcf8144f7b None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:18.374555 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01c6ba-3330-476a-9dad-bdfcf8144f7b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:18.375362 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e01c6ba-3330-476a-9dad-bdfcf8144f7b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:18.376823 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e01c6ba-3330-476a-9dad-bdfcf8144f7b None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:18.389526 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc7a02f-82bd-4785-9b9d-d267cd05da51 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:18.402783 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 464/927] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:17:18 2022] POST /identity/v3/endpoints => generated 347 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:17:18.404241 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f41f33-2d95-4f9b-a566-61bbfe2290ea None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:18.404671 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f41f33-2d95-4f9b-a566-61bbfe2290ea None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:18.405070 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f41f33-2d95-4f9b-a566-61bbfe2290ea None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:18.406762 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 465/928] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:17:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:17:18.414934 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48dd1d2-9fac-4936-86d1-5c288217f5e3 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:18.415888 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48dd1d2-9fac-4936-86d1-5c288217f5e3 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:18.417022 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48dd1d2-9fac-4936-86d1-5c288217f5e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:18.459322 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-c48dd1d2-9fac-4936-86d1-5c288217f5e3 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:18.463186 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-c48dd1d2-9fac-4936-86d1-5c288217f5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:18.479009 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82148ae1-30c3-4c1c-b97d-9b5ad84c3de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:18.480103 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82148ae1-30c3-4c1c-b97d-9b5ad84c3de2 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:18.480583 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82148ae1-30c3-4c1c-b97d-9b5ad84c3de2 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:18.481050 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82148ae1-30c3-4c1c-b97d-9b5ad84c3de2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:18.482372 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82148ae1-30c3-4c1c-b97d-9b5ad84c3de2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:18.484905 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82148ae1-30c3-4c1c-b97d-9b5ad84c3de2 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:18.503866 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-82148ae1-30c3-4c1c-b97d-9b5ad84c3de2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 12:17:18.503866 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:18.503866 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 12:17:18.503866 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 12:17:18.503866 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 12:17:18.503866 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 12:17:18.503866 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 12:17:18.503866 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:17:18.503866 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 12:17:18.503866 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:17:18.503866 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:17:18.503866 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:17:18.503866 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:18.503866 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:17:18.503866 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:17:18.503866 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:17:18.503866 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:17:18.505862 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:17:18.505862 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:17:18.505862 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:17:18.505862 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:17:18.505862 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:17:18.505862 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:17:18.505862 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 12:17:18.505862 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 12:17:18.505862 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 12:17:18.505862 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 12:17:18.505862 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:17:18.505862 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:17:18.505862 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:17:18.505862 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:17:18.505862 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:17:18.505862 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:17:18.508057 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:17:18.508057 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:17:18.508057 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:17:18.508057 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:17:18.508057 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:17:18.508057 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:17:18.508057 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:17:18.508057 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:17:18.508057 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:17:18.508057 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:17:18.508057 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 12:17:18.508057 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:17:18.508057 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 12:17:18.508057 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:17:18.512664 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 464/929] 10.222.0.79 () {56 vars in 1114 bytes} [Wed Aug 31 12:17:18 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:17:18.517198 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82148ae1-30c3-4c1c-b97d-9b5ad84c3de2 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:18.526390 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:18.602584 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:18.626109 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 466/930] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:17:18 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 12:17:18.697964 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82148ae1-30c3-4c1c-b97d-9b5ad84c3de2 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:18.748836 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1435e86-860b-4170-a14c-f7f1ed075d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:18.749456 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1435e86-860b-4170-a14c-f7f1ed075d40 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:18.749769 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1435e86-860b-4170-a14c-f7f1ed075d40 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:18.750049 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1435e86-860b-4170-a14c-f7f1ed075d40 None admin] PATH_INFO: `/v3/services` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:18.750739 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1435e86-860b-4170-a14c-f7f1ed075d40 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:18.751103 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1435e86-860b-4170-a14c-f7f1ed075d40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:18.752909 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1435e86-860b-4170-a14c-f7f1ed075d40 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:18.760221 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 465/931] 10.222.0.79 () {56 vars in 1114 bytes} [Wed Aug 31 12:17:18 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:18.767919 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48dd1d2-9fac-4936-86d1-5c288217f5e3 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:18.895865 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48dd1d2-9fac-4936-86d1-5c288217f5e3 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:18.939095 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd76c82d-4526-45e6-8821-87f5f09161ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:18.939744 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd76c82d-4526-45e6-8821-87f5f09161ee None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:18.940026 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd76c82d-4526-45e6-8821-87f5f09161ee None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:18.940303 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd76c82d-4526-45e6-8821-87f5f09161ee None admin] PATH_INFO: `/v3/services` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:18.940988 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd76c82d-4526-45e6-8821-87f5f09161ee None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:18.941368 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd76c82d-4526-45e6-8821-87f5f09161ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:18.942957 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd76c82d-4526-45e6-8821-87f5f09161ee None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:18.950095 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 467/932] 10.222.0.79 () {56 vars in 1114 bytes} [Wed Aug 31 12:17:18 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:18.959238 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1435e86-860b-4170-a14c-f7f1ed075d40 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:18.985388 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00526caf-cd4f-48f6-ae69-78428dac6351 None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:18.985678 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00526caf-cd4f-48f6-ae69-78428dac6351 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:18.985966 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00526caf-cd4f-48f6-ae69-78428dac6351 None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:18.987638 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 468/933] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:17:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:17:18.996999 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c8dd2-55b8-49d2-936b-08812e6b4c31 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:18.997284 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c8dd2-55b8-49d2-936b-08812e6b4c31 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:18.997589 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c8dd2-55b8-49d2-936b-08812e6b4c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:19.020452 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-3b2c8dd2-55b8-49d2-936b-08812e6b4c31 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:19.021686 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-3b2c8dd2-55b8-49d2-936b-08812e6b4c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:19.045727 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:19.129034 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1435e86-860b-4170-a14c-f7f1ed075d40 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:19.132698 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:19.140124 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 469/934] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:17:18 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 12:17:19.142086 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c8dd2-55b8-49d2-936b-08812e6b4c31 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:19.205891 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb051f3-c3a3-440f-803c-1011b0ebda50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:19.207221 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb051f3-c3a3-440f-803c-1011b0ebda50 None admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:19.207920 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb051f3-c3a3-440f-803c-1011b0ebda50 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:19.208560 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb051f3-c3a3-440f-803c-1011b0ebda50 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:19.210104 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb051f3-c3a3-440f-803c-1011b0ebda50 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:19.213205 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb051f3-c3a3-440f-803c-1011b0ebda50 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:19.255650 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 466/935] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:17:18 2022] POST /identity/v3/endpoints => generated 346 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:17:19.316051 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c8dd2-55b8-49d2-936b-08812e6b4c31 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:19.378715 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9501c7b9-f57f-45ff-b09b-69977f2c0d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:19.379717 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9501c7b9-f57f-45ff-b09b-69977f2c0d6d None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:19.380103 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9501c7b9-f57f-45ff-b09b-69977f2c0d6d None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:19.380463 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9501c7b9-f57f-45ff-b09b-69977f2c0d6d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:19.396122 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9501c7b9-f57f-45ff-b09b-69977f2c0d6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:17:19.402340 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-9501c7b9-f57f-45ff-b09b-69977f2c0d6d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 12:17:19.402340 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:19.402340 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:17:19.402340 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:17:19.402340 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:17:19.402340 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:17:19.402340 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:17:19.402340 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:17:19.402340 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:17:19.402340 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:17:19.402340 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:17:19.402340 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:17:19.402340 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:17:19.402340 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:17:19.402340 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:17:19.402340 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:17:19.404192 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:17:19.404192 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:17:19.404192 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:17:19.404192 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:17:19.404192 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:17:19.404192 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:17:19.404192 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:17:19.404192 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:17:19.404192 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:17:19.404192 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:17:19.404192 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:17:19.404192 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:17:19.404192 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:17:19.404192 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:17:19.404192 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:17:19.404192 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:17:19.405807 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:17:19.405807 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:17:19.405807 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:17:19.405807 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:17:19.405807 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:17:19.405807 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:17:19.405807 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:17:19.405807 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:17:19.405807 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:17:19.405807 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:17:19.405807 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 12:17:19.405807 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:17:19.405807 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 470/936] 10.222.0.79 () {56 vars in 1120 bytes} [Wed Aug 31 12:17:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:17:19.410983 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb051f3-c3a3-440f-803c-1011b0ebda50 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:19.426643 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9501c7b9-f57f-45ff-b09b-69977f2c0d6d None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:19.445859 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:19.570010 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9501c7b9-f57f-45ff-b09b-69977f2c0d6d None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:19.602821 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb051f3-c3a3-440f-803c-1011b0ebda50 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:19.635006 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c8b6aa-96d3-45a7-9c33-7b3545d2bea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:19.636598 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c8b6aa-96d3-45a7-9c33-7b3545d2bea8 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:19.637360 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c8b6aa-96d3-45a7-9c33-7b3545d2bea8 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:19.638146 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c8b6aa-96d3-45a7-9c33-7b3545d2bea8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:19.639665 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c8b6aa-96d3-45a7-9c33-7b3545d2bea8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:19.642491 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c8b6aa-96d3-45a7-9c33-7b3545d2bea8 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:19.645474 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c584693-6e01-4a1c-a9ed-6e0ced7f8f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:19.646184 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c584693-6e01-4a1c-a9ed-6e0ced7f8f5b None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:19.646626 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c584693-6e01-4a1c-a9ed-6e0ced7f8f5b None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:19.646926 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c584693-6e01-4a1c-a9ed-6e0ced7f8f5b None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:19.648285 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c584693-6e01-4a1c-a9ed-6e0ced7f8f5b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:19.648591 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c584693-6e01-4a1c-a9ed-6e0ced7f8f5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:19.650527 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c584693-6e01-4a1c-a9ed-6e0ced7f8f5b None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:19.659939 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 467/937] 10.222.0.79 () {56 vars in 1115 bytes} [Wed Aug 31 12:17:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:19.663189 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-b1c8b6aa-96d3-45a7-9c33-7b3545d2bea8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 12:17:19.663189 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:19.663189 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 12:17:19.663189 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 12:17:19.663189 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 12:17:19.663189 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 12:17:19.663189 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 12:17:19.663189 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:17:19.663189 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 12:17:19.663189 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:17:19.663189 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:17:19.663189 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:17:19.663189 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:19.663189 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:17:19.663189 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:17:19.663189 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:17:19.663189 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:17:19.664967 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:17:19.664967 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:17:19.664967 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:17:19.664967 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:17:19.664967 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:17:19.664967 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:17:19.664967 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 12:17:19.664967 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 12:17:19.664967 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 12:17:19.664967 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 12:17:19.664967 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:17:19.664967 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:17:19.664967 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:17:19.664967 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:17:19.664967 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:17:19.664967 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:17:19.666611 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:17:19.666611 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:17:19.666611 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:17:19.666611 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:17:19.666611 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:17:19.666611 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:17:19.666611 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:17:19.666611 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:17:19.666611 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:17:19.666611 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:17:19.666611 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 12:17:19.666611 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:17:19.666611 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 12:17:19.666611 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:17:19.668880 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 471/938] 10.222.0.79 () {56 vars in 1126 bytes} [Wed Aug 31 12:17:19 2022] GET /identity/v3/services/object-store => generated 93 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:17:19.669568 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c584693-6e01-4a1c-a9ed-6e0ced7f8f5b None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:19.679855 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c8b6aa-96d3-45a7-9c33-7b3545d2bea8 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:19.704122 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:19.804702 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c584693-6e01-4a1c-a9ed-6e0ced7f8f5b None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:19.811389 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:19.843730 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c8b6aa-96d3-45a7-9c33-7b3545d2bea8 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:19.862340 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c13b724-c529-4184-93f2-ea83c9037d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:19.863354 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c13b724-c529-4184-93f2-ea83c9037d88 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:19.864092 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c13b724-c529-4184-93f2-ea83c9037d88 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:19.864431 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c13b724-c529-4184-93f2-ea83c9037d88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:19.880277 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c13b724-c529-4184-93f2-ea83c9037d88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:19.881887 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c13b724-c529-4184-93f2-ea83c9037d88 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:19.883921 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad30cb8-08d0-4e11-af16-a9f8e7ce0a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:19.884656 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad30cb8-08d0-4e11-af16-a9f8e7ce0a75 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:19.884936 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad30cb8-08d0-4e11-af16-a9f8e7ce0a75 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:19.885214 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad30cb8-08d0-4e11-af16-a9f8e7ce0a75 None admin] PATH_INFO: `/v3/services` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:19.885876 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad30cb8-08d0-4e11-af16-a9f8e7ce0a75 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:19.886185 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad30cb8-08d0-4e11-af16-a9f8e7ce0a75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:19.887642 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad30cb8-08d0-4e11-af16-a9f8e7ce0a75 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:19.898798 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 472/939] 10.222.0.79 () {56 vars in 1122 bytes} [Wed Aug 31 12:17:19 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:17:19.899914 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad30cb8-08d0-4e11-af16-a9f8e7ce0a75 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:19.900164 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-9c13b724-c529-4184-93f2-ea83c9037d88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:17:19.900164 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:19.900164 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:17:19.900164 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:17:19.900164 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:17:19.900164 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:17:19.900164 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:17:19.900164 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:17:19.900164 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:17:19.900164 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:17:19.900164 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:17:19.900164 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:17:19.900164 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:17:19.900164 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:17:19.900164 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:17:19.900164 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:17:19.903154 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:17:19.903154 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:17:19.903154 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:17:19.903154 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:17:19.903154 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:17:19.903154 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:17:19.903154 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:17:19.903154 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:17:19.903154 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:17:19.903154 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:17:19.903154 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:17:19.903154 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:17:19.903154 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:17:19.903154 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:17:19.903154 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:17:19.903154 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:17:19.903154 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:17:19.905141 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:17:19.905141 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:17:19.905141 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:17:19.905141 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 468/940] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:17:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:17:19.914993 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c13b724-c529-4184-93f2-ea83c9037d88 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:20.016478 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:20.034597 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad30cb8-08d0-4e11-af16-a9f8e7ce0a75 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:20.046499 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c13b724-c529-4184-93f2-ea83c9037d88 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:20.079993 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fccece8-85cb-4622-9047-d7b356948361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:20.080702 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fccece8-85cb-4622-9047-d7b356948361 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:20.081012 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fccece8-85cb-4622-9047-d7b356948361 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:20.081296 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fccece8-85cb-4622-9047-d7b356948361 None admin] PATH_INFO: `/v3/services` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:20.082382 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fccece8-85cb-4622-9047-d7b356948361 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:20.082695 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fccece8-85cb-4622-9047-d7b356948361 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:20.084772 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fccece8-85cb-4622-9047-d7b356948361 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:20.092524 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b872a330-e578-42a3-878f-fa02cd3833a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:20.093563 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b872a330-e578-42a3-878f-fa02cd3833a7 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:20.094140 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b872a330-e578-42a3-878f-fa02cd3833a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:20.094439 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b872a330-e578-42a3-878f-fa02cd3833a7 None admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:20.094979 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 473/941] 10.222.0.79 () {56 vars in 1122 bytes} [Wed Aug 31 12:17:19 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:20.095226 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b872a330-e578-42a3-878f-fa02cd3833a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:20.095456 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b872a330-e578-42a3-878f-fa02cd3833a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:20.096733 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b872a330-e578-42a3-878f-fa02cd3833a7 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:20.098374 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fccece8-85cb-4622-9047-d7b356948361 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:20.102928 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:20.113350 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 469/942] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 12:17:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:20.119053 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b872a330-e578-42a3-878f-fa02cd3833a7 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:20.221250 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fccece8-85cb-4622-9047-d7b356948361 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:20.238180 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b872a330-e578-42a3-878f-fa02cd3833a7 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:20.268396 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc099fb-86ef-4232-bc3e-a8845d74226b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:20.270118 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc099fb-86ef-4232-bc3e-a8845d74226b None admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:20.270611 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc099fb-86ef-4232-bc3e-a8845d74226b None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:20.271373 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc099fb-86ef-4232-bc3e-a8845d74226b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:20.273074 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc099fb-86ef-4232-bc3e-a8845d74226b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:20.275484 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc099fb-86ef-4232-bc3e-a8845d74226b None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:20.277947 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50681c19-8652-4d85-86a9-4d92f6f9e73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:20.278867 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50681c19-8652-4d85-86a9-4d92f6f9e73c None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:20.279251 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50681c19-8652-4d85-86a9-4d92f6f9e73c None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:20.279585 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50681c19-8652-4d85-86a9-4d92f6f9e73c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:20.282178 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:20.293618 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50681c19-8652-4d85-86a9-4d92f6f9e73c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:20.295693 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50681c19-8652-4d85-86a9-4d92f6f9e73c None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:20.307491 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 474/943] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:17:20 2022] POST /identity/v3/endpoints => generated 349 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:17:20.318034 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-50681c19-8652-4d85-86a9-4d92f6f9e73c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 12:17:20.318034 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:20.318034 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:17:20.318034 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:17:20.318034 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:17:20.318034 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:17:20.318034 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:17:20.318034 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:17:20.318034 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:17:20.318034 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:17:20.318034 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:17:20.318034 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:17:20.318034 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:17:20.318034 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:17:20.318034 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:17:20.318034 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:17:20.319290 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:17:20.319290 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:17:20.319290 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:17:20.319290 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:17:20.319290 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:17:20.319290 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:17:20.319290 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:17:20.319290 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:17:20.319290 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:17:20.319290 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:17:20.319290 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:17:20.319290 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:17:20.319290 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:17:20.319290 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:17:20.319290 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:17:20.319290 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:17:20.319290 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:17:20.319290 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:17:20.320267 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:17:20.320267 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:17:20.320267 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:17:20.320267 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:17:20.320267 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:17:20.320267 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:17:20.320267 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:17:20.320267 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:17:20.320267 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 12:17:20.320267 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:17:20.320267 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 470/944] 10.222.0.79 () {56 vars in 1117 bytes} [Wed Aug 31 12:17:20 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:17:20.320885 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc099fb-86ef-4232-bc3e-a8845d74226b None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:20.399961 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:20.461558 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc099fb-86ef-4232-bc3e-a8845d74226b None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:20.500503 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163d35b0-f7cb-4ec0-b2d5-7c31a1e6e2cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:20.501135 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d35b0-f7cb-4ec0-b2d5-7c31a1e6e2cf None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:20.501416 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d35b0-f7cb-4ec0-b2d5-7c31a1e6e2cf None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:20.501692 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d35b0-f7cb-4ec0-b2d5-7c31a1e6e2cf None admin] PATH_INFO: `/v3/users` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:20.502436 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163d35b0-f7cb-4ec0-b2d5-7c31a1e6e2cf None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:20.502743 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163d35b0-f7cb-4ec0-b2d5-7c31a1e6e2cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:20.504314 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163d35b0-f7cb-4ec0-b2d5-7c31a1e6e2cf None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:20.525388 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 475/945] 10.222.0.79 () {56 vars in 1149 bytes} [Wed Aug 31 12:17:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:20.530551 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50681c19-8652-4d85-86a9-4d92f6f9e73c None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:20.654715 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50681c19-8652-4d85-86a9-4d92f6f9e73c None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:20.693545 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e496f5-9383-4f3e-9d23-f5a270c95844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:20.694816 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e496f5-9383-4f3e-9d23-f5a270c95844 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:20.695134 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e496f5-9383-4f3e-9d23-f5a270c95844 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:20.695454 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e496f5-9383-4f3e-9d23-f5a270c95844 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:20.707640 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e496f5-9383-4f3e-9d23-f5a270c95844 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:20.709361 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e496f5-9383-4f3e-9d23-f5a270c95844 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:20.734038 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-09e496f5-9383-4f3e-9d23-f5a270c95844 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:17:20.734038 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:20.734038 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:17:20.734038 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:17:20.734038 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:17:20.734038 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:17:20.734038 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:17:20.734038 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:17:20.734038 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:17:20.734038 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:17:20.734038 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:17:20.734038 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:17:20.734038 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:17:20.734038 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:17:20.734038 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:17:20.734038 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:17:20.735129 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:17:20.735129 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:17:20.735129 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:17:20.735129 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:17:20.735129 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:17:20.735129 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:17:20.735129 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:17:20.735129 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:17:20.735129 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:17:20.735129 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:17:20.735129 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:17:20.735129 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:17:20.735129 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:17:20.735129 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:17:20.735129 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:17:20.735129 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:17:20.735129 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:17:20.736068 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:17:20.736068 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:17:20.736068 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:17:20.736068 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 471/946] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:17:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:17:20.744094 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163d35b0-f7cb-4ec0-b2d5-7c31a1e6e2cf None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:20.798608 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e3ff83-7776-4076-8d50-e89811e39218 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:20.799259 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e3ff83-7776-4076-8d50-e89811e39218 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:20.799553 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e3ff83-7776-4076-8d50-e89811e39218 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:20.801520 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 472/947] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:17:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:17:20.809894 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c20ab4-bc83-4305-9eea-aab1289cc5fd None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:20.810191 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c20ab4-bc83-4305-9eea-aab1289cc5fd None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:20.810479 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c20ab4-bc83-4305-9eea-aab1289cc5fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:20.832738 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-f9c20ab4-bc83-4305-9eea-aab1289cc5fd None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:20.833961 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-f9c20ab4-bc83-4305-9eea-aab1289cc5fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:20.889494 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:20.905582 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163d35b0-f7cb-4ec0-b2d5-7c31a1e6e2cf None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:20.923270 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 473/948] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:17:20 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 12:17:20.951300 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:20.969846 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b8b377-39fe-404d-9cc5-385f57776afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:20.971013 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b8b377-39fe-404d-9cc5-385f57776afb None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:20.971521 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b8b377-39fe-404d-9cc5-385f57776afb None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:20.971942 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b8b377-39fe-404d-9cc5-385f57776afb None admin] PATH_INFO: `/v3/domains` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:20.973118 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b8b377-39fe-404d-9cc5-385f57776afb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:20.973462 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b8b377-39fe-404d-9cc5-385f57776afb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:20.976144 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b8b377-39fe-404d-9cc5-385f57776afb None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:20.998737 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 476/949] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 12:17:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:21.009101 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c20ab4-bc83-4305-9eea-aab1289cc5fd None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:21.195175 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c20ab4-bc83-4305-9eea-aab1289cc5fd None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:21.233429 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3353a512-f0b7-477b-8d4c-a6dfed84aff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:21.234450 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3353a512-f0b7-477b-8d4c-a6dfed84aff0 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:21.235118 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3353a512-f0b7-477b-8d4c-a6dfed84aff0 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:21.235637 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3353a512-f0b7-477b-8d4c-a6dfed84aff0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:21.243613 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3353a512-f0b7-477b-8d4c-a6dfed84aff0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:21.245372 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3353a512-f0b7-477b-8d4c-a6dfed84aff0 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:21.257539 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-3353a512-f0b7-477b-8d4c-a6dfed84aff0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:17:21.257539 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:21.257539 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:17:21.257539 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:17:21.257539 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:17:21.257539 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:17:21.257539 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:17:21.257539 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:17:21.257539 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:17:21.257539 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:17:21.257539 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:17:21.257539 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:17:21.257539 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:17:21.257539 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:17:21.257539 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:17:21.258487 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:17:21.258487 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:17:21.258487 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:17:21.258487 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:17:21.258487 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:17:21.258487 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:17:21.258487 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:17:21.258487 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:17:21.258487 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:17:21.258487 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:17:21.258487 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:17:21.258487 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:17:21.258487 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:17:21.258487 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:17:21.258487 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:17:21.258487 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:17:21.258487 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:17:21.259875 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:17:21.259875 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:17:21.259875 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:17:21.259875 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:17:21.259875 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:17:21.259875 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:17:21.259875 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:17:21.259875 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:17:21.260794 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b8b377-39fe-404d-9cc5-385f57776afb None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:21.262458 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 474/950] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 12:17:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:17:21.268678 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3353a512-f0b7-477b-8d4c-a6dfed84aff0 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:21.309759 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:21.381367 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3353a512-f0b7-477b-8d4c-a6dfed84aff0 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:21.419570 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851b5502-176d-4187-9ed9-9632c3bb6877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:21.420668 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b5502-176d-4187-9ed9-9632c3bb6877 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:21.421180 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b5502-176d-4187-9ed9-9632c3bb6877 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:21.421664 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b5502-176d-4187-9ed9-9632c3bb6877 None admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:21.422576 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851b5502-176d-4187-9ed9-9632c3bb6877 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:21.423115 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851b5502-176d-4187-9ed9-9632c3bb6877 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:21.424947 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851b5502-176d-4187-9ed9-9632c3bb6877 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:21.443342 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 475/951] 10.222.0.79 () {56 vars in 1148 bytes} [Wed Aug 31 12:17:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:17:21.450730 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851b5502-176d-4187-9ed9-9632c3bb6877 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:21.462353 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b8b377-39fe-404d-9cc5-385f57776afb None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:21.508564 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de3489d-cb5f-4a2f-904f-18cfc3e336ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:21.509382 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de3489d-cb5f-4a2f-904f-18cfc3e336ae None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:21.509665 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de3489d-cb5f-4a2f-904f-18cfc3e336ae None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:21.509938 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de3489d-cb5f-4a2f-904f-18cfc3e336ae None admin] PATH_INFO: `/v3/services/compute` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:21.510680 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de3489d-cb5f-4a2f-904f-18cfc3e336ae None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:21.512286 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de3489d-cb5f-4a2f-904f-18cfc3e336ae None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:21.532741 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-8de3489d-cb5f-4a2f-904f-18cfc3e336ae None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 12:17:21.532741 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:21.532741 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 12:17:21.532741 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 12:17:21.532741 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 12:17:21.532741 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 12:17:21.532741 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 12:17:21.532741 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:17:21.532741 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 12:17:21.532741 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:17:21.532741 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:17:21.532741 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:17:21.532741 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:21.532741 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:17:21.532741 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:17:21.532741 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:17:21.532741 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:17:21.533888 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:17:21.533888 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:17:21.533888 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:17:21.533888 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:17:21.533888 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:17:21.533888 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:17:21.533888 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 12:17:21.533888 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 12:17:21.533888 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 12:17:21.533888 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 12:17:21.533888 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:17:21.533888 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:17:21.533888 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:17:21.533888 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:17:21.533888 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:17:21.533888 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:17:21.534774 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:17:21.534774 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:17:21.534774 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:17:21.534774 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:17:21.534774 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:17:21.534774 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:17:21.534774 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:17:21.534774 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:17:21.534774 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:17:21.534774 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:17:21.534774 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 12:17:21.534774 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:17:21.534774 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 12:17:21.534774 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:17:21.534774 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 477/952] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 12:17:21 2022] GET /identity/v3/services/compute => generated 88 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:17:21.535603 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de3489d-cb5f-4a2f-904f-18cfc3e336ae None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:21.583300 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:21.661128 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:21.663831 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de3489d-cb5f-4a2f-904f-18cfc3e336ae None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:21.674124 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851b5502-176d-4187-9ed9-9632c3bb6877 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:21.711190 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a44ff7e-114d-4465-9231-3def9ca2d28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:21.712471 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a44ff7e-114d-4465-9231-3def9ca2d28e None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:21.712983 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a44ff7e-114d-4465-9231-3def9ca2d28e None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:21.713450 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a44ff7e-114d-4465-9231-3def9ca2d28e None admin] PATH_INFO: `/v3/services` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:21.714291 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a44ff7e-114d-4465-9231-3def9ca2d28e None admin] RBAC: Adding query filter params (name=compute) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:21.714791 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a44ff7e-114d-4465-9231-3def9ca2d28e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:21.716423 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a44ff7e-114d-4465-9231-3def9ca2d28e None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:21.728338 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 478/953] 10.222.0.79 () {56 vars in 1112 bytes} [Wed Aug 31 12:17:21 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:21.729869 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a44ff7e-114d-4465-9231-3def9ca2d28e None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:21.730937 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f30020-e82d-4165-8758-4006165cdf6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:21.731619 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f30020-e82d-4165-8758-4006165cdf6d None admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:21.731934 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f30020-e82d-4165-8758-4006165cdf6d None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:21.732173 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f30020-e82d-4165-8758-4006165cdf6d None admin] PATH_INFO: `/v3/projects/a94f4957f2a047cc844342e1c7c74ca5/users/149aa48acd504354a1d021885ca51334/roles/17ccc8cf2d4146ffa34cbd692c600ff7` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:21.734708 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f30020-e82d-4165-8758-4006165cdf6d None admin] RBAC: Authorizing `identity:create_grant(project_id=a94f4957f2a047cc844342e1c7c74ca5, user_id=149aa48acd504354a1d021885ca51334, role_id=17ccc8cf2d4146ffa34cbd692c600ff7)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:21.737280 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f30020-e82d-4165-8758-4006165cdf6d None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:21.762982 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 476/954] 10.222.0.79 () {58 vars in 1439 bytes} [Wed Aug 31 12:17:21 2022] PUT /identity/v3/projects/a94f4957f2a047cc844342e1c7c74ca5/users/149aa48acd504354a1d021885ca51334/roles/17ccc8cf2d4146ffa34cbd692c600ff7 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:21.894658 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:21.905465 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a44ff7e-114d-4465-9231-3def9ca2d28e None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:21.957593 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9a4b77-02a9-4772-95fa-cc25ca9afd3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:21.958489 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a4b77-02a9-4772-95fa-cc25ca9afd3f None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:21.958576 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a4b77-02a9-4772-95fa-cc25ca9afd3f None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:21.958832 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a4b77-02a9-4772-95fa-cc25ca9afd3f None admin] PATH_INFO: `/v3/services` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:21.959462 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9a4b77-02a9-4772-95fa-cc25ca9afd3f None admin] RBAC: Adding query filter params (type=compute) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:21.960288 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9a4b77-02a9-4772-95fa-cc25ca9afd3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:21.962050 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9a4b77-02a9-4772-95fa-cc25ca9afd3f None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:21.972673 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 479/955] 10.222.0.79 () {56 vars in 1112 bytes} [Wed Aug 31 12:17:21 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:22.124798 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff02499-5e94-4bcf-89f9-ff08ef02b695 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:22.125291 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff02499-5e94-4bcf-89f9-ff08ef02b695 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:22.125669 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff02499-5e94-4bcf-89f9-ff08ef02b695 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:22.128409 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 477/956] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:17:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:17:22.135681 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fed692-da25-4ae1-971d-3277178b67d4 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:22.135681 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fed692-da25-4ae1-971d-3277178b67d4 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:22.135681 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fed692-da25-4ae1-971d-3277178b67d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:22.158275 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-55fed692-da25-4ae1-971d-3277178b67d4 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:22.159955 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-55fed692-da25-4ae1-971d-3277178b67d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:22.251113 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 480/957] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:17:22 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 12:17:22.422912 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b1120-3599-4494-bf3c-6787a7b7df4b None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:22.423724 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b1120-3599-4494-bf3c-6787a7b7df4b None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:22.424226 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b1120-3599-4494-bf3c-6787a7b7df4b None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:22.426287 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 478/958] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:17:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:17:22.432346 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c4d89-8f2c-4036-be30-52b6c32b1ab5 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:22.432659 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c4d89-8f2c-4036-be30-52b6c32b1ab5 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:22.433025 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c4d89-8f2c-4036-be30-52b6c32b1ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:22.462670 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-135c4d89-8f2c-4036-be30-52b6c32b1ab5 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:22.464018 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-135c4d89-8f2c-4036-be30-52b6c32b1ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:22.545341 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 481/959] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:17:22 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:17:22.554843 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b1120-3599-4494-bf3c-6787a7b7df4b None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:22.692302 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b1120-3599-4494-bf3c-6787a7b7df4b None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:22.734700 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea863c12-28f2-42f3-b5d2-9b470cedfd96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:22.736174 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea863c12-28f2-42f3-b5d2-9b470cedfd96 None admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:22.736686 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea863c12-28f2-42f3-b5d2-9b470cedfd96 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:22.737175 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea863c12-28f2-42f3-b5d2-9b470cedfd96 None admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:22.738061 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea863c12-28f2-42f3-b5d2-9b470cedfd96 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:22.739778 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea863c12-28f2-42f3-b5d2-9b470cedfd96 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:22.743459 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: WARNING keystone.server.flask.common [None req-ea863c12-28f2-42f3-b5d2-9b470cedfd96 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 31 12:17:22.764658 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.sql.core [None req-ea863c12-28f2-42f3-b5d2-9b470cedfd96 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 31 12:17:22.764658 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 31 12:17:22.764658 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [parameters: {'id': 'a41a513448a94341985895f067d0eca4', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 31 12:17:22.764658 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81496) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 31 12:17:22.783937 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-ea863c12-28f2-42f3-b5d2-9b470cedfd96 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a41a513448a94341985895f067d0eca4.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a41a513448a94341985895f067d0eca4. Aug 31 12:17:22.783937 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:22.783937 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 12:17:22.783937 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 12:17:22.783937 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 12:17:22.783937 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 12:17:22.783937 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 12:17:22.783937 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 12:17:22.783937 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 12:17:22.783937 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application conn.query(q) Aug 31 12:17:22.783937 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 12:17:22.783937 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 12:17:22.783937 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 12:17:22.784849 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application result.read() Aug 31 12:17:22.784849 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 12:17:22.784849 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 12:17:22.784849 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 12:17:22.784849 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 12:17:22.784849 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 12:17:22.784849 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 12:17:22.784849 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 12:17:22.784849 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 12:17:22.784849 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 31 12:17:22.784849 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:17:22.784849 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 31 12:17:22.784849 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:17:22.784849 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:22.784849 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 31 12:17:22.784849 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 31 12:17:22.784849 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 31 12:17:22.784849 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 31 12:17:22.785849 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 12:17:22.785849 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application next(self.gen) Aug 31 12:17:22.785849 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 31 12:17:22.785849 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application yield resource Aug 31 12:17:22.785849 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 12:17:22.785849 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application next(self.gen) Aug 31 12:17:22.785849 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 31 12:17:22.785849 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application self.session.rollback() Aug 31 12:17:22.785849 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 12:17:22.785849 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application self.force_reraise() Aug 31 12:17:22.785849 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 12:17:22.785849 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise self.value Aug 31 12:17:22.785849 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 31 12:17:22.785849 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 31 12:17:22.785849 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 31 12:17:22.785849 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application session.commit() Aug 31 12:17:22.785849 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 31 12:17:22.786889 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 31 12:17:22.786889 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 31 12:17:22.786889 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application self._prepare_impl() Aug 31 12:17:22.786889 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 31 12:17:22.786889 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application self.session.flush() Aug 31 12:17:22.786889 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 31 12:17:22.786889 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application self._flush(objects) Aug 31 12:17:22.786889 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 31 12:17:22.786889 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 31 12:17:22.786889 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 31 12:17:22.786889 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application compat.raise_( Aug 31 12:17:22.786889 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 12:17:22.786889 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception Aug 31 12:17:22.786889 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 31 12:17:22.786889 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application flush_context.execute() Aug 31 12:17:22.786889 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 31 12:17:22.786889 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rec.execute(self) Aug 31 12:17:22.789869 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 31 12:17:22.789869 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 31 12:17:22.789869 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 31 12:17:22.789869 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 31 12:17:22.789869 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 31 12:17:22.789869 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 31 12:17:22.789869 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 31 12:17:22.789869 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 31 12:17:22.789869 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 31 12:17:22.789869 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 31 12:17:22.789869 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 31 12:17:22.789869 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 31 12:17:22.789869 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 31 12:17:22.789869 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 31 12:17:22.789869 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 31 12:17:22.791120 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 31 12:17:22.791120 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 12:17:22.791120 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception Aug 31 12:17:22.791120 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 12:17:22.791120 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 12:17:22.791120 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 12:17:22.791120 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 12:17:22.791120 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 12:17:22.791120 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 12:17:22.791120 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 12:17:22.791120 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application conn.query(q) Aug 31 12:17:22.791120 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 12:17:22.791120 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 12:17:22.791120 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 12:17:22.791120 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application result.read() Aug 31 12:17:22.791120 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 12:17:22.791120 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 12:17:22.793356 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 12:17:22.793356 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 12:17:22.793356 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 12:17:22.793356 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 12:17:22.793356 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 12:17:22.793356 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 12:17:22.793356 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 31 12:17:22.793356 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 31 12:17:22.793356 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [parameters: {'id': 'a41a513448a94341985895f067d0eca4', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 31 12:17:22.793356 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 31 12:17:22.793356 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:17:22.793356 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:17:22.793356 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:17:22.793356 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:22.793356 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 31 12:17:22.795537 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 31 12:17:22.795537 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 31 12:17:22.795537 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 31 12:17:22.795537 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 31 12:17:22.795537 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:17:22.795537 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:17:22.795537 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:17:22.795537 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:22.795537 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:17:22.795537 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:17:22.795537 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:17:22.795537 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:17:22.795537 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:17:22.795537 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:17:22.795537 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:17:22.795537 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:17:22.795537 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:17:22.799287 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:17:22.799287 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 31 12:17:22.799287 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 31 12:17:22.799287 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:17:22.799287 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:17:22.799287 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 31 12:17:22.799287 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 31 12:17:22.799287 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a41a513448a94341985895f067d0eca4. Aug 31 12:17:22.799287 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:17:22.807129 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 479/960] 10.222.0.79 () {60 vars in 1140 bytes} [Wed Aug 31 12:17:22 2022] POST /identity/v3/projects => generated 262 bytes in 247 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:17:22.809362 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135c4d89-8f2c-4036-be30-52b6c32b1ab5 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:22.831476 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea863c12-28f2-42f3-b5d2-9b470cedfd96 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:22.837378 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:22.854935 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:22.940279 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135c4d89-8f2c-4036-be30-52b6c32b1ab5 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:22.969070 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea863c12-28f2-42f3-b5d2-9b470cedfd96 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:22.984180 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c20e6e8-15ad-4792-8f25-ec3a94d0d250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:22.984849 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c20e6e8-15ad-4792-8f25-ec3a94d0d250 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:22.985130 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c20e6e8-15ad-4792-8f25-ec3a94d0d250 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:22.985507 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c20e6e8-15ad-4792-8f25-ec3a94d0d250 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:22.994693 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c20e6e8-15ad-4792-8f25-ec3a94d0d250 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:22.996278 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c20e6e8-15ad-4792-8f25-ec3a94d0d250 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:23.010246 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-6c20e6e8-15ad-4792-8f25-ec3a94d0d250 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:17:23.010246 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:23.010246 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:17:23.010246 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:17:23.010246 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:17:23.010246 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:17:23.010246 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:17:23.010246 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:17:23.010246 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:17:23.010246 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:17:23.010246 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:17:23.010246 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:17:23.010246 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:17:23.010246 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:17:23.010246 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:17:23.011264 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:17:23.011264 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:17:23.011264 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:17:23.011264 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:17:23.011264 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:17:23.011264 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:17:23.011264 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:17:23.011264 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:17:23.011264 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:17:23.011264 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:17:23.011264 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:17:23.011264 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:17:23.011264 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:17:23.011264 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:17:23.011264 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:17:23.011264 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:17:23.011264 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:17:23.012278 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:17:23.012278 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:17:23.012278 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:17:23.012278 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:17:23.012278 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:17:23.012278 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:17:23.012278 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:17:23.012278 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:17:23.016646 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 482/961] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 12:17:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:17:23.017732 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c20e6e8-15ad-4792-8f25-ec3a94d0d250 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:23.019411 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0620f98-7728-4b57-b37f-4a4fdf801170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:23.020685 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0620f98-7728-4b57-b37f-4a4fdf801170 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:23.021289 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0620f98-7728-4b57-b37f-4a4fdf801170 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:23.021825 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0620f98-7728-4b57-b37f-4a4fdf801170 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:23.023515 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0620f98-7728-4b57-b37f-4a4fdf801170 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:23.025442 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0620f98-7728-4b57-b37f-4a4fdf801170 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:23.036553 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-d0620f98-7728-4b57-b37f-4a4fdf801170 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 12:17:23.036553 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:23.036553 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 12:17:23.036553 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 12:17:23.036553 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 12:17:23.036553 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 12:17:23.036553 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 12:17:23.036553 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:17:23.036553 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 12:17:23.036553 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:17:23.036553 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:17:23.036553 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:17:23.036553 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:23.036553 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:17:23.036553 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:17:23.036553 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:17:23.036553 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:17:23.037716 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:17:23.037716 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:17:23.037716 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:17:23.037716 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:17:23.037716 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:17:23.037716 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:17:23.037716 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 12:17:23.037716 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 12:17:23.037716 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 12:17:23.037716 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 12:17:23.037716 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:17:23.037716 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:17:23.037716 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:17:23.037716 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:17:23.037716 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:17:23.037716 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:17:23.039860 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:17:23.039860 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:17:23.039860 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:17:23.039860 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:17:23.039860 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:17:23.039860 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:17:23.039860 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:17:23.039860 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:17:23.039860 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:17:23.039860 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:17:23.039860 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 12:17:23.039860 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:17:23.039860 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 12:17:23.039860 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:17:23.043047 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 480/962] 10.222.0.79 () {56 vars in 1126 bytes} [Wed Aug 31 12:17:22 2022] GET /identity/v3/services/object-store => generated 93 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:17:23.049288 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0620f98-7728-4b57-b37f-4a4fdf801170 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:23.140763 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:23.170518 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:23.171953 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c20e6e8-15ad-4792-8f25-ec3a94d0d250 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:23.211516 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0620f98-7728-4b57-b37f-4a4fdf801170 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:23.219474 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ae8353-e79a-4086-8cd1-00a461558042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:23.220542 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ae8353-e79a-4086-8cd1-00a461558042 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:23.221265 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ae8353-e79a-4086-8cd1-00a461558042 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:23.221813 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ae8353-e79a-4086-8cd1-00a461558042 None admin] PATH_INFO: `/v3/projects` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:23.223116 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ae8353-e79a-4086-8cd1-00a461558042 None admin] RBAC: Adding query filter params (name=service) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:23.223640 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ae8353-e79a-4086-8cd1-00a461558042 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:23.226099 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ae8353-e79a-4086-8cd1-00a461558042 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:23.252705 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d01def-685d-4c2c-977a-6805fa94049c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:23.253315 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d01def-685d-4c2c-977a-6805fa94049c None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:23.253592 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d01def-685d-4c2c-977a-6805fa94049c None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:23.253861 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d01def-685d-4c2c-977a-6805fa94049c None admin] PATH_INFO: `/v3/services` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:23.254491 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d01def-685d-4c2c-977a-6805fa94049c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:23.254830 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d01def-685d-4c2c-977a-6805fa94049c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:23.257587 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d01def-685d-4c2c-977a-6805fa94049c None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:23.263238 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 483/963] 10.222.0.79 () {56 vars in 1112 bytes} [Wed Aug 31 12:17:23 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:23.266226 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 481/964] 10.222.0.79 () {56 vars in 1122 bytes} [Wed Aug 31 12:17:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:17:23.276255 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ae8353-e79a-4086-8cd1-00a461558042 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:23.451919 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ae8353-e79a-4086-8cd1-00a461558042 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:23.492298 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7725e8-1214-4ba1-be72-105de7353bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:23.493662 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7725e8-1214-4ba1-be72-105de7353bf9 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:23.494124 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7725e8-1214-4ba1-be72-105de7353bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:23.494548 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7725e8-1214-4ba1-be72-105de7353bf9 None admin] PATH_INFO: `/v3/services` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:23.495430 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7725e8-1214-4ba1-be72-105de7353bf9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:23.495886 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7725e8-1214-4ba1-be72-105de7353bf9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:23.497452 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7725e8-1214-4ba1-be72-105de7353bf9 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:23.503589 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 484/965] 10.222.0.79 () {56 vars in 1122 bytes} [Wed Aug 31 12:17:23 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:23.509419 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d01def-685d-4c2c-977a-6805fa94049c None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:23.656750 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d01def-685d-4c2c-977a-6805fa94049c None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:23.719959 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1747da83-0163-4d1d-90bd-03a4f7302bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:23.721285 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1747da83-0163-4d1d-90bd-03a4f7302bd6 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:23.721956 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1747da83-0163-4d1d-90bd-03a4f7302bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:23.722643 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1747da83-0163-4d1d-90bd-03a4f7302bd6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:23.724187 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1747da83-0163-4d1d-90bd-03a4f7302bd6 None admin] RBAC: Adding query filter params (interface=admin, service_id=56798a797f6641d3842ce10cf50aff60, region_id=RegionOne) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:23.724968 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1747da83-0163-4d1d-90bd-03a4f7302bd6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:23.728161 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1747da83-0163-4d1d-90bd-03a4f7302bd6 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:23.738142 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 482/966] 10.222.0.79 () {56 vars in 1249 bytes} [Wed Aug 31 12:17:23 2022] GET /identity/v3/endpoints?service_id=56798a797f6641d3842ce10cf50aff60&interface=admin®ion_id=RegionOne => generated 193 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:23.748707 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7725e8-1214-4ba1-be72-105de7353bf9 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:23.761614 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:23.865867 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7725e8-1214-4ba1-be72-105de7353bf9 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:23.906224 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710e1d5a-6b10-4b88-8bc0-68da31d4fcef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:23.907260 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e1d5a-6b10-4b88-8bc0-68da31d4fcef None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:23.907747 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e1d5a-6b10-4b88-8bc0-68da31d4fcef None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:23.908318 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e1d5a-6b10-4b88-8bc0-68da31d4fcef None admin] PATH_INFO: `/v3/services` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:23.909126 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710e1d5a-6b10-4b88-8bc0-68da31d4fcef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:23.910696 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710e1d5a-6b10-4b88-8bc0-68da31d4fcef None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:23.919166 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 485/967] 10.222.0.79 () {56 vars in 1087 bytes} [Wed Aug 31 12:17:23 2022] GET /identity/v3/services => generated 1497 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:17:24.049658 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cad280-63a5-4320-a83e-7c25348f97cd None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:24.050251 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cad280-63a5-4320-a83e-7c25348f97cd None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:24.050570 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cad280-63a5-4320-a83e-7c25348f97cd None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:24.052035 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 483/968] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:17:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:17:24.058264 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191fd2a5-92ee-468c-a3ad-e4aa18db8e0e None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:24.058661 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191fd2a5-92ee-468c-a3ad-e4aa18db8e0e None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:24.058992 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191fd2a5-92ee-468c-a3ad-e4aa18db8e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:24.080544 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-191fd2a5-92ee-468c-a3ad-e4aa18db8e0e None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:24.081783 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-191fd2a5-92ee-468c-a3ad-e4aa18db8e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:24.163028 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 486/969] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:17:24 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:17:24.280374 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01da8e3-e293-40be-ab39-56980eb5eca1 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:24.280665 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01da8e3-e293-40be-ab39-56980eb5eca1 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:24.280913 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01da8e3-e293-40be-ab39-56980eb5eca1 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:24.282261 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 484/970] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:17:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:17:24.288237 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca2892-a525-4e5f-8264-9e05b42de66c None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:24.288740 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca2892-a525-4e5f-8264-9e05b42de66c None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:24.289121 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca2892-a525-4e5f-8264-9e05b42de66c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:24.295764 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:24.311019 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-daca2892-a525-4e5f-8264-9e05b42de66c None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:24.312220 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-daca2892-a525-4e5f-8264-9e05b42de66c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:24.413948 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 487/971] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:17:24 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 12:17:24.551027 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01da8e3-e293-40be-ab39-56980eb5eca1 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:24.557371 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:24.698107 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01da8e3-e293-40be-ab39-56980eb5eca1 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:24.735135 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f187d03a-514e-4a9f-9641-cc6e656998e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:24.735776 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187d03a-514e-4a9f-9641-cc6e656998e9 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:24.736049 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187d03a-514e-4a9f-9641-cc6e656998e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:24.736318 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187d03a-514e-4a9f-9641-cc6e656998e9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:24.749464 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f187d03a-514e-4a9f-9641-cc6e656998e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:17:24.754566 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-f187d03a-514e-4a9f-9641-cc6e656998e9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 12:17:24.754566 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:24.754566 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:17:24.754566 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:17:24.754566 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:17:24.754566 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:17:24.754566 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:17:24.754566 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:17:24.754566 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:17:24.754566 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:17:24.754566 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:17:24.754566 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:17:24.754566 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:17:24.754566 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:17:24.754566 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:17:24.754566 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:17:24.755674 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:17:24.755674 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:17:24.755674 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:17:24.755674 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:17:24.755674 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:17:24.755674 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:17:24.755674 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:17:24.755674 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:17:24.755674 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:17:24.755674 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:17:24.755674 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:17:24.755674 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:17:24.755674 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:17:24.755674 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:17:24.755674 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:17:24.755674 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:17:24.756526 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:17:24.756526 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:17:24.756526 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:17:24.756526 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:17:24.756526 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:17:24.756526 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:17:24.756526 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:17:24.756526 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:17:24.756526 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:17:24.756526 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:17:24.756526 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 12:17:24.756526 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:17:24.756526 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 485/972] 10.222.0.79 () {56 vars in 1120 bytes} [Wed Aug 31 12:17:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:17:24.764721 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daca2892-a525-4e5f-8264-9e05b42de66c None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:24.791413 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f187d03a-514e-4a9f-9641-cc6e656998e9 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:24.885835 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:24.886100 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daca2892-a525-4e5f-8264-9e05b42de66c None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:24.923380 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:24.930198 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58be2414-1c04-4b98-9b53-59624379b3c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:24.931285 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58be2414-1c04-4b98-9b53-59624379b3c8 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:24.931567 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58be2414-1c04-4b98-9b53-59624379b3c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:24.931834 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58be2414-1c04-4b98-9b53-59624379b3c8 None admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:24.932810 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58be2414-1c04-4b98-9b53-59624379b3c8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:24.933111 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58be2414-1c04-4b98-9b53-59624379b3c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:24.934687 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58be2414-1c04-4b98-9b53-59624379b3c8 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:24.946324 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 488/973] 10.222.0.79 () {56 vars in 1115 bytes} [Wed Aug 31 12:17:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:24.955925 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58be2414-1c04-4b98-9b53-59624379b3c8 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:24.962200 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f187d03a-514e-4a9f-9641-cc6e656998e9 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:25.010047 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f43ae-8c93-4706-9ff8-c7f5a1c192fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:25.011104 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f43ae-8c93-4706-9ff8-c7f5a1c192fe None admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:25.011933 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f43ae-8c93-4706-9ff8-c7f5a1c192fe None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:25.013651 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f43ae-8c93-4706-9ff8-c7f5a1c192fe None admin] PATH_INFO: `/v3/services` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:25.014934 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442f43ae-8c93-4706-9ff8-c7f5a1c192fe None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:25.017546 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442f43ae-8c93-4706-9ff8-c7f5a1c192fe None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:25.053269 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 486/974] 10.222.0.79 () {60 vars in 1141 bytes} [Wed Aug 31 12:17:24 2022] POST /identity/v3/services => generated 242 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:17:25.113076 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58be2414-1c04-4b98-9b53-59624379b3c8 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:25.169050 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1520abf-a803-48c4-8399-137749824f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:25.169804 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1520abf-a803-48c4-8399-137749824f6a None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:25.170072 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1520abf-a803-48c4-8399-137749824f6a None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:25.170354 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1520abf-a803-48c4-8399-137749824f6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:25.183633 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1520abf-a803-48c4-8399-137749824f6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:25.185264 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1520abf-a803-48c4-8399-137749824f6a None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:25.211296 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-f1520abf-a803-48c4-8399-137749824f6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:17:25.211296 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:25.211296 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:17:25.211296 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:17:25.211296 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:17:25.211296 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:17:25.211296 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:17:25.211296 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:17:25.211296 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:17:25.211296 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:17:25.211296 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:17:25.211296 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:17:25.211296 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:17:25.211296 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:17:25.211296 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:17:25.211296 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:17:25.213398 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:17:25.213398 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:17:25.213398 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:17:25.213398 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:17:25.213398 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:17:25.213398 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:17:25.213398 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:17:25.213398 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:17:25.213398 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:17:25.213398 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:17:25.213398 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:17:25.213398 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:17:25.213398 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:17:25.213398 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:17:25.213398 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:17:25.213398 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:17:25.213398 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:17:25.215003 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:17:25.215003 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:17:25.215003 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:17:25.215003 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 489/975] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:17:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:17:25.220074 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f43ae-8c93-4706-9ff8-c7f5a1c192fe None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:25.348968 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f43ae-8c93-4706-9ff8-c7f5a1c192fe None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:25.380155 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:25.400702 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1415828f-a725-4e7f-8f23-e720a74c70f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:25.401327 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1415828f-a725-4e7f-8f23-e720a74c70f0 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:25.401615 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1415828f-a725-4e7f-8f23-e720a74c70f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:25.401891 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1415828f-a725-4e7f-8f23-e720a74c70f0 None admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:25.402559 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1415828f-a725-4e7f-8f23-e720a74c70f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:25.402874 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1415828f-a725-4e7f-8f23-e720a74c70f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:25.404290 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1415828f-a725-4e7f-8f23-e720a74c70f0 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:25.423228 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 487/976] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 12:17:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:25.424944 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1520abf-a803-48c4-8399-137749824f6a None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:25.478303 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:25.551502 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1520abf-a803-48c4-8399-137749824f6a None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:25.592109 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af78985-9c2b-4a3a-a011-14891395fd13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:25.592759 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af78985-9c2b-4a3a-a011-14891395fd13 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:25.593045 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af78985-9c2b-4a3a-a011-14891395fd13 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:25.593322 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af78985-9c2b-4a3a-a011-14891395fd13 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:25.602467 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af78985-9c2b-4a3a-a011-14891395fd13 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:25.603981 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af78985-9c2b-4a3a-a011-14891395fd13 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:25.618575 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-5af78985-9c2b-4a3a-a011-14891395fd13 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 12:17:25.618575 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:25.618575 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:17:25.618575 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:17:25.618575 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:17:25.618575 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:17:25.618575 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:17:25.618575 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:17:25.618575 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:17:25.618575 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:17:25.618575 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:17:25.618575 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:17:25.618575 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:17:25.618575 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:17:25.618575 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:17:25.618575 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:17:25.619772 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:17:25.619772 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:17:25.619772 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:17:25.619772 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:17:25.619772 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:17:25.619772 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:17:25.619772 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:17:25.619772 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:17:25.619772 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:17:25.619772 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:17:25.619772 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:17:25.619772 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:17:25.619772 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:17:25.619772 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:17:25.619772 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:17:25.619772 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:17:25.619772 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:17:25.619772 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:17:25.620795 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:17:25.620795 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:17:25.620795 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:17:25.620795 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:17:25.620795 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:17:25.620795 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:17:25.620795 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:17:25.620795 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:17:25.620795 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 12:17:25.620795 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:17:25.624677 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 490/977] 10.222.0.79 () {56 vars in 1117 bytes} [Wed Aug 31 12:17:25 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:17:25.626078 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1415828f-a725-4e7f-8f23-e720a74c70f0 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:25.747797 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1415828f-a725-4e7f-8f23-e720a74c70f0 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:25.789852 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9fb92b-6a59-42a8-9729-74f0fec1f357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:25.791421 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9fb92b-6a59-42a8-9729-74f0fec1f357 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:25.791957 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9fb92b-6a59-42a8-9729-74f0fec1f357 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:25.792449 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9fb92b-6a59-42a8-9729-74f0fec1f357 None admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:25.793412 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9fb92b-6a59-42a8-9729-74f0fec1f357 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:25.793992 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9fb92b-6a59-42a8-9729-74f0fec1f357 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:25.795729 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9fb92b-6a59-42a8-9729-74f0fec1f357 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:25.818040 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 488/978] 10.222.0.79 () {56 vars in 1149 bytes} [Wed Aug 31 12:17:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:25.824322 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af78985-9c2b-4a3a-a011-14891395fd13 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:25.833260 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3711fb7-2371-4c97-b5ae-1b80717ef9eb None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:25.833582 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3711fb7-2371-4c97-b5ae-1b80717ef9eb None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:25.833859 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3711fb7-2371-4c97-b5ae-1b80717ef9eb None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:25.836303 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 489/979] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:17:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:17:25.842081 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0870e44-ffa3-4985-9ec5-bd5f5a3cb9ff None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:25.842365 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0870e44-ffa3-4985-9ec5-bd5f5a3cb9ff None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:25.842639 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0870e44-ffa3-4985-9ec5-bd5f5a3cb9ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:25.862956 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-b0870e44-ffa3-4985-9ec5-bd5f5a3cb9ff None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:25.865206 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-b0870e44-ffa3-4985-9ec5-bd5f5a3cb9ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:25.908254 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:25.950566 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af78985-9c2b-4a3a-a011-14891395fd13 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:25.952730 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:25.953679 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 490/980] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:17:25 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 12:17:25.994250 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dac6a2b-b805-4b6b-8259-b577d88fefd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:25.995100 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac6a2b-b805-4b6b-8259-b577d88fefd4 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:25.995484 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac6a2b-b805-4b6b-8259-b577d88fefd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:25.995855 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac6a2b-b805-4b6b-8259-b577d88fefd4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:26.075002 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dac6a2b-b805-4b6b-8259-b577d88fefd4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:26.076484 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dac6a2b-b805-4b6b-8259-b577d88fefd4 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:26.195082 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 491/981] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 12:17:25 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 12:17:26.198185 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0870e44-ffa3-4985-9ec5-bd5f5a3cb9ff None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:26.202781 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86805c8-a326-4bf0-96fa-dab78c4588a0 None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:26.203145 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86805c8-a326-4bf0-96fa-dab78c4588a0 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:26.203401 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86805c8-a326-4bf0-96fa-dab78c4588a0 None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:26.205465 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 492/982] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:17:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:17:26.211484 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3580c9-8def-4a52-b3cb-3dabcbe06f24 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:26.212072 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3580c9-8def-4a52-b3cb-3dabcbe06f24 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:26.212306 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3580c9-8def-4a52-b3cb-3dabcbe06f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:26.220063 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:26.233531 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-2e3580c9-8def-4a52-b3cb-3dabcbe06f24 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:26.234809 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-2e3580c9-8def-4a52-b3cb-3dabcbe06f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:26.328719 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 493/983] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:17:26 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 12:17:26.329892 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3580c9-8def-4a52-b3cb-3dabcbe06f24 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:26.400554 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0870e44-ffa3-4985-9ec5-bd5f5a3cb9ff None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:26.468144 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f140d653-5ad4-4d13-b301-d96b81abbe9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:26.469730 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140d653-5ad4-4d13-b301-d96b81abbe9c None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:26.470413 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140d653-5ad4-4d13-b301-d96b81abbe9c None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:26.471071 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140d653-5ad4-4d13-b301-d96b81abbe9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:26.486959 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f140d653-5ad4-4d13-b301-d96b81abbe9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:26.489155 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f140d653-5ad4-4d13-b301-d96b81abbe9c None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:26.511411 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-f140d653-5ad4-4d13-b301-d96b81abbe9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:17:26.511411 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:26.511411 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:17:26.511411 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:17:26.511411 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:17:26.511411 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:17:26.511411 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:17:26.511411 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:17:26.511411 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:17:26.511411 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:17:26.511411 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:17:26.511411 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:17:26.511411 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:17:26.511411 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:17:26.511411 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:17:26.511411 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:17:26.513054 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:17:26.513054 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:17:26.513054 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:17:26.513054 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:17:26.513054 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:17:26.513054 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:17:26.513054 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:17:26.513054 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:17:26.513054 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:17:26.513054 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:17:26.513054 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:17:26.513054 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:17:26.513054 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:17:26.513054 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:17:26.513054 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:17:26.513054 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:17:26.513054 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:17:26.513974 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:17:26.513974 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:17:26.513974 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:17:26.517088 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 491/984] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:17:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:17:26.526279 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f140d653-5ad4-4d13-b301-d96b81abbe9c None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:26.544594 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3580c9-8def-4a52-b3cb-3dabcbe06f24 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:26.555633 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:26.629822 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:26.639403 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b683a4-52bb-46b3-b005-68be0e7709fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:26.640918 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b683a4-52bb-46b3-b005-68be0e7709fb None admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:26.641218 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b683a4-52bb-46b3-b005-68be0e7709fb None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:26.641465 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b683a4-52bb-46b3-b005-68be0e7709fb None admin] PATH_INFO: `/v3/users` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:26.642150 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b683a4-52bb-46b3-b005-68be0e7709fb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:26.644749 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b683a4-52bb-46b3-b005-68be0e7709fb None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:26.648318 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: WARNING keystone.server.flask.common [None req-c5b683a4-52bb-46b3-b005-68be0e7709fb None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 31 12:17:26.662264 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.sql.core [None req-c5b683a4-52bb-46b3-b005-68be0e7709fb None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 31 12:17:26.662264 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 31 12:17:26.662264 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [parameters: {'user_id': 'ca35439949f4423cbb3addd6c6c54586', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 31 12:17:26.662264 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81495) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 31 12:17:26.669798 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-c5b683a4-52bb-46b3-b005-68be0e7709fb None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 31 12:17:26.669798 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:26.669798 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 12:17:26.669798 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 12:17:26.669798 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 12:17:26.669798 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 12:17:26.669798 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 12:17:26.669798 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 12:17:26.669798 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 12:17:26.669798 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application conn.query(q) Aug 31 12:17:26.669798 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 12:17:26.669798 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 12:17:26.669798 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 12:17:26.669798 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application result.read() Aug 31 12:17:26.669798 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 12:17:26.671005 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 12:17:26.671005 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 12:17:26.671005 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 12:17:26.671005 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 12:17:26.671005 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 12:17:26.671005 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 12:17:26.671005 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 12:17:26.671005 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 31 12:17:26.671005 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:17:26.671005 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 31 12:17:26.671005 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:17:26.671005 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:26.671005 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 31 12:17:26.671005 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 31 12:17:26.671005 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 31 12:17:26.671005 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 31 12:17:26.671005 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 12:17:26.671005 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application next(self.gen) Aug 31 12:17:26.673651 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 31 12:17:26.673651 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application yield resource Aug 31 12:17:26.673651 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 12:17:26.673651 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application next(self.gen) Aug 31 12:17:26.673651 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 31 12:17:26.673651 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application self.session.rollback() Aug 31 12:17:26.673651 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 12:17:26.673651 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application self.force_reraise() Aug 31 12:17:26.673651 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 12:17:26.673651 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise self.value Aug 31 12:17:26.673651 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 31 12:17:26.673651 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 31 12:17:26.673651 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 31 12:17:26.673651 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application session.commit() Aug 31 12:17:26.673651 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 31 12:17:26.673651 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 31 12:17:26.673651 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 31 12:17:26.675232 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application self._prepare_impl() Aug 31 12:17:26.675232 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 31 12:17:26.675232 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application self.session.flush() Aug 31 12:17:26.675232 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 31 12:17:26.675232 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application self._flush(objects) Aug 31 12:17:26.675232 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 31 12:17:26.675232 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 31 12:17:26.675232 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 31 12:17:26.675232 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application compat.raise_( Aug 31 12:17:26.675232 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 12:17:26.675232 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception Aug 31 12:17:26.675232 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 31 12:17:26.675232 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application flush_context.execute() Aug 31 12:17:26.675232 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 31 12:17:26.675232 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rec.execute(self) Aug 31 12:17:26.675232 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 31 12:17:26.675232 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 31 12:17:26.677420 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 31 12:17:26.677420 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 31 12:17:26.677420 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 31 12:17:26.677420 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 31 12:17:26.677420 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 31 12:17:26.677420 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 31 12:17:26.677420 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 31 12:17:26.677420 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 31 12:17:26.677420 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 31 12:17:26.677420 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 31 12:17:26.677420 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 31 12:17:26.677420 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 31 12:17:26.677420 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 31 12:17:26.677420 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 31 12:17:26.677420 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 12:17:26.677420 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception Aug 31 12:17:26.680346 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 12:17:26.680346 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 12:17:26.680346 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 12:17:26.680346 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 12:17:26.680346 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 12:17:26.680346 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 12:17:26.680346 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 12:17:26.680346 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application conn.query(q) Aug 31 12:17:26.680346 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 12:17:26.680346 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 12:17:26.680346 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 12:17:26.680346 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application result.read() Aug 31 12:17:26.680346 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 12:17:26.680346 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 12:17:26.680346 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 12:17:26.680346 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 12:17:26.685690 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 12:17:26.685690 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 12:17:26.685690 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 12:17:26.685690 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 12:17:26.685690 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 31 12:17:26.685690 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 31 12:17:26.685690 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [parameters: {'user_id': 'ca35439949f4423cbb3addd6c6c54586', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 31 12:17:26.685690 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 31 12:17:26.685690 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:17:26.685690 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:17:26.685690 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:17:26.685690 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:26.685690 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:17:26.685690 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:17:26.685690 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:17:26.688778 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:17:26.688778 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:17:26.688778 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:17:26.688778 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:17:26.688778 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:17:26.688778 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:17:26.688778 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:17:26.688778 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 31 12:17:26.688778 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 31 12:17:26.688778 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:17:26.688778 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:17:26.688778 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:17:26.688778 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:17:26.688778 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:17:26.688778 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:17:26.688778 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 31 12:17:26.688778 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 31 12:17:26.691248 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 31 12:17:26.691248 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 31 12:17:26.691248 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 31 12:17:26.691248 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 31 12:17:26.691248 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 31 12:17:26.691248 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:17:26.691248 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 494/985] 10.222.0.79 () {60 vars in 1131 bytes} [Wed Aug 31 12:17:26 2022] POST /identity/v3/users => generated 160 bytes in 342 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:17:26.691248 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b683a4-52bb-46b3-b005-68be0e7709fb None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:26.692525 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f140d653-5ad4-4d13-b301-d96b81abbe9c None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:26.749671 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6152c07a-a2df-4416-b260-85812e3fa503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:26.750357 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6152c07a-a2df-4416-b260-85812e3fa503 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:26.750824 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6152c07a-a2df-4416-b260-85812e3fa503 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:26.751349 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6152c07a-a2df-4416-b260-85812e3fa503 None admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:26.752507 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6152c07a-a2df-4416-b260-85812e3fa503 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:26.753031 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6152c07a-a2df-4416-b260-85812e3fa503 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:26.755702 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6152c07a-a2df-4416-b260-85812e3fa503 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:26.775403 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 492/986] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 12:17:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:26.776466 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6152c07a-a2df-4416-b260-85812e3fa503 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:26.816661 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b683a4-52bb-46b3-b005-68be0e7709fb None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:26.882382 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3261b2c9-9c60-4ea7-a50a-eeb19e75dd3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:26.884535 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3261b2c9-9c60-4ea7-a50a-eeb19e75dd3c None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:26.885215 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3261b2c9-9c60-4ea7-a50a-eeb19e75dd3c None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:26.885782 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3261b2c9-9c60-4ea7-a50a-eeb19e75dd3c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:26.886804 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3261b2c9-9c60-4ea7-a50a-eeb19e75dd3c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:26.889637 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3261b2c9-9c60-4ea7-a50a-eeb19e75dd3c None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:26.904957 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-3261b2c9-9c60-4ea7-a50a-eeb19e75dd3c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 12:17:26.904957 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:26.904957 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 12:17:26.904957 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 12:17:26.904957 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 12:17:26.904957 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 12:17:26.904957 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 12:17:26.904957 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:17:26.904957 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 12:17:26.904957 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:17:26.904957 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:17:26.904957 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:17:26.904957 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:26.904957 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:17:26.904957 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:17:26.904957 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:17:26.904957 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:17:26.906273 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:17:26.906273 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:17:26.906273 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:17:26.906273 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:17:26.906273 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:17:26.906273 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:17:26.906273 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 12:17:26.906273 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 12:17:26.906273 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 12:17:26.906273 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 12:17:26.906273 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:17:26.906273 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:17:26.906273 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:17:26.906273 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:17:26.906273 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:17:26.906273 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:17:26.908322 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:17:26.908322 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:17:26.908322 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:17:26.908322 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:17:26.908322 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:17:26.908322 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:17:26.908322 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:17:26.908322 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:17:26.908322 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:17:26.908322 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:17:26.908322 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 12:17:26.908322 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:17:26.908322 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 12:17:26.908322 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:17:26.908322 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 495/987] 10.222.0.79 () {56 vars in 1126 bytes} [Wed Aug 31 12:17:26 2022] GET /identity/v3/services/object-store => generated 93 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:17:26.909449 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3261b2c9-9c60-4ea7-a50a-eeb19e75dd3c None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:26.935122 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:26.967838 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6152c07a-a2df-4416-b260-85812e3fa503 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:27.015483 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:27.035230 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa2b1f-c6d0-4c8c-8fbc-004ead4203e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:27.036265 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa2b1f-c6d0-4c8c-8fbc-004ead4203e5 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:27.036549 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa2b1f-c6d0-4c8c-8fbc-004ead4203e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:27.036820 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa2b1f-c6d0-4c8c-8fbc-004ead4203e5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:27.045528 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aa2b1f-c6d0-4c8c-8fbc-004ead4203e5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:27.047160 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aa2b1f-c6d0-4c8c-8fbc-004ead4203e5 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:27.060841 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-91aa2b1f-c6d0-4c8c-8fbc-004ead4203e5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 12:17:27.060841 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:27.060841 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:17:27.060841 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:17:27.060841 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:17:27.060841 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:17:27.060841 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:17:27.060841 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:17:27.060841 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:17:27.060841 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:17:27.060841 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:17:27.060841 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:17:27.060841 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:17:27.060841 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:17:27.060841 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:17:27.060841 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:17:27.062359 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:17:27.062359 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:17:27.062359 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:17:27.062359 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:17:27.062359 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:17:27.062359 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:17:27.062359 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:17:27.062359 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:17:27.062359 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:17:27.062359 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:17:27.062359 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:17:27.062359 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:17:27.062359 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:17:27.062359 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:17:27.062359 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:17:27.062359 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:17:27.062359 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:17:27.062359 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:17:27.064619 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:17:27.064619 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:17:27.064619 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:17:27.064619 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:17:27.064619 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:17:27.064619 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:17:27.064619 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:17:27.064619 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:17:27.064619 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 12:17:27.064619 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:17:27.064619 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 493/988] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 12:17:26 2022] GET /identity/v3/users/cinder => generated 84 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:17:27.064619 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa2b1f-c6d0-4c8c-8fbc-004ead4203e5 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:27.100627 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3261b2c9-9c60-4ea7-a50a-eeb19e75dd3c None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:27.161610 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9644e7c-8a52-460e-b252-8b4327c2f762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:27.162581 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9644e7c-8a52-460e-b252-8b4327c2f762 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:27.163142 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9644e7c-8a52-460e-b252-8b4327c2f762 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:27.163619 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9644e7c-8a52-460e-b252-8b4327c2f762 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:27.175702 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9644e7c-8a52-460e-b252-8b4327c2f762 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:27.178390 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9644e7c-8a52-460e-b252-8b4327c2f762 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:27.188392 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa2b1f-c6d0-4c8c-8fbc-004ead4203e5 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:27.200466 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-c9644e7c-8a52-460e-b252-8b4327c2f762 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:17:27.200466 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:27.200466 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:17:27.200466 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:17:27.200466 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:17:27.200466 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:17:27.200466 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:17:27.200466 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:17:27.200466 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:17:27.200466 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:17:27.200466 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:17:27.200466 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:17:27.200466 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:17:27.200466 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:17:27.200466 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:17:27.201608 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:17:27.201608 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:17:27.201608 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:17:27.201608 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:17:27.201608 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:17:27.201608 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:17:27.201608 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:17:27.201608 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:17:27.201608 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:17:27.201608 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:17:27.201608 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:17:27.201608 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:17:27.201608 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:17:27.201608 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:17:27.201608 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:17:27.201608 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:17:27.201608 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:17:27.202762 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:17:27.202762 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:17:27.202762 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:17:27.202762 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:17:27.202762 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:17:27.202762 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:17:27.202762 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:17:27.202762 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:17:27.202762 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 496/989] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 12:17:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:17:27.203959 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9644e7c-8a52-460e-b252-8b4327c2f762 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:27.241722 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c348781-b203-4d76-a3c1-c2e565072181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:27.242646 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c348781-b203-4d76-a3c1-c2e565072181 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:27.243122 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c348781-b203-4d76-a3c1-c2e565072181 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:27.243559 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c348781-b203-4d76-a3c1-c2e565072181 None admin] PATH_INFO: `/v3/services` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:27.244346 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c348781-b203-4d76-a3c1-c2e565072181 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:27.244834 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c348781-b203-4d76-a3c1-c2e565072181 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:27.246436 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c348781-b203-4d76-a3c1-c2e565072181 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:27.252619 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 494/990] 10.222.0.79 () {56 vars in 1122 bytes} [Wed Aug 31 12:17:27 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:27.253484 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c348781-b203-4d76-a3c1-c2e565072181 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:27.278818 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:27.363979 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9644e7c-8a52-460e-b252-8b4327c2f762 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:27.393422 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:27.421264 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c348781-b203-4d76-a3c1-c2e565072181 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:27.425624 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a8ea32-0173-4a8f-b073-1ee5736fae7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:27.426941 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8ea32-0173-4a8f-b073-1ee5736fae7a None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:27.427797 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8ea32-0173-4a8f-b073-1ee5736fae7a None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:27.428520 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8ea32-0173-4a8f-b073-1ee5736fae7a None admin] PATH_INFO: `/v3/users` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:27.430797 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a8ea32-0173-4a8f-b073-1ee5736fae7a None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:27.432092 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a8ea32-0173-4a8f-b073-1ee5736fae7a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:27.435677 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a8ea32-0173-4a8f-b073-1ee5736fae7a None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:27.464706 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b93bb3-be0c-49da-9169-a29d80649d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:27.465331 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b93bb3-be0c-49da-9169-a29d80649d73 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:27.465612 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b93bb3-be0c-49da-9169-a29d80649d73 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:27.465880 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b93bb3-be0c-49da-9169-a29d80649d73 None admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:27.466649 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b93bb3-be0c-49da-9169-a29d80649d73 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:27.466915 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b93bb3-be0c-49da-9169-a29d80649d73 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:27.468360 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b93bb3-be0c-49da-9169-a29d80649d73 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:27.482045 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 495/991] 10.222.0.79 () {56 vars in 1148 bytes} [Wed Aug 31 12:17:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:27.483010 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b93bb3-be0c-49da-9169-a29d80649d73 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:27.500296 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 497/992] 10.222.0.79 () {56 vars in 1101 bytes} [Wed Aug 31 12:17:27 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:27.501656 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796cac7-8c8f-409f-bf7f-1f5c9aa7edcd None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:27.501953 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796cac7-8c8f-409f-bf7f-1f5c9aa7edcd None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:27.502216 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796cac7-8c8f-409f-bf7f-1f5c9aa7edcd None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:27.503518 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 498/993] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:17:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:17:27.509642 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3796cac7-8c8f-409f-bf7f-1f5c9aa7edcd None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:27.566205 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:27.611994 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b93bb3-be0c-49da-9169-a29d80649d73 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:27.665622 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d682828d-c94d-47ed-af1d-afa98b29f1ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:27.667176 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d682828d-c94d-47ed-af1d-afa98b29f1ee None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:27.667176 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d682828d-c94d-47ed-af1d-afa98b29f1ee None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:27.667641 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d682828d-c94d-47ed-af1d-afa98b29f1ee None admin] PATH_INFO: `/v3/services` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:27.668598 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d682828d-c94d-47ed-af1d-afa98b29f1ee None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:27.669033 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d682828d-c94d-47ed-af1d-afa98b29f1ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:27.671231 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d682828d-c94d-47ed-af1d-afa98b29f1ee None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:27.680766 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3796cac7-8c8f-409f-bf7f-1f5c9aa7edcd None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:27.685675 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 496/994] 10.222.0.79 () {56 vars in 1122 bytes} [Wed Aug 31 12:17:27 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:27.685675 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4d4bc-02e4-46c2-95cf-0e9d272c69ca None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:27.685675 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4d4bc-02e4-46c2-95cf-0e9d272c69ca None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:27.685675 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4d4bc-02e4-46c2-95cf-0e9d272c69ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:27.719122 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-dba4d4bc-02e4-46c2-95cf-0e9d272c69ca None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:27.720347 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-dba4d4bc-02e4-46c2-95cf-0e9d272c69ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:27.754215 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be3436-2a05-4e0f-ae05-1d16eedab459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:27.755058 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be3436-2a05-4e0f-ae05-1d16eedab459 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:27.755400 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be3436-2a05-4e0f-ae05-1d16eedab459 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:27.755743 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be3436-2a05-4e0f-ae05-1d16eedab459 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:27.757330 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39be3436-2a05-4e0f-ae05-1d16eedab459 None admin] RBAC: Adding query filter params (role.id=17ccc8cf2d4146ffa34cbd692c600ff7, scope.project.id=a94f4957f2a047cc844342e1c7c74ca5, user.id=149aa48acd504354a1d021885ca51334) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:27.757711 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39be3436-2a05-4e0f-ae05-1d16eedab459 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:27.759931 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39be3436-2a05-4e0f-ae05-1d16eedab459 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:27.768888 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 499/995] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 12:17:27 2022] GET /identity/v3/role_assignments?user.id=149aa48acd504354a1d021885ca51334&scope.project.id=a94f4957f2a047cc844342e1c7c74ca5&role.id=17ccc8cf2d4146ffa34cbd692c600ff7 => generated 608 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:27.770114 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be3436-2a05-4e0f-ae05-1d16eedab459 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:27.827645 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:27.844199 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 497/996] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:17:27 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:17:27.914142 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be3436-2a05-4e0f-ae05-1d16eedab459 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:27.970668 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb6d75a-0f45-4c29-87dd-73c302489a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:27.971714 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb6d75a-0f45-4c29-87dd-73c302489a5f None admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:27.972210 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb6d75a-0f45-4c29-87dd-73c302489a5f None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:27.972710 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb6d75a-0f45-4c29-87dd-73c302489a5f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:27.973919 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb6d75a-0f45-4c29-87dd-73c302489a5f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:27.976170 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb6d75a-0f45-4c29-87dd-73c302489a5f None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:28.001494 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 500/997] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:17:27 2022] POST /identity/v3/endpoints => generated 325 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:17:28.127369 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba4d4bc-02e4-46c2-95cf-0e9d272c69ca None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:28.208481 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:28.280964 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba4d4bc-02e4-46c2-95cf-0e9d272c69ca None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:28.358286 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ccbfd3-d420-4ad5-8f96-e4f6fb5cfc8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:28.358972 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ccbfd3-d420-4ad5-8f96-e4f6fb5cfc8e None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:28.359254 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ccbfd3-d420-4ad5-8f96-e4f6fb5cfc8e None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:28.359558 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ccbfd3-d420-4ad5-8f96-e4f6fb5cfc8e None admin] PATH_INFO: `/v3/services/compute` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:28.360151 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ccbfd3-d420-4ad5-8f96-e4f6fb5cfc8e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:28.361610 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ccbfd3-d420-4ad5-8f96-e4f6fb5cfc8e None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:28.372442 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-d6ccbfd3-d420-4ad5-8f96-e4f6fb5cfc8e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 12:17:28.372442 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:28.372442 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 12:17:28.372442 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 12:17:28.372442 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 12:17:28.372442 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 12:17:28.372442 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 12:17:28.372442 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:17:28.372442 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 12:17:28.372442 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:17:28.372442 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:17:28.372442 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:17:28.372442 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:28.372442 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:17:28.372442 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:17:28.372442 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:17:28.372442 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:17:28.373780 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:17:28.373780 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:17:28.373780 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:17:28.373780 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:17:28.373780 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:17:28.373780 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:17:28.373780 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 12:17:28.373780 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 12:17:28.373780 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 12:17:28.373780 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 12:17:28.373780 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:17:28.373780 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:17:28.373780 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:17:28.373780 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:17:28.373780 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:17:28.373780 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:17:28.375306 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:17:28.375306 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:17:28.375306 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:17:28.375306 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:17:28.375306 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:17:28.375306 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:17:28.375306 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:17:28.375306 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:17:28.375306 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:17:28.375306 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:17:28.375306 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 12:17:28.375306 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:17:28.375306 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 12:17:28.375306 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:17:28.375306 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 498/998] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 12:17:28 2022] GET /identity/v3/services/compute => generated 88 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:17:28.379740 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb6d75a-0f45-4c29-87dd-73c302489a5f None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:28.530492 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:28.536799 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb6d75a-0f45-4c29-87dd-73c302489a5f None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:28.597216 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bcb21d-bbac-4b1d-9409-4042d10e1a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:28.597850 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bcb21d-bbac-4b1d-9409-4042d10e1a0c None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:28.598130 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bcb21d-bbac-4b1d-9409-4042d10e1a0c None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:28.598408 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bcb21d-bbac-4b1d-9409-4042d10e1a0c None admin] PATH_INFO: `/v3/services` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:28.599073 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bcb21d-bbac-4b1d-9409-4042d10e1a0c None admin] RBAC: Adding query filter params (name=compute) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:28.599381 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bcb21d-bbac-4b1d-9409-4042d10e1a0c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:28.601966 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bcb21d-bbac-4b1d-9409-4042d10e1a0c None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:28.612415 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 501/999] 10.222.0.79 () {56 vars in 1112 bytes} [Wed Aug 31 12:17:28 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:17:28.614258 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ccbfd3-d420-4ad5-8f96-e4f6fb5cfc8e None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:28.733941 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ccbfd3-d420-4ad5-8f96-e4f6fb5cfc8e None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:28.761805 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:28.778829 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e8d04a-427f-478c-8c4d-095abfaf5c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:28.779619 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8d04a-427f-478c-8c4d-095abfaf5c47 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:28.779907 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8d04a-427f-478c-8c4d-095abfaf5c47 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:28.780181 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8d04a-427f-478c-8c4d-095abfaf5c47 None admin] PATH_INFO: `/v3/services` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:28.780841 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e8d04a-427f-478c-8c4d-095abfaf5c47 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:28.781148 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e8d04a-427f-478c-8c4d-095abfaf5c47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:28.782583 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e8d04a-427f-478c-8c4d-095abfaf5c47 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:28.793965 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 499/1000] 10.222.0.79 () {56 vars in 1112 bytes} [Wed Aug 31 12:17:28 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:28.796349 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bcb21d-bbac-4b1d-9409-4042d10e1a0c None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:28.969789 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bcb21d-bbac-4b1d-9409-4042d10e1a0c None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:29.032096 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0f5c88-63a1-4ec4-8382-c346848d9e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:29.033159 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f5c88-63a1-4ec4-8382-c346848d9e7b None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:29.033646 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f5c88-63a1-4ec4-8382-c346848d9e7b None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:29.034126 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f5c88-63a1-4ec4-8382-c346848d9e7b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:29.035529 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0f5c88-63a1-4ec4-8382-c346848d9e7b None admin] RBAC: Adding query filter params (interface=public, service_id=401711990b8e491c8100700b017baa1e, region_id=RegionOne) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:29.036010 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0f5c88-63a1-4ec4-8382-c346848d9e7b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:29.038961 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0f5c88-63a1-4ec4-8382-c346848d9e7b None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:29.054834 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 502/1001] 10.222.0.79 () {56 vars in 1251 bytes} [Wed Aug 31 12:17:28 2022] GET /identity/v3/endpoints?service_id=401711990b8e491c8100700b017baa1e&interface=public®ion_id=RegionOne => generated 194 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:29.056414 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e8d04a-427f-478c-8c4d-095abfaf5c47 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:29.168941 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e8d04a-427f-478c-8c4d-095abfaf5c47 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:29.209342 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb337ba-7b08-4b12-993e-e6137935a873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:29.210148 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb337ba-7b08-4b12-993e-e6137935a873 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:29.210387 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb337ba-7b08-4b12-993e-e6137935a873 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:29.210546 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb337ba-7b08-4b12-993e-e6137935a873 None admin] PATH_INFO: `/v3/services` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:29.211195 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb337ba-7b08-4b12-993e-e6137935a873 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:29.212821 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb337ba-7b08-4b12-993e-e6137935a873 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:29.219914 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 500/1002] 10.222.0.79 () {56 vars in 1087 bytes} [Wed Aug 31 12:17:29 2022] GET /identity/v3/services => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:17:30.011777 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d2339-8fb6-4616-afd5-3c06956a67fb None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:30.012620 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d2339-8fb6-4616-afd5-3c06956a67fb None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:30.012620 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d2339-8fb6-4616-afd5-3c06956a67fb None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:30.013929 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 503/1003] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:17:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:17:30.020326 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725d441-12ab-4624-b0fc-6ea7d43a7708 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:30.020915 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725d441-12ab-4624-b0fc-6ea7d43a7708 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:30.021473 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725d441-12ab-4624-b0fc-6ea7d43a7708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:30.052438 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-2725d441-12ab-4624-b0fc-6ea7d43a7708 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:30.054667 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-2725d441-12ab-4624-b0fc-6ea7d43a7708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:30.142937 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:30.161424 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683da264-18e6-4456-a5f2-26fce9a86f4b None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:30.161770 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683da264-18e6-4456-a5f2-26fce9a86f4b None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:30.161977 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683da264-18e6-4456-a5f2-26fce9a86f4b None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:30.163887 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 504/1004] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:17:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:17:30.171553 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24399344-e0d8-4938-ae77-36daa21725f5 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:30.171906 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24399344-e0d8-4938-ae77-36daa21725f5 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:30.172298 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24399344-e0d8-4938-ae77-36daa21725f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:30.182920 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 501/1005] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:17:30 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 12:17:30.197984 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-24399344-e0d8-4938-ae77-36daa21725f5 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:30.199889 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-24399344-e0d8-4938-ae77-36daa21725f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:30.229497 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:30.282447 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 505/1006] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:17:30 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 12:17:30.560059 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2725d441-12ab-4624-b0fc-6ea7d43a7708 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:30.577750 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24399344-e0d8-4938-ae77-36daa21725f5 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:30.684035 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2725d441-12ab-4624-b0fc-6ea7d43a7708 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:30.726697 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a1c0e5-0e2c-4d96-948b-ccc71b680059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:30.727439 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a1c0e5-0e2c-4d96-948b-ccc71b680059 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:30.727718 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a1c0e5-0e2c-4d96-948b-ccc71b680059 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:30.728014 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a1c0e5-0e2c-4d96-948b-ccc71b680059 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:30.729427 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a1c0e5-0e2c-4d96-948b-ccc71b680059 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:30.730904 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a1c0e5-0e2c-4d96-948b-ccc71b680059 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:30.737875 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 502/1007] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:17:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:17:30.739091 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a1c0e5-0e2c-4d96-948b-ccc71b680059 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:30.767255 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24399344-e0d8-4938-ae77-36daa21725f5 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:30.800251 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:30.839958 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d480082b-20dc-46fc-9f7b-32b0b8c40f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:30.840915 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d480082b-20dc-46fc-9f7b-32b0b8c40f9d None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:30.841405 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d480082b-20dc-46fc-9f7b-32b0b8c40f9d None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:30.841868 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d480082b-20dc-46fc-9f7b-32b0b8c40f9d None admin] PATH_INFO: `/v3/services/image` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:30.842995 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d480082b-20dc-46fc-9f7b-32b0b8c40f9d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:30.845779 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d480082b-20dc-46fc-9f7b-32b0b8c40f9d None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:30.862486 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-d480082b-20dc-46fc-9f7b-32b0b8c40f9d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 12:17:30.862486 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:30.862486 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 12:17:30.862486 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 12:17:30.862486 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 12:17:30.862486 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 12:17:30.862486 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 12:17:30.862486 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:17:30.862486 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 12:17:30.862486 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:17:30.862486 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:17:30.862486 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:17:30.862486 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:30.862486 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:17:30.862486 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:17:30.862486 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:17:30.862486 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:17:30.864889 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:17:30.864889 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:17:30.864889 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:17:30.864889 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:17:30.864889 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:17:30.864889 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:17:30.864889 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 12:17:30.864889 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 12:17:30.864889 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 12:17:30.864889 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 12:17:30.864889 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:17:30.864889 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:17:30.864889 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:17:30.864889 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:17:30.864889 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:17:30.864889 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:17:30.867313 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:17:30.867313 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:17:30.867313 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:17:30.867313 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:17:30.867313 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:17:30.867313 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:17:30.867313 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:17:30.867313 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:17:30.867313 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:17:30.867313 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:17:30.867313 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 12:17:30.867313 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:17:30.867313 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 12:17:30.867313 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:17:30.867313 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 506/1008] 10.222.0.79 () {56 vars in 1105 bytes} [Wed Aug 31 12:17:30 2022] GET /identity/v3/services/image => generated 86 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:17:30.870719 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d480082b-20dc-46fc-9f7b-32b0b8c40f9d None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:30.885689 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a1c0e5-0e2c-4d96-948b-ccc71b680059 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:30.904195 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:30.947516 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8049943-2764-4cf2-af2b-79993a2d43bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:30.948152 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8049943-2764-4cf2-af2b-79993a2d43bc None admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:30.948429 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8049943-2764-4cf2-af2b-79993a2d43bc None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:30.948700 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8049943-2764-4cf2-af2b-79993a2d43bc None admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:30.949410 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8049943-2764-4cf2-af2b-79993a2d43bc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:30.950943 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8049943-2764-4cf2-af2b-79993a2d43bc None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:30.988517 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 503/1009] 10.222.0.79 () {60 vars in 1141 bytes} [Wed Aug 31 12:17:30 2022] POST /identity/v3/projects => generated 311 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:17:31.053223 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d480082b-20dc-46fc-9f7b-32b0b8c40f9d None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:31.118015 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62605e32-c40c-4c31-8b1a-b2b5e2677e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:31.119014 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62605e32-c40c-4c31-8b1a-b2b5e2677e63 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:31.119498 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62605e32-c40c-4c31-8b1a-b2b5e2677e63 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:31.119970 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62605e32-c40c-4c31-8b1a-b2b5e2677e63 None admin] PATH_INFO: `/v3/services` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:31.121095 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62605e32-c40c-4c31-8b1a-b2b5e2677e63 None admin] RBAC: Adding query filter params (name=image) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:31.121627 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62605e32-c40c-4c31-8b1a-b2b5e2677e63 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:31.124196 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62605e32-c40c-4c31-8b1a-b2b5e2677e63 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:31.133778 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 507/1010] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:17:30 2022] GET /identity/v3/services?name=image => generated 122 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:31.142397 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8049943-2764-4cf2-af2b-79993a2d43bc None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:31.269112 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:31.272437 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8049943-2764-4cf2-af2b-79993a2d43bc None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:31.318901 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd4b31e-b55a-43fd-94ad-1363344c777c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:31.320276 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd4b31e-b55a-43fd-94ad-1363344c777c None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:31.320567 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd4b31e-b55a-43fd-94ad-1363344c777c None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:31.320845 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd4b31e-b55a-43fd-94ad-1363344c777c None admin] PATH_INFO: `/v3/services` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:31.321541 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd4b31e-b55a-43fd-94ad-1363344c777c None admin] RBAC: Adding query filter params (type=image) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:31.321798 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd4b31e-b55a-43fd-94ad-1363344c777c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:31.323248 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd4b31e-b55a-43fd-94ad-1363344c777c None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:31.328473 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 504/1011] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:17:31 2022] GET /identity/v3/services?type=image => generated 122 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:31.364624 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9148053-d47e-400f-b5d7-003db2a026c7 None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:31.365052 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9148053-d47e-400f-b5d7-003db2a026c7 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:31.365339 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9148053-d47e-400f-b5d7-003db2a026c7 None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:31.367244 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 508/1012] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:17:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:17:31.372990 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf4cf6-fa7b-43f4-90f8-2d36edfff4b1 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:31.373293 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf4cf6-fa7b-43f4-90f8-2d36edfff4b1 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:31.373452 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf4cf6-fa7b-43f4-90f8-2d36edfff4b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:31.394220 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-6ebf4cf6-fa7b-43f4-90f8-2d36edfff4b1 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:31.395548 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-6ebf4cf6-fa7b-43f4-90f8-2d36edfff4b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:31.504072 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 505/1013] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:17:31 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:17:31.987730 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9148053-d47e-400f-b5d7-003db2a026c7 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:32.141135 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:32.167985 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9148053-d47e-400f-b5d7-003db2a026c7 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:32.230934 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f551be0b-3fd5-40ef-b8ae-d3140b053786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:32.231952 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f551be0b-3fd5-40ef-b8ae-d3140b053786 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:32.232420 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f551be0b-3fd5-40ef-b8ae-d3140b053786 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:32.232868 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f551be0b-3fd5-40ef-b8ae-d3140b053786 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:32.233879 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f551be0b-3fd5-40ef-b8ae-d3140b053786 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:32.236568 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f551be0b-3fd5-40ef-b8ae-d3140b053786 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:32.253890 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-f551be0b-3fd5-40ef-b8ae-d3140b053786 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 12:17:32.253890 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:32.253890 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 12:17:32.253890 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 12:17:32.253890 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 12:17:32.253890 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 12:17:32.253890 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 12:17:32.253890 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:17:32.253890 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 12:17:32.253890 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:17:32.253890 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:17:32.253890 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:17:32.253890 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:32.253890 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:17:32.253890 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:17:32.253890 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:17:32.253890 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:17:32.255049 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:17:32.255049 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:17:32.255049 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:17:32.255049 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:17:32.255049 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:17:32.255049 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:17:32.255049 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 12:17:32.255049 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 12:17:32.255049 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 12:17:32.255049 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 12:17:32.255049 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:17:32.255049 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:17:32.255049 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:17:32.255049 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:17:32.255049 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:17:32.255049 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:17:32.256150 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:17:32.256150 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:17:32.256150 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:17:32.256150 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:17:32.256150 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:17:32.256150 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:17:32.256150 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:17:32.256150 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:17:32.256150 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:17:32.256150 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:17:32.256150 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 12:17:32.256150 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:17:32.256150 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 12:17:32.256150 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:17:32.259220 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 509/1014] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 12:17:31 2022] GET /identity/v3/services/compute => generated 88 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:17:32.265572 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebf4cf6-fa7b-43f4-90f8-2d36edfff4b1 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:32.449103 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:32.457694 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebf4cf6-fa7b-43f4-90f8-2d36edfff4b1 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:32.518242 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e5ce18-3a3a-4bea-9682-b59a12b7da46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:32.519341 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e5ce18-3a3a-4bea-9682-b59a12b7da46 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:32.519667 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e5ce18-3a3a-4bea-9682-b59a12b7da46 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:32.520150 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e5ce18-3a3a-4bea-9682-b59a12b7da46 None admin] PATH_INFO: `/v3/services` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:32.521327 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e5ce18-3a3a-4bea-9682-b59a12b7da46 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:32.521853 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e5ce18-3a3a-4bea-9682-b59a12b7da46 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:32.525000 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e5ce18-3a3a-4bea-9682-b59a12b7da46 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:32.533308 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 506/1015] 10.222.0.79 () {56 vars in 1112 bytes} [Wed Aug 31 12:17:32 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:32.540972 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f551be0b-3fd5-40ef-b8ae-d3140b053786 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:32.720631 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f551be0b-3fd5-40ef-b8ae-d3140b053786 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:32.769733 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cf2cb4-1a26-4712-a8aa-808c0e998f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:32.770242 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf2cb4-1a26-4712-a8aa-808c0e998f80 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:32.770517 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf2cb4-1a26-4712-a8aa-808c0e998f80 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:32.770786 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf2cb4-1a26-4712-a8aa-808c0e998f80 None admin] PATH_INFO: `/v3/services` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:32.771453 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cf2cb4-1a26-4712-a8aa-808c0e998f80 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:32.771753 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cf2cb4-1a26-4712-a8aa-808c0e998f80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:32.773901 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cf2cb4-1a26-4712-a8aa-808c0e998f80 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:32.787664 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 510/1016] 10.222.0.79 () {56 vars in 1112 bytes} [Wed Aug 31 12:17:32 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:17:32.790343 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e5ce18-3a3a-4bea-9682-b59a12b7da46 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:32.929544 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e5ce18-3a3a-4bea-9682-b59a12b7da46 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:32.972586 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6329cfda-a37e-44c0-a59a-7b8f45bea524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:32.973210 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6329cfda-a37e-44c0-a59a-7b8f45bea524 None admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:32.973487 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6329cfda-a37e-44c0-a59a-7b8f45bea524 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:32.973761 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6329cfda-a37e-44c0-a59a-7b8f45bea524 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:32.974451 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6329cfda-a37e-44c0-a59a-7b8f45bea524 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:32.976421 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6329cfda-a37e-44c0-a59a-7b8f45bea524 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:33.007034 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 507/1017] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:17:32 2022] POST /identity/v3/endpoints => generated 334 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:17:33.354557 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f069130d-68c4-4aba-8d4f-fab42c838926 None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:33.355135 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f069130d-68c4-4aba-8d4f-fab42c838926 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:33.355135 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f069130d-68c4-4aba-8d4f-fab42c838926 None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:33.356922 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 511/1018] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:17:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:17:33.363228 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454bd503-52ae-4b46-a68c-7bb5dcfcd142 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:33.363593 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454bd503-52ae-4b46-a68c-7bb5dcfcd142 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:33.363875 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454bd503-52ae-4b46-a68c-7bb5dcfcd142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:33.386038 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-454bd503-52ae-4b46-a68c-7bb5dcfcd142 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:33.387303 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-454bd503-52ae-4b46-a68c-7bb5dcfcd142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:33.400114 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:33.499760 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1394b967-80ce-4367-b45a-a8019c356c33 None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:33.500132 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1394b967-80ce-4367-b45a-a8019c356c33 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:33.505782 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1394b967-80ce-4367-b45a-a8019c356c33 None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:33.505950 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 508/1019] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:17:33 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 12:17:33.506382 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 512/1020] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:17:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:17:33.507588 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f002e-0087-4614-8d1b-bb35b8da3be9 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:33.507919 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f002e-0087-4614-8d1b-bb35b8da3be9 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:33.508145 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f002e-0087-4614-8d1b-bb35b8da3be9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:33.527091 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-402f002e-0087-4614-8d1b-bb35b8da3be9 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:33.528298 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-402f002e-0087-4614-8d1b-bb35b8da3be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:33.623019 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 509/1021] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:17:33 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 12:17:33.780506 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1394b967-80ce-4367-b45a-a8019c356c33 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:33.797252 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:33.890406 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1394b967-80ce-4367-b45a-a8019c356c33 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:33.929904 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cd0386-c8fc-4e56-a4a1-f0a943054575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:33.930533 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cd0386-c8fc-4e56-a4a1-f0a943054575 None admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:33.931189 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cd0386-c8fc-4e56-a4a1-f0a943054575 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:33.931327 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cd0386-c8fc-4e56-a4a1-f0a943054575 None admin] PATH_INFO: `/v3/services` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:33.931955 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cd0386-c8fc-4e56-a4a1-f0a943054575 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:33.932122 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f002e-0087-4614-8d1b-bb35b8da3be9 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:33.933526 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cd0386-c8fc-4e56-a4a1-f0a943054575 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:33.949846 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 513/1022] 10.222.0.79 () {60 vars in 1141 bytes} [Wed Aug 31 12:17:33 2022] POST /identity/v3/services => generated 242 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:17:34.030688 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:34.075910 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f002e-0087-4614-8d1b-bb35b8da3be9 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:34.128162 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd14fc44-fa3f-4519-a558-8b996014d5db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:34.128812 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd14fc44-fa3f-4519-a558-8b996014d5db None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:34.129086 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd14fc44-fa3f-4519-a558-8b996014d5db None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:34.129351 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd14fc44-fa3f-4519-a558-8b996014d5db None admin] PATH_INFO: `/v3/domains/default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:34.130531 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd14fc44-fa3f-4519-a558-8b996014d5db None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:34.132665 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd14fc44-fa3f-4519-a558-8b996014d5db None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:34.134667 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 510/1023] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:17:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:17:34.141100 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cd0386-c8fc-4e56-a4a1-f0a943054575 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:34.231375 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:34.263316 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cd0386-c8fc-4e56-a4a1-f0a943054575 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:34.303228 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eb7eaa-58a5-41c7-a92c-2987d779d524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:34.304037 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eb7eaa-58a5-41c7-a92c-2987d779d524 None admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:34.304324 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eb7eaa-58a5-41c7-a92c-2987d779d524 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:34.304648 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eb7eaa-58a5-41c7-a92c-2987d779d524 None admin] PATH_INFO: `/v3/users` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:34.305275 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eb7eaa-58a5-41c7-a92c-2987d779d524 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:34.306727 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eb7eaa-58a5-41c7-a92c-2987d779d524 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:34.333892 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 514/1024] 10.222.0.79 () {60 vars in 1132 bytes} [Wed Aug 31 12:17:34 2022] POST /identity/v3/users => generated 285 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:17:35.180343 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd46dbd-80a6-4f49-911f-2b384018f306 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:35.180937 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd46dbd-80a6-4f49-911f-2b384018f306 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:35.180937 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd46dbd-80a6-4f49-911f-2b384018f306 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:35.182398 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 511/1025] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:17:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:17:35.187582 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdba010-84d3-4a3f-865a-c0821bdd28cd None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:35.188011 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdba010-84d3-4a3f-865a-c0821bdd28cd None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:35.188184 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdba010-84d3-4a3f-865a-c0821bdd28cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:35.206665 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-6cdba010-84d3-4a3f-865a-c0821bdd28cd None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:35.207939 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-6cdba010-84d3-4a3f-865a-c0821bdd28cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:35.274696 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 515/1026] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:17:35 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:17:35.546137 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd46dbd-80a6-4f49-911f-2b384018f306 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:35.670439 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd46dbd-80a6-4f49-911f-2b384018f306 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:35.707534 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ca3053-1533-49cc-adca-43cb5132006a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:35.708599 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca3053-1533-49cc-adca-43cb5132006a None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:35.709075 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca3053-1533-49cc-adca-43cb5132006a None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:35.709572 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca3053-1533-49cc-adca-43cb5132006a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:35.711787 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:35.721734 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ca3053-1533-49cc-adca-43cb5132006a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:17:35.727474 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-b4ca3053-1533-49cc-adca-43cb5132006a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 12:17:35.727474 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:35.727474 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:17:35.727474 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:17:35.727474 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:17:35.727474 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:17:35.727474 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:17:35.727474 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:17:35.727474 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:17:35.727474 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:17:35.727474 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:17:35.727474 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:17:35.727474 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:17:35.727474 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:17:35.727474 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:17:35.727474 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:17:35.728470 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:17:35.728470 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:17:35.728470 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:17:35.728470 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:17:35.728470 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:17:35.728470 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:17:35.728470 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:17:35.728470 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:17:35.728470 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:17:35.728470 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:17:35.728470 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:17:35.728470 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:17:35.728470 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:17:35.728470 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:17:35.728470 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:17:35.728470 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:17:35.729410 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:17:35.729410 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:17:35.729410 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:17:35.729410 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:17:35.729410 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:17:35.729410 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:17:35.729410 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:17:35.729410 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:17:35.729410 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:17:35.729410 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:17:35.729410 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 12:17:35.729410 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:17:35.731789 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 512/1027] 10.222.0.79 () {56 vars in 1120 bytes} [Wed Aug 31 12:17:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:17:35.737902 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdba010-84d3-4a3f-865a-c0821bdd28cd None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:35.801528 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:35.845627 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdba010-84d3-4a3f-865a-c0821bdd28cd None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:35.881289 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06e1238-9c5f-4a8a-9f37-db92a72a954c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:35.882072 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06e1238-9c5f-4a8a-9f37-db92a72a954c None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:35.882379 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06e1238-9c5f-4a8a-9f37-db92a72a954c None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:35.882726 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06e1238-9c5f-4a8a-9f37-db92a72a954c None admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:35.883447 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06e1238-9c5f-4a8a-9f37-db92a72a954c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:35.883754 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06e1238-9c5f-4a8a-9f37-db92a72a954c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:35.885144 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06e1238-9c5f-4a8a-9f37-db92a72a954c None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:35.893837 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 516/1028] 10.222.0.79 () {56 vars in 1115 bytes} [Wed Aug 31 12:17:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:35.900006 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ca3053-1533-49cc-adca-43cb5132006a None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:35.982779 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb9019-b0df-43e1-8401-2647412188af None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:35.983074 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb9019-b0df-43e1-8401-2647412188af None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:35.983273 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb9019-b0df-43e1-8401-2647412188af None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:35.984777 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 517/1029] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:17:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:17:35.989993 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e8445-237d-4b8d-bab4-aa3212db037a None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:35.990280 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e8445-237d-4b8d-bab4-aa3212db037a None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:35.990563 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e8445-237d-4b8d-bab4-aa3212db037a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:36.010671 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-575e8445-237d-4b8d-bab4-aa3212db037a None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:36.011931 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-575e8445-237d-4b8d-bab4-aa3212db037a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:36.013345 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ca3053-1533-49cc-adca-43cb5132006a None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:36.055970 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c261720-28d6-468a-a7b5-0d8bf6e502f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:36.056617 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c261720-28d6-468a-a7b5-0d8bf6e502f1 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:36.056897 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c261720-28d6-468a-a7b5-0d8bf6e502f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:36.057209 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c261720-28d6-468a-a7b5-0d8bf6e502f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:36.068804 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c261720-28d6-468a-a7b5-0d8bf6e502f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:36.070983 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c261720-28d6-468a-a7b5-0d8bf6e502f1 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:36.088575 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-5c261720-28d6-468a-a7b5-0d8bf6e502f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:17:36.088575 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:36.088575 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:17:36.088575 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:17:36.088575 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:17:36.088575 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:17:36.088575 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:17:36.088575 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:17:36.088575 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:17:36.088575 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:17:36.088575 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:17:36.088575 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:17:36.088575 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:17:36.088575 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:17:36.088575 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:17:36.088575 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:17:36.089673 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:17:36.089673 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:17:36.089673 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:17:36.089673 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:17:36.089673 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:17:36.089673 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:17:36.089673 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:17:36.089673 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:17:36.089673 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:17:36.089673 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:17:36.089673 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:17:36.089673 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:17:36.089673 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:17:36.089673 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:17:36.089673 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:17:36.089673 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:17:36.089673 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:17:36.090916 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:17:36.090916 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:17:36.090916 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:17:36.090916 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 513/1030] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:17:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:17:36.096524 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c261720-28d6-468a-a7b5-0d8bf6e502f1 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:36.110912 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 518/1031] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:17:35 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 12:17:36.150648 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:36.212337 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c261720-28d6-468a-a7b5-0d8bf6e502f1 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:36.250084 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ad4dc0-6d58-4c56-992a-7b7cbd2bfd4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:36.250525 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad4dc0-6d58-4c56-992a-7b7cbd2bfd4d None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:36.250787 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad4dc0-6d58-4c56-992a-7b7cbd2bfd4d None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:36.251099 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad4dc0-6d58-4c56-992a-7b7cbd2bfd4d None admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:36.251702 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ad4dc0-6d58-4c56-992a-7b7cbd2bfd4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:36.252006 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ad4dc0-6d58-4c56-992a-7b7cbd2bfd4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:36.253378 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ad4dc0-6d58-4c56-992a-7b7cbd2bfd4d None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:36.266986 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 514/1032] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 12:17:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:36.274387 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575e8445-237d-4b8d-bab4-aa3212db037a None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:36.360467 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:36.370296 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac25b6-4914-46bd-88e2-f3650f9ee01f None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:36.370579 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac25b6-4914-46bd-88e2-f3650f9ee01f None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:36.371008 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac25b6-4914-46bd-88e2-f3650f9ee01f None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:36.373654 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 515/1033] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:17:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:17:36.379173 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33aa02-2fa1-479f-a55c-e5b5e3209f51 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:36.379455 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33aa02-2fa1-479f-a55c-e5b5e3209f51 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:36.379768 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33aa02-2fa1-479f-a55c-e5b5e3209f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:36.405562 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-1a33aa02-2fa1-479f-a55c-e5b5e3209f51 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:36.407565 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-1a33aa02-2fa1-479f-a55c-e5b5e3209f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:36.429158 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575e8445-237d-4b8d-bab4-aa3212db037a None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:36.468198 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1053fb47-cf06-4b8c-8c71-08d76cb1654e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:36.468850 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1053fb47-cf06-4b8c-8c71-08d76cb1654e None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:36.469125 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1053fb47-cf06-4b8c-8c71-08d76cb1654e None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:36.469403 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1053fb47-cf06-4b8c-8c71-08d76cb1654e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:36.479548 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1053fb47-cf06-4b8c-8c71-08d76cb1654e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:36.481029 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1053fb47-cf06-4b8c-8c71-08d76cb1654e None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:36.492358 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 516/1034] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:17:36 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 12:17:36.493216 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a33aa02-2fa1-479f-a55c-e5b5e3209f51 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:36.493501 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-1053fb47-cf06-4b8c-8c71-08d76cb1654e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 12:17:36.493501 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:36.493501 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:17:36.493501 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:17:36.493501 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:17:36.493501 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:17:36.493501 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:17:36.493501 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:17:36.493501 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:17:36.493501 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:17:36.493501 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:17:36.493501 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:17:36.493501 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:17:36.493501 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:17:36.493501 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:17:36.493501 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:17:36.494661 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:17:36.494661 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:17:36.494661 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:17:36.494661 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:17:36.494661 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:17:36.494661 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:17:36.494661 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:17:36.494661 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:17:36.494661 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:17:36.494661 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:17:36.494661 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:17:36.494661 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:17:36.494661 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:17:36.494661 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:17:36.494661 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:17:36.494661 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:17:36.494661 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:17:36.494661 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:17:36.495889 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:17:36.495889 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:17:36.495889 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:17:36.495889 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:17:36.495889 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:17:36.495889 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:17:36.495889 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:17:36.495889 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:17:36.495889 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 12:17:36.495889 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:17:36.495889 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 519/1035] 10.222.0.79 () {56 vars in 1093 bytes} [Wed Aug 31 12:17:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:17:36.500871 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1053fb47-cf06-4b8c-8c71-08d76cb1654e None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:36.537098 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:36.647813 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a33aa02-2fa1-479f-a55c-e5b5e3209f51 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:36.684367 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe60d8b-0be0-48c6-803a-55e3645090b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:36.684716 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1053fb47-cf06-4b8c-8c71-08d76cb1654e None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:36.685017 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe60d8b-0be0-48c6-803a-55e3645090b9 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:36.685294 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe60d8b-0be0-48c6-803a-55e3645090b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:36.685561 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe60d8b-0be0-48c6-803a-55e3645090b9 None admin] PATH_INFO: `/v3/services/image` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:36.686155 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe60d8b-0be0-48c6-803a-55e3645090b9 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:36.687579 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe60d8b-0be0-48c6-803a-55e3645090b9 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:36.699098 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-cfe60d8b-0be0-48c6-803a-55e3645090b9 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 12:17:36.699098 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:36.699098 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 12:17:36.699098 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 12:17:36.699098 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 12:17:36.699098 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 12:17:36.699098 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 12:17:36.699098 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:17:36.699098 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 12:17:36.699098 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:17:36.699098 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:17:36.699098 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:17:36.699098 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:36.699098 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:17:36.699098 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:17:36.699098 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:17:36.699098 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:17:36.700190 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:17:36.700190 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:17:36.700190 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:17:36.700190 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:17:36.700190 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:17:36.700190 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:17:36.700190 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 12:17:36.700190 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 12:17:36.700190 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 12:17:36.700190 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 12:17:36.700190 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:17:36.700190 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:17:36.700190 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:17:36.700190 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:17:36.700190 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:17:36.700190 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:17:36.701046 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:17:36.701046 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:17:36.701046 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:17:36.701046 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:17:36.701046 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:17:36.701046 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:17:36.701046 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:17:36.701046 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:17:36.701046 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:17:36.701046 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:17:36.701046 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 12:17:36.701046 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:17:36.701046 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 12:17:36.701046 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:17:36.701814 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:36.703654 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 517/1036] 10.222.0.79 () {56 vars in 1105 bytes} [Wed Aug 31 12:17:36 2022] GET /identity/v3/services/image => generated 86 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:17:36.711293 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe60d8b-0be0-48c6-803a-55e3645090b9 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:36.726502 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f968a50d-a16a-4962-a4da-2507451139c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:36.727157 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f968a50d-a16a-4962-a4da-2507451139c0 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:36.727448 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f968a50d-a16a-4962-a4da-2507451139c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:36.727723 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f968a50d-a16a-4962-a4da-2507451139c0 None admin] PATH_INFO: `/v3/users` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:36.728461 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f968a50d-a16a-4962-a4da-2507451139c0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:36.728769 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f968a50d-a16a-4962-a4da-2507451139c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:36.730224 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f968a50d-a16a-4962-a4da-2507451139c0 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:36.749737 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 520/1037] 10.222.0.79 () {56 vars in 1133 bytes} [Wed Aug 31 12:17:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:17:36.755805 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f968a50d-a16a-4962-a4da-2507451139c0 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:36.836414 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:36.840092 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe60d8b-0be0-48c6-803a-55e3645090b9 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:36.878453 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f968a50d-a16a-4962-a4da-2507451139c0 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:36.880719 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5add1d10-4391-4dab-a5ec-bfb38ea3631a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:36.881343 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add1d10-4391-4dab-a5ec-bfb38ea3631a None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:36.881772 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add1d10-4391-4dab-a5ec-bfb38ea3631a None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:36.882055 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add1d10-4391-4dab-a5ec-bfb38ea3631a None admin] PATH_INFO: `/v3/services` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:36.882700 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5add1d10-4391-4dab-a5ec-bfb38ea3631a None admin] RBAC: Adding query filter params (name=image) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:36.883058 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5add1d10-4391-4dab-a5ec-bfb38ea3631a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:36.884484 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5add1d10-4391-4dab-a5ec-bfb38ea3631a None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:36.890508 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 518/1038] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:17:36 2022] GET /identity/v3/services?name=image => generated 122 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:36.891773 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5add1d10-4391-4dab-a5ec-bfb38ea3631a None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:36.921256 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3d12f7-7ccd-4de4-9aea-2ca5c0f66ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:36.922092 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d12f7-7ccd-4de4-9aea-2ca5c0f66ee6 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:36.922723 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d12f7-7ccd-4de4-9aea-2ca5c0f66ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:36.923084 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d12f7-7ccd-4de4-9aea-2ca5c0f66ee6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:36.983624 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:37.014170 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5add1d10-4391-4dab-a5ec-bfb38ea3631a None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:37.015466 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3d12f7-7ccd-4de4-9aea-2ca5c0f66ee6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:37.016948 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3d12f7-7ccd-4de4-9aea-2ca5c0f66ee6 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:37.051266 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d4b025-c3e2-4a80-ad77-290d868e2ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:37.051900 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d4b025-c3e2-4a80-ad77-290d868e2ea4 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:37.052173 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d4b025-c3e2-4a80-ad77-290d868e2ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:37.052437 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d4b025-c3e2-4a80-ad77-290d868e2ea4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:37.064017 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d4b025-c3e2-4a80-ad77-290d868e2ea4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:17:37.068865 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-92d4b025-c3e2-4a80-ad77-290d868e2ea4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:17:37.068865 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:37.068865 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:17:37.068865 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:17:37.068865 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:17:37.068865 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:17:37.068865 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:17:37.068865 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:17:37.068865 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:17:37.068865 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:17:37.068865 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:17:37.068865 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:17:37.068865 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:17:37.068865 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:17:37.068865 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:17:37.068865 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:17:37.069933 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:17:37.069933 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:17:37.069933 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:17:37.069933 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:17:37.069933 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:17:37.069933 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:17:37.069933 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:17:37.069933 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:17:37.069933 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:17:37.069933 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:17:37.069933 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:17:37.069933 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:17:37.069933 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:17:37.069933 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:17:37.069933 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:17:37.069933 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:17:37.070828 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:17:37.070828 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:17:37.070828 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:17:37.070828 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:17:37.070828 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:17:37.070828 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:17:37.070828 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:17:37.070828 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:17:37.070828 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:17:37.070828 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:17:37.070828 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:17:37.070828 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:17:37.070828 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 519/1039] 10.222.0.79 () {56 vars in 1096 bytes} [Wed Aug 31 12:17:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:17:37.071632 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d4b025-c3e2-4a80-ad77-290d868e2ea4 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:37.100825 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:37.143377 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 521/1040] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 12:17:36 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 12:17:37.143377 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3d12f7-7ccd-4de4-9aea-2ca5c0f66ee6 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:37.193368 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d4b025-c3e2-4a80-ad77-290d868e2ea4 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:37.217190 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:37.237083 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46366dbe-f58e-4dd2-aefb-15471b983d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:37.238149 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46366dbe-f58e-4dd2-aefb-15471b983d82 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:37.238647 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46366dbe-f58e-4dd2-aefb-15471b983d82 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:37.239185 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46366dbe-f58e-4dd2-aefb-15471b983d82 None admin] PATH_INFO: `/v3/services` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:37.240241 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46366dbe-f58e-4dd2-aefb-15471b983d82 None admin] RBAC: Adding query filter params (type=image) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:37.240763 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46366dbe-f58e-4dd2-aefb-15471b983d82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:37.243306 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46366dbe-f58e-4dd2-aefb-15471b983d82 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:37.250357 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 520/1041] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:17:37 2022] GET /identity/v3/services?type=image => generated 350 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:37.251567 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46366dbe-f58e-4dd2-aefb-15471b983d82 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:37.253040 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3d12f7-7ccd-4de4-9aea-2ca5c0f66ee6 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:37.293034 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b06429-11c7-445b-be02-e560bcb26ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:37.293702 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b06429-11c7-445b-be02-e560bcb26ee3 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:37.293919 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b06429-11c7-445b-be02-e560bcb26ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:37.294186 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b06429-11c7-445b-be02-e560bcb26ee3 None admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:37.294911 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b06429-11c7-445b-be02-e560bcb26ee3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:37.295218 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b06429-11c7-445b-be02-e560bcb26ee3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:37.296594 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b06429-11c7-445b-be02-e560bcb26ee3 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:37.307171 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 522/1042] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 12:17:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:37.308335 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b06429-11c7-445b-be02-e560bcb26ee3 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:37.362921 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:37.377536 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46366dbe-f58e-4dd2-aefb-15471b983d82 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:37.415267 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e727817c-49ab-42e8-baa5-dd8ab0d6a9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:37.415921 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e727817c-49ab-42e8-baa5-dd8ab0d6a9bc None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:37.416205 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e727817c-49ab-42e8-baa5-dd8ab0d6a9bc None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:37.416477 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e727817c-49ab-42e8-baa5-dd8ab0d6a9bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:37.429334 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e727817c-49ab-42e8-baa5-dd8ab0d6a9bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:37.429708 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b06429-11c7-445b-be02-e560bcb26ee3 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:37.431951 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e727817c-49ab-42e8-baa5-dd8ab0d6a9bc None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:37.448584 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-e727817c-49ab-42e8-baa5-dd8ab0d6a9bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:17:37.448584 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:37.448584 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:17:37.448584 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:17:37.448584 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:17:37.448584 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:17:37.448584 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:17:37.448584 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:17:37.448584 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:17:37.448584 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:17:37.448584 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:17:37.448584 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:17:37.448584 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:17:37.448584 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:17:37.448584 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:17:37.448584 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:17:37.449646 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:17:37.449646 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:17:37.449646 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:17:37.449646 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:17:37.449646 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:17:37.449646 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:17:37.449646 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:17:37.449646 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:17:37.449646 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:17:37.449646 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:17:37.449646 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:17:37.449646 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:17:37.449646 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:17:37.449646 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:17:37.449646 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:17:37.449646 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:17:37.449646 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:17:37.450554 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:17:37.450554 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:17:37.450554 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:17:37.450554 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 521/1043] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:17:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:17:37.450916 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e727817c-49ab-42e8-baa5-dd8ab0d6a9bc None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:37.465620 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:37.472065 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebce21e-39ca-49d8-bf1f-ea272705175c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:37.472768 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebce21e-39ca-49d8-bf1f-ea272705175c None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:37.473109 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebce21e-39ca-49d8-bf1f-ea272705175c None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:37.473446 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebce21e-39ca-49d8-bf1f-ea272705175c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:37.474230 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebce21e-39ca-49d8-bf1f-ea272705175c None admin] RBAC: Adding query filter params (interface=public, service_id=7a93e6af9bd6479798d1963f5a79d255, region_id=RegionOne) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:37.474615 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebce21e-39ca-49d8-bf1f-ea272705175c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:37.476835 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebce21e-39ca-49d8-bf1f-ea272705175c None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:37.482287 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 523/1044] 10.222.0.79 () {56 vars in 1251 bytes} [Wed Aug 31 12:17:37 2022] GET /identity/v3/endpoints?service_id=7a93e6af9bd6479798d1963f5a79d255&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:37.483214 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebce21e-39ca-49d8-bf1f-ea272705175c None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:37.568389 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e727817c-49ab-42e8-baa5-dd8ab0d6a9bc None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:37.606272 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3526c736-18c3-45ec-9b0a-8c82959c99d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:37.607189 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3526c736-18c3-45ec-9b0a-8c82959c99d8 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:37.607564 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3526c736-18c3-45ec-9b0a-8c82959c99d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:37.607964 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3526c736-18c3-45ec-9b0a-8c82959c99d8 None admin] PATH_INFO: `/v3/users/0a3f234434da4f68966af7eae9e5d16a` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:37.614920 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebce21e-39ca-49d8-bf1f-ea272705175c None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:37.622801 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:37.627350 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3526c736-18c3-45ec-9b0a-8c82959c99d8 None admin] RBAC: Authorizing `identity:get_user(user_id=0a3f234434da4f68966af7eae9e5d16a)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:37.629125 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3526c736-18c3-45ec-9b0a-8c82959c99d8 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:37.631035 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 522/1045] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 12:17:37 2022] GET /identity/v3/users/0a3f234434da4f68966af7eae9e5d16a => generated 285 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:37.632412 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3526c736-18c3-45ec-9b0a-8c82959c99d8 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:37.666614 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bfce32-1119-4540-8f07-7ec8204c39c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:37.667287 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bfce32-1119-4540-8f07-7ec8204c39c6 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:37.667571 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bfce32-1119-4540-8f07-7ec8204c39c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:37.667839 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bfce32-1119-4540-8f07-7ec8204c39c6 None admin] PATH_INFO: `/v3/domains` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:37.668506 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bfce32-1119-4540-8f07-7ec8204c39c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:37.669883 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bfce32-1119-4540-8f07-7ec8204c39c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:37.670247 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bfce32-1119-4540-8f07-7ec8204c39c6 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:37.685263 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 524/1046] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 12:17:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:37.686150 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bfce32-1119-4540-8f07-7ec8204c39c6 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:37.748581 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:37.762793 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3526c736-18c3-45ec-9b0a-8c82959c99d8 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:37.799292 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bfce32-1119-4540-8f07-7ec8204c39c6 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:37.802778 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcfee4d-53d8-439d-a570-31efdae58daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:37.804065 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcfee4d-53d8-439d-a570-31efdae58daa None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:37.804454 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcfee4d-53d8-439d-a570-31efdae58daa None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:37.804731 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcfee4d-53d8-439d-a570-31efdae58daa None admin] PATH_INFO: `/v3/services` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:37.805398 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcfee4d-53d8-439d-a570-31efdae58daa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:37.807097 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcfee4d-53d8-439d-a570-31efdae58daa None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:37.835212 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 523/1047] 10.222.0.79 () {56 vars in 1087 bytes} [Wed Aug 31 12:17:37 2022] GET /identity/v3/services => generated 1957 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:17:37.835212 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcfee4d-53d8-439d-a570-31efdae58daa None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:37.840133 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf69428-3b52-4220-bc2e-f41cae82e615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:37.840864 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf69428-3b52-4220-bc2e-f41cae82e615 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:37.841150 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf69428-3b52-4220-bc2e-f41cae82e615 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:37.841401 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf69428-3b52-4220-bc2e-f41cae82e615 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:37.903541 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:37.932472 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf69428-3b52-4220-bc2e-f41cae82e615 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:37.935343 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf69428-3b52-4220-bc2e-f41cae82e615 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:37.949409 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcfee4d-53d8-439d-a570-31efdae58daa None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:37.996906 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e738750-6e7a-4214-8d8c-79068cdb8225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:37.997572 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e738750-6e7a-4214-8d8c-79068cdb8225 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:37.997854 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e738750-6e7a-4214-8d8c-79068cdb8225 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:37.998127 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e738750-6e7a-4214-8d8c-79068cdb8225 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:38.011346 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e738750-6e7a-4214-8d8c-79068cdb8225 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:38.015152 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e738750-6e7a-4214-8d8c-79068cdb8225 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:38.031084 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-2e738750-6e7a-4214-8d8c-79068cdb8225 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:17:38.031084 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:38.031084 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:17:38.031084 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:17:38.031084 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:17:38.031084 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:17:38.031084 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:17:38.031084 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:17:38.031084 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:17:38.031084 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:17:38.031084 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:17:38.031084 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:17:38.031084 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:17:38.031084 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:17:38.031084 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:17:38.032943 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:17:38.032943 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:17:38.032943 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:17:38.032943 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:17:38.032943 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:17:38.032943 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:17:38.032943 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:17:38.032943 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:17:38.032943 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:17:38.032943 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:17:38.032943 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:17:38.032943 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:17:38.032943 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:17:38.032943 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:17:38.032943 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:17:38.032943 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:17:38.032943 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:17:38.034588 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:17:38.034588 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:17:38.034588 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:17:38.034588 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:17:38.034588 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:17:38.034588 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:17:38.034588 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:17:38.034588 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:17:38.034588 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 524/1048] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 12:17:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:17:38.040230 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e738750-6e7a-4214-8d8c-79068cdb8225 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:38.041052 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:38.109210 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 525/1049] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 12:17:37 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 12:17:38.114843 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf69428-3b52-4220-bc2e-f41cae82e615 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:38.176614 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e738750-6e7a-4214-8d8c-79068cdb8225 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:38.218747 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:38.234873 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194795a1-b034-4bf4-9132-ac7322729f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:38.235639 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194795a1-b034-4bf4-9132-ac7322729f21 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:38.236060 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194795a1-b034-4bf4-9132-ac7322729f21 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:38.236340 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194795a1-b034-4bf4-9132-ac7322729f21 None admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:38.237358 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194795a1-b034-4bf4-9132-ac7322729f21 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:38.237948 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194795a1-b034-4bf4-9132-ac7322729f21 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:38.239434 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194795a1-b034-4bf4-9132-ac7322729f21 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:38.249446 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf69428-3b52-4220-bc2e-f41cae82e615 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:38.262813 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 525/1050] 10.222.0.79 () {56 vars in 1148 bytes} [Wed Aug 31 12:17:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:17:38.263830 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194795a1-b034-4bf4-9132-ac7322729f21 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:38.293940 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c974c565-a684-46bd-ac15-a8e60ad40b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:38.294590 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c974c565-a684-46bd-ac15-a8e60ad40b07 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:38.294874 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c974c565-a684-46bd-ac15-a8e60ad40b07 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:38.295163 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c974c565-a684-46bd-ac15-a8e60ad40b07 None admin] PATH_INFO: `/v3/projects/5f3ea5efb09e4c80ad89505b6905f7d2` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:38.296407 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c974c565-a684-46bd-ac15-a8e60ad40b07 None admin] RBAC: Authorizing `identity:get_project(project_id=5f3ea5efb09e4c80ad89505b6905f7d2)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:38.297888 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c974c565-a684-46bd-ac15-a8e60ad40b07 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:38.300015 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 526/1051] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 12:17:38 2022] GET /identity/v3/projects/5f3ea5efb09e4c80ad89505b6905f7d2 => generated 311 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:17:38.309665 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c974c565-a684-46bd-ac15-a8e60ad40b07 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:38.337595 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:38.420158 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194795a1-b034-4bf4-9132-ac7322729f21 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:38.438574 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c974c565-a684-46bd-ac15-a8e60ad40b07 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:38.464922 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a739f33d-d941-4dfa-8e96-031de1450239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:38.465530 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a739f33d-d941-4dfa-8e96-031de1450239 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:38.465805 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a739f33d-d941-4dfa-8e96-031de1450239 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:38.466070 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a739f33d-d941-4dfa-8e96-031de1450239 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:38.466831 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a739f33d-d941-4dfa-8e96-031de1450239 None admin] RBAC: Adding query filter params (role.id=17ccc8cf2d4146ffa34cbd692c600ff7, scope.project.id=a94f4957f2a047cc844342e1c7c74ca5, user.id=62401c8e1457450590f4147e0665265a) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:38.467150 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a739f33d-d941-4dfa-8e96-031de1450239 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:38.468572 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a739f33d-d941-4dfa-8e96-031de1450239 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:38.482891 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 526/1052] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 12:17:38 2022] GET /identity/v3/role_assignments?user.id=62401c8e1457450590f4147e0665265a&scope.project.id=a94f4957f2a047cc844342e1c7c74ca5&role.id=17ccc8cf2d4146ffa34cbd692c600ff7 => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:38.508308 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f804b7-6ec5-40f6-b38c-e799562b17b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:38.509122 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f804b7-6ec5-40f6-b38c-e799562b17b3 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:38.509536 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f804b7-6ec5-40f6-b38c-e799562b17b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:38.509934 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f804b7-6ec5-40f6-b38c-e799562b17b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:38.510982 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f804b7-6ec5-40f6-b38c-e799562b17b3 None admin] RBAC: Adding query filter params (role.id=a332ef951db949b0bad7019fbd28a1b9, scope.project.id=5f3ea5efb09e4c80ad89505b6905f7d2, user.id=0a3f234434da4f68966af7eae9e5d16a) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:38.511457 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f804b7-6ec5-40f6-b38c-e799562b17b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:38.513170 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f804b7-6ec5-40f6-b38c-e799562b17b3 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:38.519985 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 527/1053] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 12:17:38 2022] GET /identity/v3/role_assignments?user.id=0a3f234434da4f68966af7eae9e5d16a&scope.project.id=5f3ea5efb09e4c80ad89505b6905f7d2&role.id=a332ef951db949b0bad7019fbd28a1b9 => generated 259 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:17:39.823454 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f7f97-bc7a-4326-96eb-a98501735d1b None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:39.823985 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f7f97-bc7a-4326-96eb-a98501735d1b None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:39.823985 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f7f97-bc7a-4326-96eb-a98501735d1b None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:39.825489 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 527/1054] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:17:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:17:39.830500 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cabaf2-32a5-44ef-a8e4-9b0a46b2bc90 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:39.830960 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cabaf2-32a5-44ef-a8e4-9b0a46b2bc90 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:39.831147 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cabaf2-32a5-44ef-a8e4-9b0a46b2bc90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:39.849597 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-51cabaf2-32a5-44ef-a8e4-9b0a46b2bc90 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:39.851027 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-51cabaf2-32a5-44ef-a8e4-9b0a46b2bc90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:39.921993 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 528/1055] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:17:39 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:17:40.189850 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77f7f97-bc7a-4326-96eb-a98501735d1b None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:40.242062 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:40.301127 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77f7f97-bc7a-4326-96eb-a98501735d1b None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:40.336035 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c67792-fabc-4130-a2b0-e1718e891a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:40.336676 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c67792-fabc-4130-a2b0-e1718e891a94 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:40.336956 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c67792-fabc-4130-a2b0-e1718e891a94 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:40.337481 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c67792-fabc-4130-a2b0-e1718e891a94 None admin] PATH_INFO: `/v3/services/image` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:40.338063 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c67792-fabc-4130-a2b0-e1718e891a94 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:40.339471 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c67792-fabc-4130-a2b0-e1718e891a94 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:40.348372 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-a7c67792-fabc-4130-a2b0-e1718e891a94 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 12:17:40.348372 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:40.348372 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 12:17:40.348372 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 12:17:40.348372 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 12:17:40.348372 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 12:17:40.348372 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 12:17:40.348372 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:17:40.348372 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 12:17:40.348372 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:17:40.348372 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:17:40.348372 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:17:40.348372 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:40.348372 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:17:40.348372 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:17:40.348372 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:17:40.348372 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:17:40.349405 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:17:40.349405 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:17:40.349405 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:17:40.349405 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:17:40.349405 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:17:40.349405 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:17:40.349405 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 12:17:40.349405 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 12:17:40.349405 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 12:17:40.349405 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 12:17:40.349405 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:17:40.349405 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:17:40.349405 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:17:40.349405 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:17:40.349405 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:17:40.349405 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:17:40.350843 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:17:40.350843 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:17:40.350843 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:17:40.350843 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:17:40.350843 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:17:40.350843 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:17:40.350843 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:17:40.350843 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:17:40.350843 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:17:40.350843 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:17:40.350843 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 12:17:40.350843 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:17:40.350843 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 12:17:40.350843 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:17:40.358860 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 528/1056] 10.222.0.79 () {56 vars in 1105 bytes} [Wed Aug 31 12:17:40 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:17:40.359137 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cabaf2-32a5-44ef-a8e4-9b0a46b2bc90 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:40.376593 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:40.434481 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba17ea-f99e-4823-88ae-492b93d92efc None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:40.434755 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba17ea-f99e-4823-88ae-492b93d92efc None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:40.435064 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba17ea-f99e-4823-88ae-492b93d92efc None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:40.436554 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 529/1057] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:17:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:17:40.442457 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a80e85-0d87-490d-96fb-46b1762c7a8a None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:40.442457 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a80e85-0d87-490d-96fb-46b1762c7a8a None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:40.442457 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a80e85-0d87-490d-96fb-46b1762c7a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:40.460691 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-32a80e85-0d87-490d-96fb-46b1762c7a8a None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:40.461886 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-32a80e85-0d87-490d-96fb-46b1762c7a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:40.473321 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cabaf2-32a5-44ef-a8e4-9b0a46b2bc90 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:40.513395 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce551dcc-8a74-4ea0-a380-5a7c95c53e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:40.514292 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce551dcc-8a74-4ea0-a380-5a7c95c53e95 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:40.514572 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce551dcc-8a74-4ea0-a380-5a7c95c53e95 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:40.514845 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce551dcc-8a74-4ea0-a380-5a7c95c53e95 None admin] PATH_INFO: `/v3/services` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:40.515658 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce551dcc-8a74-4ea0-a380-5a7c95c53e95 None admin] RBAC: Adding query filter params (name=image) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:40.516255 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce551dcc-8a74-4ea0-a380-5a7c95c53e95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:40.517631 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce551dcc-8a74-4ea0-a380-5a7c95c53e95 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:40.524548 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 529/1058] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:17:40 2022] GET /identity/v3/services?name=image => generated 122 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:40.529729 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce551dcc-8a74-4ea0-a380-5a7c95c53e95 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:40.535551 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 530/1059] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:17:40 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 12:17:40.536877 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d3cece-85e9-410e-8633-695117884ea3 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:40.537163 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d3cece-85e9-410e-8633-695117884ea3 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:40.537435 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d3cece-85e9-410e-8633-695117884ea3 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:40.539374 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 531/1060] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:17:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:17:40.544604 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f208f-ef60-489a-b7e8-f0ff64d05193 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:40.544886 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f208f-ef60-489a-b7e8-f0ff64d05193 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:40.545158 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f208f-ef60-489a-b7e8-f0ff64d05193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:40.564773 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-716f208f-ef60-489a-b7e8-f0ff64d05193 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:40.565974 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-716f208f-ef60-489a-b7e8-f0ff64d05193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:40.603768 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:40.626906 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:40.640471 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 532/1061] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:17:40 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 12:17:40.650760 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce551dcc-8a74-4ea0-a380-5a7c95c53e95 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:40.695558 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a406c66c-9fcd-4560-90c4-263cc27a6b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:40.696557 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a406c66c-9fcd-4560-90c4-263cc27a6b4d None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:40.696990 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a406c66c-9fcd-4560-90c4-263cc27a6b4d None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:40.697492 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a406c66c-9fcd-4560-90c4-263cc27a6b4d None admin] PATH_INFO: `/v3/services` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:40.698318 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a406c66c-9fcd-4560-90c4-263cc27a6b4d None admin] RBAC: Adding query filter params (type=image) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:40.698828 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a406c66c-9fcd-4560-90c4-263cc27a6b4d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:40.700626 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a406c66c-9fcd-4560-90c4-263cc27a6b4d None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:40.707681 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 530/1062] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:17:40 2022] GET /identity/v3/services?type=image => generated 350 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:17:40.714839 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716f208f-ef60-489a-b7e8-f0ff64d05193 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:40.821081 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a406c66c-9fcd-4560-90c4-263cc27a6b4d None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:40.836063 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716f208f-ef60-489a-b7e8-f0ff64d05193 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:40.875609 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0efbde-e8dd-40ff-87bb-6bf0bd5e1ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:40.876567 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0efbde-e8dd-40ff-87bb-6bf0bd5e1ca0 None admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:40.876857 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0efbde-e8dd-40ff-87bb-6bf0bd5e1ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:40.877126 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0efbde-e8dd-40ff-87bb-6bf0bd5e1ca0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:40.877819 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0efbde-e8dd-40ff-87bb-6bf0bd5e1ca0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:40.879231 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0efbde-e8dd-40ff-87bb-6bf0bd5e1ca0 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:40.903367 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 533/1063] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:17:40 2022] POST /identity/v3/endpoints => generated 327 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:17:40.929744 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0efbde-e8dd-40ff-87bb-6bf0bd5e1ca0 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:40.947279 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a406c66c-9fcd-4560-90c4-263cc27a6b4d None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:40.970317 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:41.004636 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6572a1c4-7224-4b0c-8f7b-5bdd2befd12b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:41.005344 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6572a1c4-7224-4b0c-8f7b-5bdd2befd12b None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:41.005618 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6572a1c4-7224-4b0c-8f7b-5bdd2befd12b None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:41.005891 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6572a1c4-7224-4b0c-8f7b-5bdd2befd12b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:41.019611 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6572a1c4-7224-4b0c-8f7b-5bdd2befd12b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:17:41.024878 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-6572a1c4-7224-4b0c-8f7b-5bdd2befd12b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 12:17:41.024878 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:41.024878 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:17:41.024878 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:17:41.024878 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:17:41.024878 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:17:41.024878 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:17:41.024878 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:17:41.024878 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:17:41.024878 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:17:41.024878 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:17:41.024878 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:17:41.024878 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:17:41.024878 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:17:41.024878 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:17:41.024878 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:17:41.026016 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:17:41.026016 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:17:41.026016 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:17:41.026016 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:17:41.026016 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:17:41.026016 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:17:41.026016 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:17:41.026016 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:17:41.026016 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:17:41.026016 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:17:41.026016 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:17:41.026016 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:17:41.026016 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:17:41.026016 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:17:41.026016 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:17:41.026016 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:17:41.026925 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:17:41.026925 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:17:41.026925 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:17:41.026925 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:17:41.026925 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:17:41.026925 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:17:41.026925 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:17:41.026925 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:17:41.026925 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:17:41.026925 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:17:41.026925 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 12:17:41.026925 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:17:41.026925 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 531/1064] 10.222.0.79 () {56 vars in 1120 bytes} [Wed Aug 31 12:17:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:17:41.035599 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6572a1c4-7224-4b0c-8f7b-5bdd2befd12b None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:41.041526 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:41.062715 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0efbde-e8dd-40ff-87bb-6bf0bd5e1ca0 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:41.103474 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d0653d-6c92-429b-a59c-231b82c34e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:41.104140 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d0653d-6c92-429b-a59c-231b82c34e7e None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:41.104427 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d0653d-6c92-429b-a59c-231b82c34e7e None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:41.104706 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d0653d-6c92-429b-a59c-231b82c34e7e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:41.118202 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d0653d-6c92-429b-a59c-231b82c34e7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:17:41.123169 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-a3d0653d-6c92-429b-a59c-231b82c34e7e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:17:41.123169 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:41.123169 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:17:41.123169 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:17:41.123169 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:17:41.123169 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:17:41.123169 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:17:41.123169 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:17:41.123169 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:17:41.123169 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:17:41.123169 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:17:41.123169 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:17:41.123169 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:17:41.123169 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:17:41.123169 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:17:41.123169 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:17:41.124148 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:17:41.124148 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:17:41.124148 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:17:41.124148 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:17:41.124148 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:17:41.124148 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:17:41.124148 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:17:41.124148 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:17:41.124148 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:17:41.124148 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:17:41.124148 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:17:41.124148 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:17:41.124148 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:17:41.124148 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:17:41.124148 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:17:41.124148 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:17:41.125026 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:17:41.125026 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:17:41.125026 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:17:41.125026 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:17:41.125026 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:17:41.125026 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:17:41.125026 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:17:41.125026 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:17:41.125026 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:17:41.125026 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:17:41.125026 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:17:41.125026 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:17:41.125839 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 534/1065] 10.222.0.79 () {56 vars in 1096 bytes} [Wed Aug 31 12:17:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:17:41.131970 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d0653d-6c92-429b-a59c-231b82c34e7e None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:41.182257 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6572a1c4-7224-4b0c-8f7b-5bdd2befd12b None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:41.223026 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377aa821-7398-4e3a-a335-c4ed5cb7a3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:41.223613 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377aa821-7398-4e3a-a335-c4ed5cb7a3ab None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:41.223894 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377aa821-7398-4e3a-a335-c4ed5cb7a3ab None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:41.224195 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377aa821-7398-4e3a-a335-c4ed5cb7a3ab None admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:41.224895 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377aa821-7398-4e3a-a335-c4ed5cb7a3ab None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:41.226291 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377aa821-7398-4e3a-a335-c4ed5cb7a3ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:41.228377 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377aa821-7398-4e3a-a335-c4ed5cb7a3ab None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:41.236696 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:41.246615 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 532/1066] 10.222.0.79 () {56 vars in 1115 bytes} [Wed Aug 31 12:17:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:41.248043 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377aa821-7398-4e3a-a335-c4ed5cb7a3ab None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:41.253184 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d0653d-6c92-429b-a59c-231b82c34e7e None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:41.296314 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137cf669-b12a-47bc-9aad-dc2b391f5408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:41.297018 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137cf669-b12a-47bc-9aad-dc2b391f5408 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:41.297376 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137cf669-b12a-47bc-9aad-dc2b391f5408 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:41.297651 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137cf669-b12a-47bc-9aad-dc2b391f5408 None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:41.298327 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137cf669-b12a-47bc-9aad-dc2b391f5408 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:41.298630 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137cf669-b12a-47bc-9aad-dc2b391f5408 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:41.300049 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137cf669-b12a-47bc-9aad-dc2b391f5408 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:41.310628 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 535/1067] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 12:17:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:17:41.316612 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137cf669-b12a-47bc-9aad-dc2b391f5408 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:41.320914 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:41.368889 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377aa821-7398-4e3a-a335-c4ed5cb7a3ab None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:41.406600 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f989f12b-cbbc-4600-9f46-7a62a769ca57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:41.407390 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f989f12b-cbbc-4600-9f46-7a62a769ca57 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:41.407668 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f989f12b-cbbc-4600-9f46-7a62a769ca57 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:41.408165 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f989f12b-cbbc-4600-9f46-7a62a769ca57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:41.421441 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f989f12b-cbbc-4600-9f46-7a62a769ca57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:41.423453 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f989f12b-cbbc-4600-9f46-7a62a769ca57 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:41.430029 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137cf669-b12a-47bc-9aad-dc2b391f5408 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:41.439749 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-f989f12b-cbbc-4600-9f46-7a62a769ca57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:17:41.439749 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:41.439749 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:17:41.439749 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:17:41.439749 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:17:41.439749 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:17:41.439749 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:17:41.439749 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:17:41.439749 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:17:41.439749 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:17:41.439749 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:17:41.439749 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:17:41.439749 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:17:41.439749 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:17:41.439749 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:17:41.439749 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:17:41.440792 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:17:41.440792 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:17:41.440792 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:17:41.440792 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:17:41.440792 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:17:41.440792 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:17:41.440792 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:17:41.440792 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:17:41.440792 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:17:41.440792 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:17:41.440792 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:17:41.440792 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:17:41.440792 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:17:41.440792 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:17:41.440792 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:17:41.440792 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:17:41.440792 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:17:41.441713 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:17:41.441713 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:17:41.441713 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:17:41.441713 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 533/1068] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:17:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:17:41.448227 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f989f12b-cbbc-4600-9f46-7a62a769ca57 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:41.478948 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092584e6-3951-4a7a-943c-dff04f618bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:41.479528 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092584e6-3951-4a7a-943c-dff04f618bc0 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:41.479815 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092584e6-3951-4a7a-943c-dff04f618bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:41.480089 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092584e6-3951-4a7a-943c-dff04f618bc0 None admin] PATH_INFO: `/v3/users/0a3f234434da4f68966af7eae9e5d16a` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:41.481276 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092584e6-3951-4a7a-943c-dff04f618bc0 None admin] RBAC: Authorizing `identity:get_user(user_id=0a3f234434da4f68966af7eae9e5d16a)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:41.483025 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092584e6-3951-4a7a-943c-dff04f618bc0 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:41.489499 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 536/1069] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 12:17:41 2022] GET /identity/v3/users/0a3f234434da4f68966af7eae9e5d16a => generated 285 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:17:41.490392 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092584e6-3951-4a7a-943c-dff04f618bc0 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:41.511858 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:41.555798 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f989f12b-cbbc-4600-9f46-7a62a769ca57 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:41.575678 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:41.596954 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4400b3-7e8c-4266-a5c7-28abe8b68ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:41.597529 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4400b3-7e8c-4266-a5c7-28abe8b68ecf None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:41.597813 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4400b3-7e8c-4266-a5c7-28abe8b68ecf None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:41.598261 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4400b3-7e8c-4266-a5c7-28abe8b68ecf None admin] PATH_INFO: `/v3/domains` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:41.598727 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4400b3-7e8c-4266-a5c7-28abe8b68ecf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:41.599142 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4400b3-7e8c-4266-a5c7-28abe8b68ecf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:41.601653 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4400b3-7e8c-4266-a5c7-28abe8b68ecf None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:41.601838 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092584e6-3951-4a7a-943c-dff04f618bc0 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:41.620927 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 534/1070] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 12:17:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:17:41.621759 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4400b3-7e8c-4266-a5c7-28abe8b68ecf None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:41.638178 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75837f62-4d8f-4214-aa62-d12bdb10dbcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:41.638823 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75837f62-4d8f-4214-aa62-d12bdb10dbcd None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:41.639131 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75837f62-4d8f-4214-aa62-d12bdb10dbcd None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:41.639406 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75837f62-4d8f-4214-aa62-d12bdb10dbcd None admin] PATH_INFO: `/v3/projects/5f3ea5efb09e4c80ad89505b6905f7d2` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:41.640540 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75837f62-4d8f-4214-aa62-d12bdb10dbcd None admin] RBAC: Authorizing `identity:get_project(project_id=5f3ea5efb09e4c80ad89505b6905f7d2)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:41.642033 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75837f62-4d8f-4214-aa62-d12bdb10dbcd None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:41.649030 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 537/1071] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 12:17:41 2022] GET /identity/v3/projects/5f3ea5efb09e4c80ad89505b6905f7d2 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:41.651185 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75837f62-4d8f-4214-aa62-d12bdb10dbcd None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:41.741632 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4400b3-7e8c-4266-a5c7-28abe8b68ecf None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:41.752435 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:41.773208 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75837f62-4d8f-4214-aa62-d12bdb10dbcd None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:41.782804 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257ecbb0-5c8b-4ff4-a8c7-40387cf7223c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:41.783577 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257ecbb0-5c8b-4ff4-a8c7-40387cf7223c None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:41.783938 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257ecbb0-5c8b-4ff4-a8c7-40387cf7223c None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:41.784218 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257ecbb0-5c8b-4ff4-a8c7-40387cf7223c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:41.792275 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257ecbb0-5c8b-4ff4-a8c7-40387cf7223c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:41.793711 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257ecbb0-5c8b-4ff4-a8c7-40387cf7223c None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:41.807167 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-257ecbb0-5c8b-4ff4-a8c7-40387cf7223c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 12:17:41.807167 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:41.807167 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:17:41.807167 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:17:41.807167 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:17:41.807167 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:17:41.807167 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:17:41.807167 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:17:41.807167 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:17:41.807167 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:17:41.807167 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:17:41.807167 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:17:41.807167 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:17:41.807167 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:17:41.807167 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:17:41.807167 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:17:41.808126 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:17:41.808126 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:17:41.808126 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:17:41.808126 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:17:41.808126 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:17:41.808126 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:17:41.808126 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:17:41.808126 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:17:41.808126 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:17:41.808126 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:17:41.808126 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:17:41.808126 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:17:41.808126 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:17:41.808126 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:17:41.808126 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:17:41.808126 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:17:41.808126 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:17:41.808126 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:17:41.809080 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:17:41.809080 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:17:41.809080 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:17:41.809080 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:17:41.809080 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:17:41.809080 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:17:41.809080 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:17:41.809080 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:17:41.809080 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 12:17:41.809080 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:17:41.809080 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 535/1072] 10.222.0.79 () {56 vars in 1093 bytes} [Wed Aug 31 12:17:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:17:41.811309 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77387d83-df43-4ad9-ac8f-6b2457ac9936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:41.811973 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77387d83-df43-4ad9-ac8f-6b2457ac9936 None admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:41.812248 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77387d83-df43-4ad9-ac8f-6b2457ac9936 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:41.812514 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77387d83-df43-4ad9-ac8f-6b2457ac9936 None admin] PATH_INFO: `/v3/projects/5f3ea5efb09e4c80ad89505b6905f7d2/users/0a3f234434da4f68966af7eae9e5d16a/roles/a332ef951db949b0bad7019fbd28a1b9` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:41.814108 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257ecbb0-5c8b-4ff4-a8c7-40387cf7223c None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:41.814633 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77387d83-df43-4ad9-ac8f-6b2457ac9936 None admin] RBAC: Authorizing `identity:create_grant(project_id=5f3ea5efb09e4c80ad89505b6905f7d2, user_id=0a3f234434da4f68966af7eae9e5d16a, role_id=a332ef951db949b0bad7019fbd28a1b9)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:41.816099 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77387d83-df43-4ad9-ac8f-6b2457ac9936 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:41.846884 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 538/1073] 10.222.0.79 () {58 vars in 1439 bytes} [Wed Aug 31 12:17:41 2022] PUT /identity/v3/projects/5f3ea5efb09e4c80ad89505b6905f7d2/users/0a3f234434da4f68966af7eae9e5d16a/roles/a332ef951db949b0bad7019fbd28a1b9 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:41.867119 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:41.944854 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257ecbb0-5c8b-4ff4-a8c7-40387cf7223c None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:41.987531 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef58766d-2874-436b-be34-7f4a690fadef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:41.988194 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef58766d-2874-436b-be34-7f4a690fadef None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:41.988407 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef58766d-2874-436b-be34-7f4a690fadef None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:41.988673 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef58766d-2874-436b-be34-7f4a690fadef None admin] PATH_INFO: `/v3/users` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:41.989412 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef58766d-2874-436b-be34-7f4a690fadef None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:41.989712 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef58766d-2874-436b-be34-7f4a690fadef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:41.992146 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef58766d-2874-436b-be34-7f4a690fadef None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:42.012853 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 536/1074] 10.222.0.79 () {56 vars in 1133 bytes} [Wed Aug 31 12:17:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:42.018825 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77387d83-df43-4ad9-ac8f-6b2457ac9936 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:42.128397 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77387d83-df43-4ad9-ac8f-6b2457ac9936 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:42.167631 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a45566-f9c4-41bf-9006-028593875031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:42.168705 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a45566-f9c4-41bf-9006-028593875031 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:42.169186 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a45566-f9c4-41bf-9006-028593875031 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:42.169651 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a45566-f9c4-41bf-9006-028593875031 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:42.182317 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a45566-f9c4-41bf-9006-028593875031 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:42.184189 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a45566-f9c4-41bf-9006-028593875031 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:42.187195 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:42.200901 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-89a45566-f9c4-41bf-9006-028593875031 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:17:42.200901 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:42.200901 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:17:42.200901 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:17:42.200901 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:17:42.200901 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:17:42.200901 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:17:42.200901 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:17:42.200901 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:17:42.200901 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:17:42.200901 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:17:42.200901 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:17:42.200901 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:17:42.200901 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:17:42.200901 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:17:42.200901 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:17:42.201907 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:17:42.201907 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:17:42.201907 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:17:42.201907 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:17:42.201907 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:17:42.201907 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:17:42.201907 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:17:42.201907 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:17:42.201907 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:17:42.201907 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:17:42.201907 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:17:42.201907 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:17:42.201907 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:17:42.201907 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:17:42.201907 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:17:42.201907 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:17:42.201907 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:17:42.203544 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:17:42.203544 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:17:42.203544 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:17:42.203883 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 539/1075] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:17:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:17:42.208195 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef58766d-2874-436b-be34-7f4a690fadef None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:42.306435 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:42.314020 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef58766d-2874-436b-be34-7f4a690fadef None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:42.348888 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dfbe99-f3e1-45e2-917c-171f9f7c90db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:42.349498 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dfbe99-f3e1-45e2-917c-171f9f7c90db None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:42.349782 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dfbe99-f3e1-45e2-917c-171f9f7c90db None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:42.350110 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dfbe99-f3e1-45e2-917c-171f9f7c90db None admin] PATH_INFO: `/v3/domains` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:42.350910 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dfbe99-f3e1-45e2-917c-171f9f7c90db None admin] RBAC: Adding query filter params (name=Default) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:42.351210 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dfbe99-f3e1-45e2-917c-171f9f7c90db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:42.354213 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dfbe99-f3e1-45e2-917c-171f9f7c90db None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:42.365585 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 537/1076] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 12:17:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:42.371799 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a45566-f9c4-41bf-9006-028593875031 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:42.494417 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a45566-f9c4-41bf-9006-028593875031 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:42.534742 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f9d20-0238-43ee-b330-2b86a1b2c9fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:42.535417 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f9d20-0238-43ee-b330-2b86a1b2c9fc None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:42.535702 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f9d20-0238-43ee-b330-2b86a1b2c9fc None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:42.535980 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f9d20-0238-43ee-b330-2b86a1b2c9fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:42.543881 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94f9d20-0238-43ee-b330-2b86a1b2c9fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:42.545326 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94f9d20-0238-43ee-b330-2b86a1b2c9fc None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:42.557446 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-c94f9d20-0238-43ee-b330-2b86a1b2c9fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:17:42.557446 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:42.557446 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:17:42.557446 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:17:42.557446 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:17:42.557446 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:17:42.557446 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:17:42.557446 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:17:42.557446 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:17:42.557446 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:17:42.557446 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:17:42.557446 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:17:42.557446 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:17:42.557446 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:17:42.557446 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:17:42.558449 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:17:42.558449 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:17:42.558449 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:17:42.558449 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:17:42.558449 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:17:42.558449 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:17:42.558449 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:17:42.558449 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:17:42.558449 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:17:42.558449 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:17:42.558449 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:17:42.558449 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:17:42.558449 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:17:42.558449 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:17:42.558449 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:17:42.558449 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:17:42.558449 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:17:42.564283 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:17:42.564283 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:17:42.564283 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:17:42.564283 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:17:42.564283 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:17:42.564283 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:17:42.564283 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:17:42.564283 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:17:42.564283 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 540/1077] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 12:17:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:17:42.564831 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dfbe99-f3e1-45e2-917c-171f9f7c90db None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:42.671578 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dfbe99-f3e1-45e2-917c-171f9f7c90db None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:42.707829 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7cdcec-fdff-4b97-8c8a-0765ba8c1282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:42.708434 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7cdcec-fdff-4b97-8c8a-0765ba8c1282 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:42.708716 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7cdcec-fdff-4b97-8c8a-0765ba8c1282 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:42.708990 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7cdcec-fdff-4b97-8c8a-0765ba8c1282 None admin] PATH_INFO: `/v3/projects` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:42.710126 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7cdcec-fdff-4b97-8c8a-0765ba8c1282 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:42.710915 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7cdcec-fdff-4b97-8c8a-0765ba8c1282 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:42.712634 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7cdcec-fdff-4b97-8c8a-0765ba8c1282 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:42.730907 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 538/1078] 10.222.0.79 () {56 vars in 1148 bytes} [Wed Aug 31 12:17:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:42.732162 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f9d20-0238-43ee-b330-2b86a1b2c9fc None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:42.794347 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:42.844294 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f9d20-0238-43ee-b330-2b86a1b2c9fc None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:42.890248 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa080e7-65e8-42ad-b2cf-c681b34c04e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:42.890942 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa080e7-65e8-42ad-b2cf-c681b34c04e0 None admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:42.891230 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa080e7-65e8-42ad-b2cf-c681b34c04e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:42.891503 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa080e7-65e8-42ad-b2cf-c681b34c04e0 None admin] PATH_INFO: `/v3/projects/a94f4957f2a047cc844342e1c7c74ca5/users/62401c8e1457450590f4147e0665265a/roles/17ccc8cf2d4146ffa34cbd692c600ff7` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:42.893712 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa080e7-65e8-42ad-b2cf-c681b34c04e0 None admin] RBAC: Authorizing `identity:create_grant(project_id=a94f4957f2a047cc844342e1c7c74ca5, user_id=62401c8e1457450590f4147e0665265a, role_id=17ccc8cf2d4146ffa34cbd692c600ff7)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:42.895391 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa080e7-65e8-42ad-b2cf-c681b34c04e0 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:42.918946 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 541/1079] 10.222.0.79 () {58 vars in 1439 bytes} [Wed Aug 31 12:17:42 2022] PUT /identity/v3/projects/a94f4957f2a047cc844342e1c7c74ca5/users/62401c8e1457450590f4147e0665265a/roles/17ccc8cf2d4146ffa34cbd692c600ff7 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:17:43.067317 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0680f8-e575-403e-b96d-7cb09e970b83 None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:43.067856 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0680f8-e575-403e-b96d-7cb09e970b83 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:43.067856 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0680f8-e575-403e-b96d-7cb09e970b83 None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:43.069999 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 539/1080] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:17:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:17:43.076244 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715918bf-fb78-4015-935f-73546ea699e6 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:43.076530 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715918bf-fb78-4015-935f-73546ea699e6 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:43.076954 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715918bf-fb78-4015-935f-73546ea699e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:43.098321 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-715918bf-fb78-4015-935f-73546ea699e6 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:43.099451 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-715918bf-fb78-4015-935f-73546ea699e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:43.176955 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 542/1081] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:17:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:17:43.455427 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0680f8-e575-403e-b96d-7cb09e970b83 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:43.473051 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:43.578138 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0680f8-e575-403e-b96d-7cb09e970b83 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:43.615232 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8edada-6b46-486e-90db-e59a609e2e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:43.616450 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8edada-6b46-486e-90db-e59a609e2e13 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:43.616736 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8edada-6b46-486e-90db-e59a609e2e13 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:43.617082 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8edada-6b46-486e-90db-e59a609e2e13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:43.702611 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8edada-6b46-486e-90db-e59a609e2e13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:43.704443 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8edada-6b46-486e-90db-e59a609e2e13 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:43.725173 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:43.786625 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d44f4d-2afd-4f4e-b5dd-794c5185974c None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:43.786959 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d44f4d-2afd-4f4e-b5dd-794c5185974c None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:43.787231 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d44f4d-2afd-4f4e-b5dd-794c5185974c None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:43.789561 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 543/1082] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:17:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:17:43.794770 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5581c521-40f5-44b6-952d-86487e133df7 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:43.795134 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5581c521-40f5-44b6-952d-86487e133df7 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:43.795395 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5581c521-40f5-44b6-952d-86487e133df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:43.814474 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-5581c521-40f5-44b6-952d-86487e133df7 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:43.815811 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-5581c521-40f5-44b6-952d-86487e133df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:43.826315 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 540/1083] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 12:17:43 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 12:17:43.831971 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8edada-6b46-486e-90db-e59a609e2e13 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:43.865918 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:43.903426 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 544/1084] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:17:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 12:17:43.953820 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8edada-6b46-486e-90db-e59a609e2e13 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:43.970793 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:43.994928 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8748b4-5ffc-499d-9d45-140d45580d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:43.995568 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8748b4-5ffc-499d-9d45-140d45580d3e None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:43.995857 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8748b4-5ffc-499d-9d45-140d45580d3e None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:43.996128 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8748b4-5ffc-499d-9d45-140d45580d3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:44.008461 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8748b4-5ffc-499d-9d45-140d45580d3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:44.011148 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8748b4-5ffc-499d-9d45-140d45580d3e None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:44.027730 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-da8748b4-5ffc-499d-9d45-140d45580d3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:17:44.027730 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:44.027730 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:17:44.027730 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:17:44.027730 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:17:44.027730 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:17:44.027730 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:17:44.027730 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:17:44.027730 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:17:44.027730 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:17:44.027730 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:17:44.027730 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:17:44.027730 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:17:44.027730 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:17:44.027730 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:17:44.027730 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:17:44.028917 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:17:44.028917 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:17:44.028917 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:17:44.028917 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:17:44.028917 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:17:44.028917 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:17:44.028917 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:17:44.028917 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:17:44.028917 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:17:44.028917 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:17:44.028917 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:17:44.028917 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:17:44.028917 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:17:44.028917 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:17:44.028917 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:17:44.028917 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:17:44.028917 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:17:44.029954 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:17:44.029954 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:17:44.029954 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:17:44.029954 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 541/1085] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:17:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:17:44.036689 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5581c521-40f5-44b6-952d-86487e133df7 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:44.145813 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5581c521-40f5-44b6-952d-86487e133df7 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:44.160276 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8748b4-5ffc-499d-9d45-140d45580d3e None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:44.184048 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bec2b4-10b3-48e4-a9b2-caecd06c838c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:44.184660 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bec2b4-10b3-48e4-a9b2-caecd06c838c None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:44.184934 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bec2b4-10b3-48e4-a9b2-caecd06c838c None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:44.185204 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bec2b4-10b3-48e4-a9b2-caecd06c838c None admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:44.185845 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bec2b4-10b3-48e4-a9b2-caecd06c838c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:44.186140 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bec2b4-10b3-48e4-a9b2-caecd06c838c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:44.187556 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bec2b4-10b3-48e4-a9b2-caecd06c838c None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:44.200086 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 545/1086] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 12:17:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:44.279774 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8748b4-5ffc-499d-9d45-140d45580d3e None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:44.322375 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabfe8a5-d772-41e0-b5f2-5eda357ad34c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:44.323403 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabfe8a5-d772-41e0-b5f2-5eda357ad34c None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:44.323891 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabfe8a5-d772-41e0-b5f2-5eda357ad34c None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:44.324388 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabfe8a5-d772-41e0-b5f2-5eda357ad34c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:44.339080 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabfe8a5-d772-41e0-b5f2-5eda357ad34c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:17:44.344603 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-aabfe8a5-d772-41e0-b5f2-5eda357ad34c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:17:44.344603 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:44.344603 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:17:44.344603 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:17:44.344603 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:17:44.344603 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:17:44.344603 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:17:44.344603 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:17:44.344603 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:17:44.344603 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:17:44.344603 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:17:44.344603 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:17:44.344603 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:17:44.344603 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:17:44.344603 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:17:44.344603 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:17:44.345658 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:17:44.345658 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:17:44.345658 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:17:44.345658 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:17:44.345658 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:17:44.345658 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:17:44.345658 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:17:44.345658 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:17:44.345658 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:17:44.345658 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:17:44.345658 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:17:44.345658 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:17:44.345658 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:17:44.345658 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:17:44.345658 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:17:44.345658 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:17:44.346522 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:17:44.346522 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:17:44.346522 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:17:44.346522 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:17:44.346522 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:17:44.346522 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:17:44.346522 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:17:44.346522 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:17:44.346522 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:17:44.346522 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:17:44.346522 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:17:44.346522 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:17:44.346522 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 542/1087] 10.222.0.79 () {56 vars in 1096 bytes} [Wed Aug 31 12:17:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:17:44.352466 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bec2b4-10b3-48e4-a9b2-caecd06c838c None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:44.399287 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:44.497030 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bec2b4-10b3-48e4-a9b2-caecd06c838c None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:44.536703 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2f3808-e3b3-42db-b6ea-660db0aa429a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:44.537273 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f3808-e3b3-42db-b6ea-660db0aa429a None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:44.537588 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f3808-e3b3-42db-b6ea-660db0aa429a None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:44.537856 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f3808-e3b3-42db-b6ea-660db0aa429a None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:44.538722 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2f3808-e3b3-42db-b6ea-660db0aa429a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:44.539050 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2f3808-e3b3-42db-b6ea-660db0aa429a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:44.540452 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2f3808-e3b3-42db-b6ea-660db0aa429a None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:44.550032 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 546/1088] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 12:17:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:44.557158 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabfe8a5-d772-41e0-b5f2-5eda357ad34c None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:44.588743 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:44.666260 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabfe8a5-d772-41e0-b5f2-5eda357ad34c None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:44.702178 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25f1ff8-a230-45a9-9925-96b8db64e165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:44.702818 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25f1ff8-a230-45a9-9925-96b8db64e165 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:44.703126 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25f1ff8-a230-45a9-9925-96b8db64e165 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:44.703401 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25f1ff8-a230-45a9-9925-96b8db64e165 None admin] PATH_INFO: `/v3/users/0a3f234434da4f68966af7eae9e5d16a` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:44.704530 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25f1ff8-a230-45a9-9925-96b8db64e165 None admin] RBAC: Authorizing `identity:get_user(user_id=0a3f234434da4f68966af7eae9e5d16a)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:44.705974 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25f1ff8-a230-45a9-9925-96b8db64e165 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:44.707616 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 543/1089] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 12:17:44 2022] GET /identity/v3/users/0a3f234434da4f68966af7eae9e5d16a => generated 285 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:44.714466 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2f3808-e3b3-42db-b6ea-660db0aa429a None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:44.812746 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:44.816708 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2f3808-e3b3-42db-b6ea-660db0aa429a None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:44.853100 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667eed22-0bd7-4d3d-8f01-fa7af8296114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:44.853701 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667eed22-0bd7-4d3d-8f01-fa7af8296114 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:44.853983 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667eed22-0bd7-4d3d-8f01-fa7af8296114 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:44.854255 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667eed22-0bd7-4d3d-8f01-fa7af8296114 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:44.888117 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a2136b-96f9-4560-80ba-a3606ee167eb None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:44.888405 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a2136b-96f9-4560-80ba-a3606ee167eb None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:44.888686 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a2136b-96f9-4560-80ba-a3606ee167eb None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:44.890077 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 544/1090] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:17:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:17:44.895203 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aca391-c3ba-4234-a76a-12b2fbea5d4e None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:44.895483 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aca391-c3ba-4234-a76a-12b2fbea5d4e None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:44.895754 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aca391-c3ba-4234-a76a-12b2fbea5d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:44.914746 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-60aca391-c3ba-4234-a76a-12b2fbea5d4e None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:44.916012 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-60aca391-c3ba-4234-a76a-12b2fbea5d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:44.926795 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667eed22-0bd7-4d3d-8f01-fa7af8296114 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:44.928854 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667eed22-0bd7-4d3d-8f01-fa7af8296114 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:44.989013 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 545/1091] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:17:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:17:45.032568 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:45.040416 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 547/1092] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 12:17:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 12:17:45.043372 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aca391-c3ba-4234-a76a-12b2fbea5d4e None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:45.068027 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:45.142372 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aca391-c3ba-4234-a76a-12b2fbea5d4e None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:45.175939 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec530d7c-846b-4caf-acfd-de2bdc153c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:45.176567 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec530d7c-846b-4caf-acfd-de2bdc153c54 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:45.176830 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec530d7c-846b-4caf-acfd-de2bdc153c54 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:45.177097 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec530d7c-846b-4caf-acfd-de2bdc153c54 None admin] PATH_INFO: `/v3/projects/5f3ea5efb09e4c80ad89505b6905f7d2` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:45.178234 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec530d7c-846b-4caf-acfd-de2bdc153c54 None admin] RBAC: Authorizing `identity:get_project(project_id=5f3ea5efb09e4c80ad89505b6905f7d2)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:45.179691 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec530d7c-846b-4caf-acfd-de2bdc153c54 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:45.181475 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 546/1093] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 12:17:45 2022] GET /identity/v3/projects/5f3ea5efb09e4c80ad89505b6905f7d2 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:45.187391 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667eed22-0bd7-4d3d-8f01-fa7af8296114 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:45.266814 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec530d7c-846b-4caf-acfd-de2bdc153c54 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:45.288786 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667eed22-0bd7-4d3d-8f01-fa7af8296114 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:45.325044 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c9833f-f1a3-470a-8688-3365687e96cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:45.325556 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c9833f-f1a3-470a-8688-3365687e96cd None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:45.325829 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c9833f-f1a3-470a-8688-3365687e96cd None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:45.326096 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c9833f-f1a3-470a-8688-3365687e96cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:45.326812 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c9833f-f1a3-470a-8688-3365687e96cd None admin] RBAC: Adding query filter params (role.id=a332ef951db949b0bad7019fbd28a1b9, scope.project.id=5f3ea5efb09e4c80ad89505b6905f7d2, user.id=0a3f234434da4f68966af7eae9e5d16a) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:45.327150 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c9833f-f1a3-470a-8688-3365687e96cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:45.328571 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c9833f-f1a3-470a-8688-3365687e96cd None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:45.334830 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 548/1094] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 12:17:45 2022] GET /identity/v3/role_assignments?user.id=0a3f234434da4f68966af7eae9e5d16a&scope.project.id=5f3ea5efb09e4c80ad89505b6905f7d2&role.id=a332ef951db949b0bad7019fbd28a1b9 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:45.367666 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:45.377376 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec530d7c-846b-4caf-acfd-de2bdc153c54 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:45.417620 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f3c9ca-6452-4de0-b5f3-3341689eb171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:45.418279 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f3c9ca-6452-4de0-b5f3-3341689eb171 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:45.418563 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f3c9ca-6452-4de0-b5f3-3341689eb171 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:45.418839 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f3c9ca-6452-4de0-b5f3-3341689eb171 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:45.431082 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f3c9ca-6452-4de0-b5f3-3341689eb171 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:17:45.436110 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-a7f3c9ca-6452-4de0-b5f3-3341689eb171 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 12:17:45.436110 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:45.436110 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:17:45.436110 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:17:45.436110 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:17:45.436110 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:17:45.436110 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:17:45.436110 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:17:45.436110 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:17:45.436110 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:17:45.436110 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:17:45.436110 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:17:45.436110 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:17:45.436110 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:17:45.436110 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:17:45.436110 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:17:45.437984 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:17:45.437984 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:17:45.437984 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:17:45.437984 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:17:45.437984 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:17:45.437984 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:17:45.437984 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:17:45.437984 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:17:45.437984 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:17:45.437984 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:17:45.437984 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:17:45.437984 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:17:45.437984 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:17:45.437984 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:17:45.437984 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:17:45.437984 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:17:45.439184 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:17:45.439184 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:17:45.439184 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:17:45.439184 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:17:45.439184 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:17:45.439184 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:17:45.439184 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:17:45.439184 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:17:45.439184 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:17:45.439184 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:17:45.439184 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 12:17:45.439184 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:17:45.439184 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 547/1095] 10.222.0.79 () {56 vars in 1120 bytes} [Wed Aug 31 12:17:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:17:45.443618 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c9833f-f1a3-470a-8688-3365687e96cd None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:45.512185 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:45.553350 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c9833f-f1a3-470a-8688-3365687e96cd None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:45.589672 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f7c1d5-689c-4afa-b38b-bad96d9f2e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:45.590204 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7c1d5-689c-4afa-b38b-bad96d9f2e16 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:45.590486 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7c1d5-689c-4afa-b38b-bad96d9f2e16 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:45.590757 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7c1d5-689c-4afa-b38b-bad96d9f2e16 None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:45.591448 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f7c1d5-689c-4afa-b38b-bad96d9f2e16 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:45.591749 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f7c1d5-689c-4afa-b38b-bad96d9f2e16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:45.593117 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f7c1d5-689c-4afa-b38b-bad96d9f2e16 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:45.602625 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 549/1096] 10.222.0.79 () {56 vars in 1115 bytes} [Wed Aug 31 12:17:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:45.608508 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f3c9ca-6452-4de0-b5f3-3341689eb171 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:45.711244 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f3c9ca-6452-4de0-b5f3-3341689eb171 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:45.745440 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5303aed7-3468-4340-a70e-77e5ecd0ec6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:45.746063 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5303aed7-3468-4340-a70e-77e5ecd0ec6b None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:45.746340 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5303aed7-3468-4340-a70e-77e5ecd0ec6b None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:45.746609 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5303aed7-3468-4340-a70e-77e5ecd0ec6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:45.756897 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5303aed7-3468-4340-a70e-77e5ecd0ec6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:45.758331 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5303aed7-3468-4340-a70e-77e5ecd0ec6b None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:45.772786 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-5303aed7-3468-4340-a70e-77e5ecd0ec6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:17:45.772786 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:45.772786 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:17:45.772786 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:17:45.772786 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:17:45.772786 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:17:45.772786 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:17:45.772786 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:17:45.772786 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:17:45.772786 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:17:45.772786 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:17:45.772786 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:17:45.772786 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:17:45.772786 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:17:45.772786 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:17:45.772786 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:17:45.773926 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:17:45.773926 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:17:45.773926 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:17:45.773926 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:17:45.773926 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:17:45.773926 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:17:45.773926 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:17:45.773926 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:17:45.773926 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:17:45.773926 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:17:45.773926 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:17:45.773926 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:17:45.773926 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:17:45.773926 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:17:45.773926 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:17:45.773926 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:17:45.773926 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:17:45.775221 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:17:45.775221 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:17:45.775221 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:17:45.775221 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 548/1097] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:17:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:17:45.779821 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f7c1d5-689c-4afa-b38b-bad96d9f2e16 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:45.889485 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f7c1d5-689c-4afa-b38b-bad96d9f2e16 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:45.914866 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:45.926273 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9a1e28-3929-4125-8629-0305d205d1bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:45.926901 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a1e28-3929-4125-8629-0305d205d1bb None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:45.927449 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a1e28-3929-4125-8629-0305d205d1bb None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:45.927449 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a1e28-3929-4125-8629-0305d205d1bb None admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:45.928073 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9a1e28-3929-4125-8629-0305d205d1bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:45.928394 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9a1e28-3929-4125-8629-0305d205d1bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:45.929765 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9a1e28-3929-4125-8629-0305d205d1bb None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:45.941497 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 550/1098] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 12:17:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:45.947206 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5303aed7-3468-4340-a70e-77e5ecd0ec6b None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:45.951780 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:46.049702 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5303aed7-3468-4340-a70e-77e5ecd0ec6b None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:46.082777 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d8aa6a-160f-421a-a8f1-1f85709f0b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:46.083442 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d8aa6a-160f-421a-a8f1-1f85709f0b88 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:46.083718 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d8aa6a-160f-421a-a8f1-1f85709f0b88 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:46.083986 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d8aa6a-160f-421a-a8f1-1f85709f0b88 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:46.092531 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d8aa6a-160f-421a-a8f1-1f85709f0b88 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:46.093969 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d8aa6a-160f-421a-a8f1-1f85709f0b88 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:46.105133 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-09d8aa6a-160f-421a-a8f1-1f85709f0b88 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 12:17:46.105133 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:46.105133 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:17:46.105133 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:17:46.105133 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:17:46.105133 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:17:46.105133 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:17:46.105133 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:17:46.105133 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:17:46.105133 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:17:46.105133 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:17:46.105133 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:17:46.105133 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:17:46.105133 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:17:46.105133 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:17:46.105133 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:17:46.106142 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:17:46.106142 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:17:46.106142 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:17:46.106142 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:17:46.106142 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:17:46.106142 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:17:46.106142 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:17:46.106142 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:17:46.106142 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:17:46.106142 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:17:46.106142 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:17:46.106142 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:17:46.106142 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:17:46.106142 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:17:46.106142 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:17:46.106142 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:17:46.106142 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:17:46.106142 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:17:46.107150 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:17:46.107150 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:17:46.107150 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:17:46.107150 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:17:46.107150 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:17:46.107150 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:17:46.107150 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:17:46.107150 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:17:46.107150 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 12:17:46.107150 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:17:46.111013 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 549/1099] 10.222.0.79 () {56 vars in 1093 bytes} [Wed Aug 31 12:17:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:17:46.112032 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9a1e28-3929-4125-8629-0305d205d1bb None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:46.209000 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9a1e28-3929-4125-8629-0305d205d1bb None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:46.243291 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4fe0bc-f17f-4cd4-a344-662ad345ca48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:46.243898 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4fe0bc-f17f-4cd4-a344-662ad345ca48 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:46.244198 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4fe0bc-f17f-4cd4-a344-662ad345ca48 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:46.244468 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4fe0bc-f17f-4cd4-a344-662ad345ca48 None admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:46.245191 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4fe0bc-f17f-4cd4-a344-662ad345ca48 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:46.245492 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4fe0bc-f17f-4cd4-a344-662ad345ca48 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:46.246949 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4fe0bc-f17f-4cd4-a344-662ad345ca48 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:46.265163 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 551/1100] 10.222.0.79 () {56 vars in 1133 bytes} [Wed Aug 31 12:17:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:17:46.270950 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d8aa6a-160f-421a-a8f1-1f85709f0b88 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:46.332182 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:46.373327 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d8aa6a-160f-421a-a8f1-1f85709f0b88 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:46.409889 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0fffb6-9030-4833-bd03-e4f9d52a1b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:46.410504 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0fffb6-9030-4833-bd03-e4f9d52a1b64 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:46.410771 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0fffb6-9030-4833-bd03-e4f9d52a1b64 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:46.411076 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0fffb6-9030-4833-bd03-e4f9d52a1b64 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:46.488541 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0fffb6-9030-4833-bd03-e4f9d52a1b64 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:46.489895 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0fffb6-9030-4833-bd03-e4f9d52a1b64 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:46.550416 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:46.588901 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 550/1101] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 12:17:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 12:17:46.594596 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4fe0bc-f17f-4cd4-a344-662ad345ca48 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:46.637789 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:46.693404 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4fe0bc-f17f-4cd4-a344-662ad345ca48 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:46.728040 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14954109-2827-4e9c-91a9-195a79f82ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:46.728659 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14954109-2827-4e9c-91a9-195a79f82ae1 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:46.728933 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14954109-2827-4e9c-91a9-195a79f82ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:46.729197 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14954109-2827-4e9c-91a9-195a79f82ae1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:46.739230 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14954109-2827-4e9c-91a9-195a79f82ae1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:46.740603 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14954109-2827-4e9c-91a9-195a79f82ae1 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:46.755365 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-14954109-2827-4e9c-91a9-195a79f82ae1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:17:46.755365 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:46.755365 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:17:46.755365 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:17:46.755365 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:17:46.755365 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:17:46.755365 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:17:46.755365 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:17:46.755365 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:17:46.755365 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:17:46.755365 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:17:46.755365 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:17:46.755365 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:17:46.755365 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:17:46.755365 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:17:46.755365 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:17:46.756619 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:17:46.756619 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:17:46.756619 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:17:46.756619 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:17:46.756619 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:17:46.756619 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:17:46.756619 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:17:46.756619 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:17:46.756619 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:17:46.756619 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:17:46.756619 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:17:46.756619 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:17:46.756619 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:17:46.756619 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:17:46.756619 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:17:46.756619 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:17:46.756619 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:17:46.758520 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:17:46.758520 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:17:46.758520 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:17:46.758817 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 552/1102] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:17:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:17:46.762294 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0fffb6-9030-4833-bd03-e4f9d52a1b64 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:46.865059 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0fffb6-9030-4833-bd03-e4f9d52a1b64 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:46.900542 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4231763-ea5c-4dcb-b219-c05e7873f9ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:46.901151 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4231763-ea5c-4dcb-b219-c05e7873f9ce None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:46.901430 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4231763-ea5c-4dcb-b219-c05e7873f9ce None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:46.901697 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4231763-ea5c-4dcb-b219-c05e7873f9ce None admin] PATH_INFO: `/v3/domains` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:46.902331 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4231763-ea5c-4dcb-b219-c05e7873f9ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:46.902629 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4231763-ea5c-4dcb-b219-c05e7873f9ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:46.904027 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4231763-ea5c-4dcb-b219-c05e7873f9ce None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:46.916359 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 551/1103] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 12:17:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:46.922023 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14954109-2827-4e9c-91a9-195a79f82ae1 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:47.029364 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:47.037176 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14954109-2827-4e9c-91a9-195a79f82ae1 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:47.072689 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ee2609-4d14-4ef2-a2c1-a368112d3ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:47.073330 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ee2609-4d14-4ef2-a2c1-a368112d3ae0 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:47.073608 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ee2609-4d14-4ef2-a2c1-a368112d3ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:47.073883 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ee2609-4d14-4ef2-a2c1-a368112d3ae0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:47.080787 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ee2609-4d14-4ef2-a2c1-a368112d3ae0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:47.082235 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ee2609-4d14-4ef2-a2c1-a368112d3ae0 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:47.094518 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-e3ee2609-4d14-4ef2-a2c1-a368112d3ae0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:17:47.094518 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:17:47.094518 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:17:47.094518 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:17:47.094518 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:17:47.094518 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:17:47.094518 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:17:47.094518 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:17:47.094518 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:17:47.094518 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:17:47.094518 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:17:47.094518 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:17:47.094518 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:17:47.094518 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:17:47.094518 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:17:47.095529 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:17:47.095529 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:17:47.095529 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:17:47.095529 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:17:47.095529 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:17:47.095529 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:17:47.095529 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:17:47.095529 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:17:47.095529 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:17:47.095529 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:17:47.095529 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:17:47.095529 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:17:47.095529 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:17:47.095529 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:17:47.095529 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:17:47.095529 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:17:47.095529 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:17:47.096443 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:17:47.096443 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:17:47.096443 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:17:47.096443 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:17:47.096443 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:17:47.096443 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:17:47.096443 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:17:47.096443 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:17:47.096443 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 553/1104] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 12:17:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:17:47.103139 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4231763-ea5c-4dcb-b219-c05e7873f9ce None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:47.132227 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:47.212668 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4231763-ea5c-4dcb-b219-c05e7873f9ce None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:47.249245 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfb03a2-4f30-46ac-9e3d-64578f2252cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:47.249868 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb03a2-4f30-46ac-9e3d-64578f2252cc None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:47.250153 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb03a2-4f30-46ac-9e3d-64578f2252cc None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:47.250594 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb03a2-4f30-46ac-9e3d-64578f2252cc None admin] PATH_INFO: `/v3/projects` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:47.251430 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfb03a2-4f30-46ac-9e3d-64578f2252cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:47.251735 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfb03a2-4f30-46ac-9e3d-64578f2252cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:47.253548 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfb03a2-4f30-46ac-9e3d-64578f2252cc None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:47.266170 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 552/1105] 10.222.0.79 () {56 vars in 1148 bytes} [Wed Aug 31 12:17:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:47.272556 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ee2609-4d14-4ef2-a2c1-a368112d3ae0 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:47.318480 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3127651-0fe4-4b1c-9ccf-9a95858ef630 None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:47.319061 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3127651-0fe4-4b1c-9ccf-9a95858ef630 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:47.319061 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3127651-0fe4-4b1c-9ccf-9a95858ef630 None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:47.320800 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 553/1106] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:17:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:17:47.326061 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ed173-c4a1-40f8-b9d2-df6168226fec None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:47.326323 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ed173-c4a1-40f8-b9d2-df6168226fec None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:47.326592 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ed173-c4a1-40f8-b9d2-df6168226fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:47.345322 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-d76ed173-c4a1-40f8-b9d2-df6168226fec None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:47.346524 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-d76ed173-c4a1-40f8-b9d2-df6168226fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:47.380624 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ee2609-4d14-4ef2-a2c1-a368112d3ae0 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:47.417166 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 554/1107] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:17:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 12:17:47.418681 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f194f9c8-88ff-4830-bf2d-cb3c4ac1123e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:47.419340 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f194f9c8-88ff-4830-bf2d-cb3c4ac1123e None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:47.419622 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f194f9c8-88ff-4830-bf2d-cb3c4ac1123e None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:47.419895 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f194f9c8-88ff-4830-bf2d-cb3c4ac1123e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:47.420633 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f194f9c8-88ff-4830-bf2d-cb3c4ac1123e None admin] RBAC: Adding query filter params (role.id=17ccc8cf2d4146ffa34cbd692c600ff7, scope.project.id=a94f4957f2a047cc844342e1c7c74ca5, user.id=62401c8e1457450590f4147e0665265a) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:47.420937 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f194f9c8-88ff-4830-bf2d-cb3c4ac1123e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:47.422378 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f194f9c8-88ff-4830-bf2d-cb3c4ac1123e None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:47.429737 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 554/1108] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 12:17:47 2022] GET /identity/v3/role_assignments?user.id=62401c8e1457450590f4147e0665265a&scope.project.id=a94f4957f2a047cc844342e1c7c74ca5&role.id=17ccc8cf2d4146ffa34cbd692c600ff7 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:47.690279 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76ed173-c4a1-40f8-b9d2-df6168226fec None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:47.706584 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:47.811841 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76ed173-c4a1-40f8-b9d2-df6168226fec None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:47.847479 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f3790e-e73d-41be-952a-9114d9c0c5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:47.848120 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f3790e-e73d-41be-952a-9114d9c0c5a7 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:47.848398 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f3790e-e73d-41be-952a-9114d9c0c5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:47.848668 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f3790e-e73d-41be-952a-9114d9c0c5a7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:47.849773 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f3790e-e73d-41be-952a-9114d9c0c5a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:47.851787 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f3790e-e73d-41be-952a-9114d9c0c5a7 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:47.853380 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 555/1109] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:17:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:47.859337 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f194f9c8-88ff-4830-bf2d-cb3c4ac1123e None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:47.882967 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:47.968033 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f194f9c8-88ff-4830-bf2d-cb3c4ac1123e None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:48.003727 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f264ec-a743-4f52-9342-3c3c6c4398db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:48.004354 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f264ec-a743-4f52-9342-3c3c6c4398db None admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:48.005209 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f264ec-a743-4f52-9342-3c3c6c4398db None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:48.005209 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f264ec-a743-4f52-9342-3c3c6c4398db None admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:48.005564 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f264ec-a743-4f52-9342-3c3c6c4398db None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:48.007678 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f264ec-a743-4f52-9342-3c3c6c4398db None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:48.034255 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 555/1110] 10.222.0.79 () {60 vars in 1132 bytes} [Wed Aug 31 12:17:47 2022] POST /identity/v3/users => generated 286 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:17:50.002296 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e72544b-6650-4d2e-9904-5f09af166d8f None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:50.002913 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e72544b-6650-4d2e-9904-5f09af166d8f None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:50.002913 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e72544b-6650-4d2e-9904-5f09af166d8f None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:50.004192 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 556/1111] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:17:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:17:50.009762 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d6786-6c17-4aa0-9aa9-2d45b4a5d35e None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:50.010229 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d6786-6c17-4aa0-9aa9-2d45b4a5d35e None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:50.010324 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d6786-6c17-4aa0-9aa9-2d45b4a5d35e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:50.035103 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-6b0d6786-6c17-4aa0-9aa9-2d45b4a5d35e None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:50.037118 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-6b0d6786-6c17-4aa0-9aa9-2d45b4a5d35e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:50.113299 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 556/1112] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:17:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:17:50.393337 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e72544b-6650-4d2e-9904-5f09af166d8f None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:50.479077 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:50.499122 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e72544b-6650-4d2e-9904-5f09af166d8f None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:50.533804 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cb2620-b6f4-4ca1-afd7-74644ce8c1ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:50.534432 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb2620-b6f4-4ca1-afd7-74644ce8c1ee None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:50.534708 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb2620-b6f4-4ca1-afd7-74644ce8c1ee None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:50.535011 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb2620-b6f4-4ca1-afd7-74644ce8c1ee None admin] PATH_INFO: `/v3/roles/be23fee6ea264172b277f97af30cc689` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:50.536402 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cb2620-b6f4-4ca1-afd7-74644ce8c1ee None admin] RBAC: Authorizing `identity:get_role(role_id=be23fee6ea264172b277f97af30cc689)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:50.537775 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cb2620-b6f4-4ca1-afd7-74644ce8c1ee None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:50.539257 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 557/1113] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 12:17:50 2022] GET /identity/v3/roles/be23fee6ea264172b277f97af30cc689 => generated 223 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:50.545217 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d6786-6c17-4aa0-9aa9-2d45b4a5d35e None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:50.548534 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:50.650835 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d6786-6c17-4aa0-9aa9-2d45b4a5d35e None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:50.688115 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f020306-7969-4424-af01-50e3762ae7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:50.688763 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f020306-7969-4424-af01-50e3762ae7cf None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:50.689041 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f020306-7969-4424-af01-50e3762ae7cf None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:50.689311 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f020306-7969-4424-af01-50e3762ae7cf None admin] PATH_INFO: `/v3/users/e303a0b176fc4eaf94464a0975a5b6f9` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:50.706363 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f020306-7969-4424-af01-50e3762ae7cf None admin] RBAC: Authorizing `identity:get_user(user_id=e303a0b176fc4eaf94464a0975a5b6f9)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:50.707893 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f020306-7969-4424-af01-50e3762ae7cf None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:50.710075 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 557/1114] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 12:17:50 2022] GET /identity/v3/users/e303a0b176fc4eaf94464a0975a5b6f9 => generated 286 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:50.716474 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cb2620-b6f4-4ca1-afd7-74644ce8c1ee None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:50.825166 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cb2620-b6f4-4ca1-afd7-74644ce8c1ee None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:50.859750 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a935694-f76a-466b-89b7-c64deb1ab911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:50.860397 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a935694-f76a-466b-89b7-c64deb1ab911 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:50.860640 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a935694-f76a-466b-89b7-c64deb1ab911 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:50.860910 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a935694-f76a-466b-89b7-c64deb1ab911 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:50.879151 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:50.928456 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a935694-f76a-466b-89b7-c64deb1ab911 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:50.929803 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a935694-f76a-466b-89b7-c64deb1ab911 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:51.028573 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 558/1115] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 12:17:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 12:17:51.034554 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f020306-7969-4424-af01-50e3762ae7cf None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:51.095579 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:51.134297 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f020306-7969-4424-af01-50e3762ae7cf None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:51.167962 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b3e837-0d48-473d-b448-856b5b5b6cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:51.168593 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b3e837-0d48-473d-b448-856b5b5b6cdd None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:51.168873 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b3e837-0d48-473d-b448-856b5b5b6cdd None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:51.169145 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b3e837-0d48-473d-b448-856b5b5b6cdd None admin] PATH_INFO: `/v3/projects/5f3ea5efb09e4c80ad89505b6905f7d2` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:51.170254 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b3e837-0d48-473d-b448-856b5b5b6cdd None admin] RBAC: Authorizing `identity:get_project(project_id=5f3ea5efb09e4c80ad89505b6905f7d2)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:51.171722 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b3e837-0d48-473d-b448-856b5b5b6cdd None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:51.173377 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 558/1116] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 12:17:51 2022] GET /identity/v3/projects/5f3ea5efb09e4c80ad89505b6905f7d2 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:51.180301 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a935694-f76a-466b-89b7-c64deb1ab911 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:51.229091 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:51.282694 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a935694-f76a-466b-89b7-c64deb1ab911 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:51.316320 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa0788a-15a6-4faf-a4cf-040455c7f8a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:51.316936 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa0788a-15a6-4faf-a4cf-040455c7f8a7 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:51.317215 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa0788a-15a6-4faf-a4cf-040455c7f8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:51.317490 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa0788a-15a6-4faf-a4cf-040455c7f8a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:51.318207 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa0788a-15a6-4faf-a4cf-040455c7f8a7 None admin] RBAC: Adding query filter params (role.id=be23fee6ea264172b277f97af30cc689, scope.project.id=5f3ea5efb09e4c80ad89505b6905f7d2, user.id=e303a0b176fc4eaf94464a0975a5b6f9) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:51.318514 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa0788a-15a6-4faf-a4cf-040455c7f8a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:51.320715 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa0788a-15a6-4faf-a4cf-040455c7f8a7 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:51.326056 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 559/1117] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 12:17:51 2022] GET /identity/v3/role_assignments?user.id=e303a0b176fc4eaf94464a0975a5b6f9&scope.project.id=5f3ea5efb09e4c80ad89505b6905f7d2&role.id=be23fee6ea264172b277f97af30cc689 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:53.325441 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eacbac5-cc19-4434-b560-f2878ef2f20d None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:53.325988 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eacbac5-cc19-4434-b560-f2878ef2f20d None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:53.325988 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eacbac5-cc19-4434-b560-f2878ef2f20d None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:53.327444 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 559/1118] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:17:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:17:53.332675 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab1d692-4ccd-4cea-a94d-9375f0547c0c None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:53.333096 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab1d692-4ccd-4cea-a94d-9375f0547c0c None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:53.333226 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab1d692-4ccd-4cea-a94d-9375f0547c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:53.351939 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-eab1d692-4ccd-4cea-a94d-9375f0547c0c None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:53.353167 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-eab1d692-4ccd-4cea-a94d-9375f0547c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:53.430938 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 560/1119] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:17:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:17:53.722461 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eacbac5-cc19-4434-b560-f2878ef2f20d None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:53.825950 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eacbac5-cc19-4434-b560-f2878ef2f20d None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:53.855775 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:53.861992 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a0fb45-28b3-4d08-b261-147eaa3f597b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:53.862626 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a0fb45-28b3-4d08-b261-147eaa3f597b None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:53.862941 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a0fb45-28b3-4d08-b261-147eaa3f597b None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:53.863220 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a0fb45-28b3-4d08-b261-147eaa3f597b None admin] PATH_INFO: `/v3/roles/be23fee6ea264172b277f97af30cc689` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:53.864625 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a0fb45-28b3-4d08-b261-147eaa3f597b None admin] RBAC: Authorizing `identity:get_role(role_id=be23fee6ea264172b277f97af30cc689)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:53.866542 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a0fb45-28b3-4d08-b261-147eaa3f597b None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:53.867916 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 560/1120] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 12:17:53 2022] GET /identity/v3/roles/be23fee6ea264172b277f97af30cc689 => generated 223 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:53.873762 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab1d692-4ccd-4cea-a94d-9375f0547c0c None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:53.920647 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:53.976884 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab1d692-4ccd-4cea-a94d-9375f0547c0c None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:54.010859 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b62f69-6d97-4eb9-b978-f4fe629f5763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:54.011510 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b62f69-6d97-4eb9-b978-f4fe629f5763 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:54.011791 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b62f69-6d97-4eb9-b978-f4fe629f5763 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:54.012060 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b62f69-6d97-4eb9-b978-f4fe629f5763 None admin] PATH_INFO: `/v3/users/e303a0b176fc4eaf94464a0975a5b6f9` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:54.013171 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b62f69-6d97-4eb9-b978-f4fe629f5763 None admin] RBAC: Authorizing `identity:get_user(user_id=e303a0b176fc4eaf94464a0975a5b6f9)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:54.014613 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b62f69-6d97-4eb9-b978-f4fe629f5763 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:54.016232 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 561/1121] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 12:17:53 2022] GET /identity/v3/users/e303a0b176fc4eaf94464a0975a5b6f9 => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:54.023174 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a0fb45-28b3-4d08-b261-147eaa3f597b None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:54.124266 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a0fb45-28b3-4d08-b261-147eaa3f597b None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:54.159339 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99d6cb4-e257-4501-baf8-04794adb14c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:54.159968 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d6cb4-e257-4501-baf8-04794adb14c1 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:54.160248 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d6cb4-e257-4501-baf8-04794adb14c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:54.160525 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d6cb4-e257-4501-baf8-04794adb14c1 None admin] PATH_INFO: `/v3/projects/5f3ea5efb09e4c80ad89505b6905f7d2` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:54.161635 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99d6cb4-e257-4501-baf8-04794adb14c1 None admin] RBAC: Authorizing `identity:get_project(project_id=5f3ea5efb09e4c80ad89505b6905f7d2)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:54.163682 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99d6cb4-e257-4501-baf8-04794adb14c1 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:54.165317 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 561/1122] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 12:17:54 2022] GET /identity/v3/projects/5f3ea5efb09e4c80ad89505b6905f7d2 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:54.171295 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b62f69-6d97-4eb9-b978-f4fe629f5763 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:54.273921 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b62f69-6d97-4eb9-b978-f4fe629f5763 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:54.286927 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:54.308870 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54c418f-d280-488b-8257-1988b75cd094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:54.309526 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c418f-d280-488b-8257-1988b75cd094 None admin] REQUEST_METHOD: `PUT` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:54.309803 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c418f-d280-488b-8257-1988b75cd094 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:54.310075 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c418f-d280-488b-8257-1988b75cd094 None admin] PATH_INFO: `/v3/projects/5f3ea5efb09e4c80ad89505b6905f7d2/users/e303a0b176fc4eaf94464a0975a5b6f9/roles/be23fee6ea264172b277f97af30cc689` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:54.312261 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54c418f-d280-488b-8257-1988b75cd094 None admin] RBAC: Authorizing `identity:create_grant(project_id=5f3ea5efb09e4c80ad89505b6905f7d2, user_id=e303a0b176fc4eaf94464a0975a5b6f9, role_id=be23fee6ea264172b277f97af30cc689)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:54.313688 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54c418f-d280-488b-8257-1988b75cd094 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:54.326731 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 562/1123] 10.222.0.79 () {58 vars in 1439 bytes} [Wed Aug 31 12:17:54 2022] PUT /identity/v3/projects/5f3ea5efb09e4c80ad89505b6905f7d2/users/e303a0b176fc4eaf94464a0975a5b6f9/roles/be23fee6ea264172b277f97af30cc689 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:56.224383 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f39db-46d1-490c-9979-9eacd288ad47 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:56.225026 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f39db-46d1-490c-9979-9eacd288ad47 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:56.225026 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f39db-46d1-490c-9979-9eacd288ad47 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:56.226296 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 562/1124] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:17:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:17:56.231743 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e466d03-a982-4719-bdba-c498e8708f00 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:56.232188 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e466d03-a982-4719-bdba-c498e8708f00 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:56.232279 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e466d03-a982-4719-bdba-c498e8708f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:56.250327 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-7e466d03-a982-4719-bdba-c498e8708f00 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:56.251561 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-7e466d03-a982-4719-bdba-c498e8708f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:56.317462 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 563/1125] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:17:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:17:56.585667 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318f39db-46d1-490c-9979-9eacd288ad47 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:56.650597 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:56.686049 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318f39db-46d1-490c-9979-9eacd288ad47 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:56.720344 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba706aa-bb60-4c26-89b7-13b1133e8d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:56.720970 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba706aa-bb60-4c26-89b7-13b1133e8d03 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:56.721245 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba706aa-bb60-4c26-89b7-13b1133e8d03 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:56.721513 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba706aa-bb60-4c26-89b7-13b1133e8d03 None admin] PATH_INFO: `/v3/roles/be23fee6ea264172b277f97af30cc689` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:56.722922 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba706aa-bb60-4c26-89b7-13b1133e8d03 None admin] RBAC: Authorizing `identity:get_role(role_id=be23fee6ea264172b277f97af30cc689)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:56.724294 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba706aa-bb60-4c26-89b7-13b1133e8d03 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:56.725650 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 563/1126] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 12:17:56 2022] GET /identity/v3/roles/be23fee6ea264172b277f97af30cc689 => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:56.731518 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e466d03-a982-4719-bdba-c498e8708f00 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:56.831007 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e466d03-a982-4719-bdba-c498e8708f00 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:56.832561 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:56.865261 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b966752-0a4f-46dd-9519-862e8ae67456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:56.865849 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b966752-0a4f-46dd-9519-862e8ae67456 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:56.866152 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b966752-0a4f-46dd-9519-862e8ae67456 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:56.866390 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b966752-0a4f-46dd-9519-862e8ae67456 None admin] PATH_INFO: `/v3/users/e303a0b176fc4eaf94464a0975a5b6f9` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:56.867506 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b966752-0a4f-46dd-9519-862e8ae67456 None admin] RBAC: Authorizing `identity:get_user(user_id=e303a0b176fc4eaf94464a0975a5b6f9)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:56.868932 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b966752-0a4f-46dd-9519-862e8ae67456 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:56.870499 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 564/1127] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 12:17:56 2022] GET /identity/v3/users/e303a0b176fc4eaf94464a0975a5b6f9 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:56.876325 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba706aa-bb60-4c26-89b7-13b1133e8d03 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:56.974652 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba706aa-bb60-4c26-89b7-13b1133e8d03 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:57.007594 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92407853-7496-402b-92c3-8a23a2c4430a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:57.008189 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92407853-7496-402b-92c3-8a23a2c4430a None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:57.008465 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92407853-7496-402b-92c3-8a23a2c4430a None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:57.008730 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92407853-7496-402b-92c3-8a23a2c4430a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:57.011479 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:57.077305 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92407853-7496-402b-92c3-8a23a2c4430a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:57.078752 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92407853-7496-402b-92c3-8a23a2c4430a None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:57.185459 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 564/1128] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 12:17:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 12:17:57.191332 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b966752-0a4f-46dd-9519-862e8ae67456 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:57.289653 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b966752-0a4f-46dd-9519-862e8ae67456 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:57.321862 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db5700d-b377-4c08-904e-45416d1dc340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:57.322480 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db5700d-b377-4c08-904e-45416d1dc340 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:57.322754 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db5700d-b377-4c08-904e-45416d1dc340 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:57.323051 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db5700d-b377-4c08-904e-45416d1dc340 None admin] PATH_INFO: `/v3/projects/5f3ea5efb09e4c80ad89505b6905f7d2` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:57.324143 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db5700d-b377-4c08-904e-45416d1dc340 None admin] RBAC: Authorizing `identity:get_project(project_id=5f3ea5efb09e4c80ad89505b6905f7d2)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:57.325563 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db5700d-b377-4c08-904e-45416d1dc340 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:57.327209 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 565/1129] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 12:17:57 2022] GET /identity/v3/projects/5f3ea5efb09e4c80ad89505b6905f7d2 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:57.333393 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92407853-7496-402b-92c3-8a23a2c4430a None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:57.367920 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:57.431517 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92407853-7496-402b-92c3-8a23a2c4430a None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:57.465738 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12beb9b-37f1-45a8-b8fc-7140cdc1665c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:57.466343 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12beb9b-37f1-45a8-b8fc-7140cdc1665c None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:57.466622 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12beb9b-37f1-45a8-b8fc-7140cdc1665c None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:57.466920 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12beb9b-37f1-45a8-b8fc-7140cdc1665c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:57.467641 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12beb9b-37f1-45a8-b8fc-7140cdc1665c None admin] RBAC: Adding query filter params (role.id=be23fee6ea264172b277f97af30cc689, scope.project.id=5f3ea5efb09e4c80ad89505b6905f7d2, user.id=e303a0b176fc4eaf94464a0975a5b6f9) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:57.467940 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12beb9b-37f1-45a8-b8fc-7140cdc1665c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:57.469389 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12beb9b-37f1-45a8-b8fc-7140cdc1665c None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:57.475540 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 565/1130] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 12:17:57 2022] GET /identity/v3/role_assignments?user.id=e303a0b176fc4eaf94464a0975a5b6f9&scope.project.id=5f3ea5efb09e4c80ad89505b6905f7d2&role.id=be23fee6ea264172b277f97af30cc689 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:59.445594 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ebea6-c33e-4c65-9eb0-289b500fe0ec None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:59.445594 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ebea6-c33e-4c65-9eb0-289b500fe0ec None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:59.446053 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ebea6-c33e-4c65-9eb0-289b500fe0ec None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:59.447335 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 566/1131] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:17:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:17:59.452853 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82a515-bd3b-4e87-93a1-98aed1cc293e None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:59.453456 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82a515-bd3b-4e87-93a1-98aed1cc293e None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:59.453456 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82a515-bd3b-4e87-93a1-98aed1cc293e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:59.472487 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-af82a515-bd3b-4e87-93a1-98aed1cc293e None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:59.473711 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-af82a515-bd3b-4e87-93a1-98aed1cc293e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:59.548217 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 566/1132] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:17:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:17:59.815295 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955ebea6-c33e-4c65-9eb0-289b500fe0ec None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:59.857296 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:59.918254 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955ebea6-c33e-4c65-9eb0-289b500fe0ec None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:59.951465 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bab9490-176f-4c1d-b559-78213451c83a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:59.952095 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab9490-176f-4c1d-b559-78213451c83a None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:59.952368 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab9490-176f-4c1d-b559-78213451c83a None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:59.952635 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab9490-176f-4c1d-b559-78213451c83a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:59.953746 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bab9490-176f-4c1d-b559-78213451c83a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:59.955205 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bab9490-176f-4c1d-b559-78213451c83a None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:59.956780 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 567/1133] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:17:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:59.963354 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af82a515-bd3b-4e87-93a1-98aed1cc293e None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:59.990660 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:18:00.061491 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af82a515-bd3b-4e87-93a1-98aed1cc293e None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:00.095198 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b64615-1b61-4322-896d-ec8ca9952ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:00.095717 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b64615-1b61-4322-896d-ec8ca9952ab5 None admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:00.095994 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b64615-1b61-4322-896d-ec8ca9952ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:00.096259 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b64615-1b61-4322-896d-ec8ca9952ab5 None admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:00.096898 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b64615-1b61-4322-896d-ec8ca9952ab5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:00.098328 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b64615-1b61-4322-896d-ec8ca9952ab5 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:00.124296 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 567/1134] 10.222.0.79 () {60 vars in 1141 bytes} [Wed Aug 31 12:17:59 2022] POST /identity/v3/projects => generated 311 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:18:02.077586 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b27b358-7bc9-49e3-89be-a81ebddf06cc None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:02.078121 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b27b358-7bc9-49e3-89be-a81ebddf06cc None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:02.078121 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b27b358-7bc9-49e3-89be-a81ebddf06cc None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:02.079524 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 568/1135] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:18:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:18:02.084860 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e7d5e0-915a-4933-909c-81e5713da5e9 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:02.085307 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e7d5e0-915a-4933-909c-81e5713da5e9 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:02.085397 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e7d5e0-915a-4933-909c-81e5713da5e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:02.104011 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-52e7d5e0-915a-4933-909c-81e5713da5e9 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:18:02.105198 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-52e7d5e0-915a-4933-909c-81e5713da5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:18:02.171175 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 568/1136] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:18:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:18:02.439098 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b27b358-7bc9-49e3-89be-a81ebddf06cc None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:02.551342 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b27b358-7bc9-49e3-89be-a81ebddf06cc None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:02.560962 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:18:02.590581 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc33fc9-02b0-43ed-ad32-b7d71bc38812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:02.591276 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc33fc9-02b0-43ed-ad32-b7d71bc38812 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:02.591559 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc33fc9-02b0-43ed-ad32-b7d71bc38812 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:02.591831 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc33fc9-02b0-43ed-ad32-b7d71bc38812 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:02.592998 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc33fc9-02b0-43ed-ad32-b7d71bc38812 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:02.594478 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc33fc9-02b0-43ed-ad32-b7d71bc38812 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:02.596145 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 569/1137] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:18:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:18:02.603251 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e7d5e0-915a-4933-909c-81e5713da5e9 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:02.615232 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:18:02.704526 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e7d5e0-915a-4933-909c-81e5713da5e9 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:02.738793 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f77e02e-43bd-4035-939f-debcfd66592f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:02.739429 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f77e02e-43bd-4035-939f-debcfd66592f None admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:02.739709 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f77e02e-43bd-4035-939f-debcfd66592f None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:02.739980 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f77e02e-43bd-4035-939f-debcfd66592f None admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:02.740709 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f77e02e-43bd-4035-939f-debcfd66592f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:02.742082 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f77e02e-43bd-4035-939f-debcfd66592f None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:02.765797 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 569/1138] 10.222.0.79 () {60 vars in 1132 bytes} [Wed Aug 31 12:18:02 2022] POST /identity/v3/users => generated 286 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:18:04.721310 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be29086f-4130-449e-8c23-ce854338d62e None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:04.721833 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be29086f-4130-449e-8c23-ce854338d62e None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:04.721833 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be29086f-4130-449e-8c23-ce854338d62e None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:04.723152 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 570/1139] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:18:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:18:04.728436 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf602b32-8e52-4c91-94d8-2f0fdfc1a5b7 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:04.728831 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf602b32-8e52-4c91-94d8-2f0fdfc1a5b7 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:04.728989 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf602b32-8e52-4c91-94d8-2f0fdfc1a5b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:04.747489 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-bf602b32-8e52-4c91-94d8-2f0fdfc1a5b7 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:18:04.748683 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-bf602b32-8e52-4c91-94d8-2f0fdfc1a5b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:18:04.809323 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:18:04.817812 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 570/1140] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:18:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:18:05.089396 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be29086f-4130-449e-8c23-ce854338d62e None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:05.195325 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be29086f-4130-449e-8c23-ce854338d62e None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:05.229585 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa342b93-6bb4-4875-915e-75ac87363559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:05.230222 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa342b93-6bb4-4875-915e-75ac87363559 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:05.230501 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa342b93-6bb4-4875-915e-75ac87363559 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:05.230771 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa342b93-6bb4-4875-915e-75ac87363559 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:05.240908 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa342b93-6bb4-4875-915e-75ac87363559 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:18:05.245821 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-aa342b93-6bb4-4875-915e-75ac87363559 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:18:05.245821 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:18:05.245821 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:18:05.245821 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:18:05.245821 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:18:05.245821 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:18:05.245821 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:18:05.245821 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:18:05.245821 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:18:05.245821 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:18:05.245821 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:18:05.245821 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:18:05.245821 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:18:05.245821 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:18:05.245821 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:18:05.245821 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:18:05.247033 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:18:05.247033 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:18:05.247033 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:18:05.247033 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:18:05.247033 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:18:05.247033 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:18:05.247033 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:18:05.247033 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:18:05.247033 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:18:05.247033 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:18:05.247033 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:18:05.247033 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:18:05.247033 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:18:05.247033 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:18:05.247033 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:18:05.247033 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:18:05.247958 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:18:05.247958 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:18:05.247958 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:18:05.247958 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:18:05.247958 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:18:05.247958 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:18:05.247958 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:18:05.247958 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:18:05.247958 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:18:05.247958 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:18:05.247958 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:18:05.247958 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:18:05.247958 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 571/1141] 10.222.0.79 () {56 vars in 1096 bytes} [Wed Aug 31 12:18:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:18:05.253283 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf602b32-8e52-4c91-94d8-2f0fdfc1a5b7 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:05.352992 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf602b32-8e52-4c91-94d8-2f0fdfc1a5b7 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:05.386906 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116e2a59-f6c3-4d0a-85c1-bc36a1dd7d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:05.387516 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e2a59-f6c3-4d0a-85c1-bc36a1dd7d69 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:05.387794 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e2a59-f6c3-4d0a-85c1-bc36a1dd7d69 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:05.388065 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e2a59-f6c3-4d0a-85c1-bc36a1dd7d69 None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:05.388730 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116e2a59-f6c3-4d0a-85c1-bc36a1dd7d69 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:18:05.389032 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116e2a59-f6c3-4d0a-85c1-bc36a1dd7d69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:05.390424 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116e2a59-f6c3-4d0a-85c1-bc36a1dd7d69 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:05.399282 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 571/1142] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 12:18:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:18:05.405131 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa342b93-6bb4-4875-915e-75ac87363559 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:05.440723 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:18:05.508143 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa342b93-6bb4-4875-915e-75ac87363559 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:05.542599 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff7f41d-c071-4a39-aa35-0261879ae4c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:05.543264 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff7f41d-c071-4a39-aa35-0261879ae4c1 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:05.543550 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff7f41d-c071-4a39-aa35-0261879ae4c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:05.543817 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff7f41d-c071-4a39-aa35-0261879ae4c1 None admin] PATH_INFO: `/v3/users/78dd97fcaa5e401596b647266acb42bd` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:05.556904 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff7f41d-c071-4a39-aa35-0261879ae4c1 None admin] RBAC: Authorizing `identity:get_user(user_id=78dd97fcaa5e401596b647266acb42bd)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:05.558363 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff7f41d-c071-4a39-aa35-0261879ae4c1 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:05.560070 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 572/1143] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 12:18:05 2022] GET /identity/v3/users/78dd97fcaa5e401596b647266acb42bd => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:18:05.566140 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116e2a59-f6c3-4d0a-85c1-bc36a1dd7d69 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:05.626994 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:18:05.670059 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116e2a59-f6c3-4d0a-85c1-bc36a1dd7d69 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:05.705331 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd95a1ea-cfbb-432b-9f63-b26904dcbcc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:05.705941 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95a1ea-cfbb-432b-9f63-b26904dcbcc9 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:05.706218 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95a1ea-cfbb-432b-9f63-b26904dcbcc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:05.706490 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95a1ea-cfbb-432b-9f63-b26904dcbcc9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:05.779574 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd95a1ea-cfbb-432b-9f63-b26904dcbcc9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:05.781040 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd95a1ea-cfbb-432b-9f63-b26904dcbcc9 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:05.836761 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:18:05.885356 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 572/1144] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 12:18:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 12:18:05.891689 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff7f41d-c071-4a39-aa35-0261879ae4c1 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:05.992363 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:18:06.001955 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff7f41d-c071-4a39-aa35-0261879ae4c1 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:06.042811 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90be84a-073c-4364-bb37-d2291e9e433a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:06.043472 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90be84a-073c-4364-bb37-d2291e9e433a None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:06.043756 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90be84a-073c-4364-bb37-d2291e9e433a None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:06.044028 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90be84a-073c-4364-bb37-d2291e9e433a None admin] PATH_INFO: `/v3/projects/8e93b51c079b4bc6bb77924fcf66e6d9` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:06.045157 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90be84a-073c-4364-bb37-d2291e9e433a None admin] RBAC: Authorizing `identity:get_project(project_id=8e93b51c079b4bc6bb77924fcf66e6d9)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:06.046598 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90be84a-073c-4364-bb37-d2291e9e433a None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:06.048282 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 573/1145] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 12:18:05 2022] GET /identity/v3/projects/8e93b51c079b4bc6bb77924fcf66e6d9 => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:18:06.055281 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd95a1ea-cfbb-432b-9f63-b26904dcbcc9 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:06.158191 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd95a1ea-cfbb-432b-9f63-b26904dcbcc9 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:06.194542 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70bab99-1443-49a0-b212-cb8b4e8fc499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:06.195428 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70bab99-1443-49a0-b212-cb8b4e8fc499 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:06.195701 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70bab99-1443-49a0-b212-cb8b4e8fc499 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:06.195967 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70bab99-1443-49a0-b212-cb8b4e8fc499 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:06.196685 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70bab99-1443-49a0-b212-cb8b4e8fc499 None admin] RBAC: Adding query filter params (role.id=a332ef951db949b0bad7019fbd28a1b9, scope.project.id=8e93b51c079b4bc6bb77924fcf66e6d9, user.id=78dd97fcaa5e401596b647266acb42bd) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:18:06.196989 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70bab99-1443-49a0-b212-cb8b4e8fc499 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:06.198596 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70bab99-1443-49a0-b212-cb8b4e8fc499 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:06.204410 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 573/1146] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 12:18:06 2022] GET /identity/v3/role_assignments?user.id=78dd97fcaa5e401596b647266acb42bd&scope.project.id=8e93b51c079b4bc6bb77924fcf66e6d9&role.id=a332ef951db949b0bad7019fbd28a1b9 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:18:08.154190 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe89447-4341-428a-9583-e84f40e067a1 None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:08.154762 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe89447-4341-428a-9583-e84f40e067a1 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:08.154762 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe89447-4341-428a-9583-e84f40e067a1 None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:08.156130 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 574/1147] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:18:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:18:08.161248 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9472ac2e-e0f4-48b4-940d-fa71ea732c76 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:08.161634 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9472ac2e-e0f4-48b4-940d-fa71ea732c76 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:08.161800 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9472ac2e-e0f4-48b4-940d-fa71ea732c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:08.182122 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-9472ac2e-e0f4-48b4-940d-fa71ea732c76 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:18:08.183354 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-9472ac2e-e0f4-48b4-940d-fa71ea732c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:18:08.200505 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:18:08.254082 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 574/1148] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:18:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:18:08.536291 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe89447-4341-428a-9583-e84f40e067a1 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:08.642120 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe89447-4341-428a-9583-e84f40e067a1 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:08.677317 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63db3be-c294-442a-98ca-802b6281510d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:08.677996 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63db3be-c294-442a-98ca-802b6281510d None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:08.678278 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63db3be-c294-442a-98ca-802b6281510d None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:08.678548 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63db3be-c294-442a-98ca-802b6281510d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:08.689102 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63db3be-c294-442a-98ca-802b6281510d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:18:08.694777 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-b63db3be-c294-442a-98ca-802b6281510d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:18:08.694777 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:18:08.694777 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:18:08.694777 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:18:08.694777 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:18:08.694777 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:18:08.694777 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:18:08.694777 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:18:08.694777 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:18:08.694777 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:18:08.694777 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:18:08.694777 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:18:08.694777 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:18:08.694777 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:18:08.694777 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:18:08.694777 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:18:08.695844 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:18:08.695844 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:18:08.695844 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:18:08.695844 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:18:08.695844 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:18:08.695844 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:18:08.695844 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:18:08.695844 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:18:08.695844 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:18:08.695844 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:18:08.695844 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:18:08.695844 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:18:08.695844 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:18:08.695844 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:18:08.695844 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:18:08.695844 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:18:08.696894 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:18:08.696894 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:18:08.696894 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:18:08.696894 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:18:08.696894 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:18:08.696894 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:18:08.696894 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:18:08.696894 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:18:08.696894 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:18:08.696894 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:18:08.696894 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:18:08.696894 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:18:08.696894 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 575/1149] 10.222.0.79 () {56 vars in 1096 bytes} [Wed Aug 31 12:18:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:18:08.702788 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9472ac2e-e0f4-48b4-940d-fa71ea732c76 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:08.814735 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9472ac2e-e0f4-48b4-940d-fa71ea732c76 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:08.852665 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e110022-c4cd-4184-96d9-661520b03dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:08.853285 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e110022-c4cd-4184-96d9-661520b03dfe None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:08.853560 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e110022-c4cd-4184-96d9-661520b03dfe None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:08.853827 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e110022-c4cd-4184-96d9-661520b03dfe None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:08.854510 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e110022-c4cd-4184-96d9-661520b03dfe None admin] RBAC: Adding query filter params (name=admin) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:18:08.854808 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e110022-c4cd-4184-96d9-661520b03dfe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:08.856224 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e110022-c4cd-4184-96d9-661520b03dfe None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:08.865436 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 575/1150] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 12:18:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:18:08.872045 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63db3be-c294-442a-98ca-802b6281510d None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:08.895815 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:18:08.973717 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63db3be-c294-442a-98ca-802b6281510d None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:09.007737 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed750490-9c7e-4ebd-8fdc-3c28518f456b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:09.008355 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed750490-9c7e-4ebd-8fdc-3c28518f456b None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:09.008631 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed750490-9c7e-4ebd-8fdc-3c28518f456b None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:09.008896 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed750490-9c7e-4ebd-8fdc-3c28518f456b None admin] PATH_INFO: `/v3/users/78dd97fcaa5e401596b647266acb42bd` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:09.009997 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed750490-9c7e-4ebd-8fdc-3c28518f456b None admin] RBAC: Authorizing `identity:get_user(user_id=78dd97fcaa5e401596b647266acb42bd)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:09.011460 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed750490-9c7e-4ebd-8fdc-3c28518f456b None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:09.013035 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 576/1151] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 12:18:08 2022] GET /identity/v3/users/78dd97fcaa5e401596b647266acb42bd => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:18:09.019641 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e110022-c4cd-4184-96d9-661520b03dfe None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:09.035992 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:18:09.122803 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e110022-c4cd-4184-96d9-661520b03dfe None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:09.156396 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e0da6a-e32e-4c96-9576-c3e7cb45ba07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:09.157024 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e0da6a-e32e-4c96-9576-c3e7cb45ba07 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:09.157298 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e0da6a-e32e-4c96-9576-c3e7cb45ba07 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:09.157569 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e0da6a-e32e-4c96-9576-c3e7cb45ba07 None admin] PATH_INFO: `/v3/projects/8e93b51c079b4bc6bb77924fcf66e6d9` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:09.158660 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e0da6a-e32e-4c96-9576-c3e7cb45ba07 None admin] RBAC: Authorizing `identity:get_project(project_id=8e93b51c079b4bc6bb77924fcf66e6d9)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:09.160124 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e0da6a-e32e-4c96-9576-c3e7cb45ba07 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:09.161767 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 576/1152] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 12:18:09 2022] GET /identity/v3/projects/8e93b51c079b4bc6bb77924fcf66e6d9 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:18:09.168818 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed750490-9c7e-4ebd-8fdc-3c28518f456b None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:09.262293 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:18:09.274842 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed750490-9c7e-4ebd-8fdc-3c28518f456b None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:09.309383 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78317a8-f9d1-476b-9bc5-71d8f6c72ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:09.310073 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78317a8-f9d1-476b-9bc5-71d8f6c72ccc None admin] REQUEST_METHOD: `PUT` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:09.310350 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78317a8-f9d1-476b-9bc5-71d8f6c72ccc None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:09.310621 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78317a8-f9d1-476b-9bc5-71d8f6c72ccc None admin] PATH_INFO: `/v3/projects/8e93b51c079b4bc6bb77924fcf66e6d9/users/78dd97fcaa5e401596b647266acb42bd/roles/a332ef951db949b0bad7019fbd28a1b9` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:09.312600 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78317a8-f9d1-476b-9bc5-71d8f6c72ccc None admin] RBAC: Authorizing `identity:create_grant(project_id=8e93b51c079b4bc6bb77924fcf66e6d9, user_id=78dd97fcaa5e401596b647266acb42bd, role_id=a332ef951db949b0bad7019fbd28a1b9)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:09.314074 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78317a8-f9d1-476b-9bc5-71d8f6c72ccc None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:09.327117 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 577/1153] 10.222.0.79 () {58 vars in 1439 bytes} [Wed Aug 31 12:18:09 2022] PUT /identity/v3/projects/8e93b51c079b4bc6bb77924fcf66e6d9/users/78dd97fcaa5e401596b647266acb42bd/roles/a332ef951db949b0bad7019fbd28a1b9 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:18:11.232573 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c5a4c-09da-4abe-9088-fcfd3b75c345 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:11.233203 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c5a4c-09da-4abe-9088-fcfd3b75c345 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:11.233302 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c5a4c-09da-4abe-9088-fcfd3b75c345 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:11.234694 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 577/1154] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:18:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:18:11.241170 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0de2e3-ade3-4101-a636-569bf5f2a30e None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:11.241828 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0de2e3-ade3-4101-a636-569bf5f2a30e None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:11.241828 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0de2e3-ade3-4101-a636-569bf5f2a30e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:11.261548 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-5d0de2e3-ade3-4101-a636-569bf5f2a30e None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:18:11.262783 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-5d0de2e3-ade3-4101-a636-569bf5f2a30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:18:11.335092 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 578/1155] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:18:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:18:11.606005 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935c5a4c-09da-4abe-9088-fcfd3b75c345 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:11.689933 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:18:11.711273 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935c5a4c-09da-4abe-9088-fcfd3b75c345 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:11.743911 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e9d65e-e11c-4462-81cc-0a27e17c9c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:11.744527 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9d65e-e11c-4462-81cc-0a27e17c9c74 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:11.744799 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9d65e-e11c-4462-81cc-0a27e17c9c74 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:11.745059 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9d65e-e11c-4462-81cc-0a27e17c9c74 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:11.755281 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e9d65e-e11c-4462-81cc-0a27e17c9c74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:18:11.760663 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-53e9d65e-e11c-4462-81cc-0a27e17c9c74 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:18:11.760663 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:18:11.760663 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:18:11.760663 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:18:11.760663 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:18:11.760663 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:18:11.760663 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:18:11.760663 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:18:11.760663 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:18:11.760663 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:18:11.760663 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:18:11.760663 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:18:11.760663 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:18:11.760663 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:18:11.760663 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:18:11.760663 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:18:11.761804 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:18:11.761804 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:18:11.761804 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:18:11.761804 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:18:11.761804 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:18:11.761804 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:18:11.761804 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:18:11.761804 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:18:11.761804 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:18:11.761804 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:18:11.761804 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:18:11.761804 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:18:11.761804 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:18:11.761804 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:18:11.761804 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:18:11.761804 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:18:11.763157 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:18:11.763157 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:18:11.763157 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:18:11.763157 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:18:11.763157 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:18:11.763157 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:18:11.763157 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:18:11.763157 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:18:11.763157 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:18:11.763157 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:18:11.763157 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:18:11.763157 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:18:11.763157 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 578/1156] 10.222.0.79 () {56 vars in 1096 bytes} [Wed Aug 31 12:18:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:18:11.767917 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0de2e3-ade3-4101-a636-569bf5f2a30e None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:11.843875 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:18:11.866431 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0de2e3-ade3-4101-a636-569bf5f2a30e None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:11.899991 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c031d-2909-44a2-8391-aeee1a90716b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:11.900604 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c031d-2909-44a2-8391-aeee1a90716b None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:11.900883 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c031d-2909-44a2-8391-aeee1a90716b None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:11.901153 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c031d-2909-44a2-8391-aeee1a90716b None admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:11.901809 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384c031d-2909-44a2-8391-aeee1a90716b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:18:11.902116 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384c031d-2909-44a2-8391-aeee1a90716b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:11.903516 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384c031d-2909-44a2-8391-aeee1a90716b None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:11.911485 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 579/1157] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 12:18:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:18:11.918434 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e9d65e-e11c-4462-81cc-0a27e17c9c74 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:12.019590 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e9d65e-e11c-4462-81cc-0a27e17c9c74 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:12.052420 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f28a0ef-e861-4173-87bd-93d629687e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:12.053625 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f28a0ef-e861-4173-87bd-93d629687e99 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:12.054028 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f28a0ef-e861-4173-87bd-93d629687e99 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:12.054309 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f28a0ef-e861-4173-87bd-93d629687e99 None admin] PATH_INFO: `/v3/users/78dd97fcaa5e401596b647266acb42bd` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:12.055450 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f28a0ef-e861-4173-87bd-93d629687e99 None admin] RBAC: Authorizing `identity:get_user(user_id=78dd97fcaa5e401596b647266acb42bd)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:12.056876 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f28a0ef-e861-4173-87bd-93d629687e99 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:12.058463 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 579/1158] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 12:18:11 2022] GET /identity/v3/users/78dd97fcaa5e401596b647266acb42bd => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:18:12.064439 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c031d-2909-44a2-8391-aeee1a90716b None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:12.163884 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c031d-2909-44a2-8391-aeee1a90716b None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:12.196837 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fd0032-563a-4d36-bc76-fa5cb3994487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:12.197448 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd0032-563a-4d36-bc76-fa5cb3994487 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:12.197728 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd0032-563a-4d36-bc76-fa5cb3994487 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:12.198002 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd0032-563a-4d36-bc76-fa5cb3994487 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:12.208470 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:18:12.265481 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fd0032-563a-4d36-bc76-fa5cb3994487 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:12.266972 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fd0032-563a-4d36-bc76-fa5cb3994487 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:12.364813 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 580/1159] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 12:18:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 12:18:12.371552 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f28a0ef-e861-4173-87bd-93d629687e99 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:12.384759 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:18:12.473792 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f28a0ef-e861-4173-87bd-93d629687e99 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:12.507619 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5489e9ce-8bd4-4e9b-a8a0-f78eb75b58c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:12.508242 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5489e9ce-8bd4-4e9b-a8a0-f78eb75b58c4 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:12.508521 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5489e9ce-8bd4-4e9b-a8a0-f78eb75b58c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:12.508792 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5489e9ce-8bd4-4e9b-a8a0-f78eb75b58c4 None admin] PATH_INFO: `/v3/projects/8e93b51c079b4bc6bb77924fcf66e6d9` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:12.509905 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5489e9ce-8bd4-4e9b-a8a0-f78eb75b58c4 None admin] RBAC: Authorizing `identity:get_project(project_id=8e93b51c079b4bc6bb77924fcf66e6d9)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:12.511365 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5489e9ce-8bd4-4e9b-a8a0-f78eb75b58c4 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:12.512992 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 580/1160] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 12:18:12 2022] GET /identity/v3/projects/8e93b51c079b4bc6bb77924fcf66e6d9 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:18:12.519142 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fd0032-563a-4d36-bc76-fa5cb3994487 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:12.559771 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:18:12.617007 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fd0032-563a-4d36-bc76-fa5cb3994487 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:12.650345 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35dbde2-2ccd-401a-b88b-c632ed495ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:12.650979 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35dbde2-2ccd-401a-b88b-c632ed495ab1 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:12.651261 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35dbde2-2ccd-401a-b88b-c632ed495ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:12.651532 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35dbde2-2ccd-401a-b88b-c632ed495ab1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:12.652247 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35dbde2-2ccd-401a-b88b-c632ed495ab1 None admin] RBAC: Adding query filter params (role.id=a332ef951db949b0bad7019fbd28a1b9, scope.project.id=8e93b51c079b4bc6bb77924fcf66e6d9, user.id=78dd97fcaa5e401596b647266acb42bd) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:18:12.652552 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35dbde2-2ccd-401a-b88b-c632ed495ab1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:12.653989 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35dbde2-2ccd-401a-b88b-c632ed495ab1 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:12.659798 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 581/1161] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 12:18:12 2022] GET /identity/v3/role_assignments?user.id=78dd97fcaa5e401596b647266acb42bd&scope.project.id=8e93b51c079b4bc6bb77924fcf66e6d9&role.id=a332ef951db949b0bad7019fbd28a1b9 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:18:14.640281 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85fe34f-6cc0-46e5-b052-2779dc5d25a6 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:14.640871 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85fe34f-6cc0-46e5-b052-2779dc5d25a6 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:14.640871 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85fe34f-6cc0-46e5-b052-2779dc5d25a6 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:14.642144 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 581/1162] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:18:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:18:14.647249 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12acd1-d22f-4894-b7ad-4438a40b3da6 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:14.647663 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12acd1-d22f-4894-b7ad-4438a40b3da6 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:14.647779 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12acd1-d22f-4894-b7ad-4438a40b3da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:14.666104 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-4d12acd1-d22f-4894-b7ad-4438a40b3da6 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:18:14.667321 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-4d12acd1-d22f-4894-b7ad-4438a40b3da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:18:14.732956 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 582/1163] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:18:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:18:15.003867 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85fe34f-6cc0-46e5-b052-2779dc5d25a6 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:15.082452 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:18:15.105255 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85fe34f-6cc0-46e5-b052-2779dc5d25a6 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:15.138637 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5cb741-6441-4e80-be9b-10c3a1e27917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:15.139271 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5cb741-6441-4e80-be9b-10c3a1e27917 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:15.139548 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5cb741-6441-4e80-be9b-10c3a1e27917 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:15.139817 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5cb741-6441-4e80-be9b-10c3a1e27917 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:15.205695 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5cb741-6441-4e80-be9b-10c3a1e27917 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:15.207170 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5cb741-6441-4e80-be9b-10c3a1e27917 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:15.282124 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:18:15.305030 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 582/1164] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 12:18:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 12:18:15.311023 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d12acd1-d22f-4894-b7ad-4438a40b3da6 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:15.344390 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:18:15.410747 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d12acd1-d22f-4894-b7ad-4438a40b3da6 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:15.445544 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9199b280-c16e-43f2-90e3-6d69b26bfbbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:15.445675 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9199b280-c16e-43f2-90e3-6d69b26bfbbf None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:15.445846 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9199b280-c16e-43f2-90e3-6d69b26bfbbf None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:15.446120 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9199b280-c16e-43f2-90e3-6d69b26bfbbf None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:15.452952 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9199b280-c16e-43f2-90e3-6d69b26bfbbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:15.454398 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9199b280-c16e-43f2-90e3-6d69b26bfbbf None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:15.466079 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-9199b280-c16e-43f2-90e3-6d69b26bfbbf None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 31 12:18:15.466079 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:18:15.466079 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 31 12:18:15.466079 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 31 12:18:15.466079 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:18:15.466079 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:18:15.466079 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:18:15.466079 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:18:15.466079 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 31 12:18:15.466079 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:18:15.466079 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:18:15.466079 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:18:15.466079 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:18:15.466079 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:18:15.466079 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:18:15.466079 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:18:15.466079 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:18:15.467420 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:18:15.467420 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:18:15.467420 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:18:15.467420 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:18:15.467420 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:18:15.467420 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:18:15.467420 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:18:15.467420 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:18:15.467420 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:18:15.467420 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:18:15.467420 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:18:15.467420 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:18:15.467420 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:18:15.467420 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:18:15.467420 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:18:15.467420 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:18:15.468579 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:18:15.468579 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:18:15.468579 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:18:15.468579 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:18:15.468579 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:18:15.468579 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:18:15.468579 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:18:15.468579 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:18:15.468579 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:18:15.468579 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:18:15.468579 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 31 12:18:15.468579 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:18:15.468579 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 31 12:18:15.468579 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:18:15.468579 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 583/1165] 10.222.0.79 () {56 vars in 1117 bytes} [Wed Aug 31 12:18:15 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:18:15.473382 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5cb741-6441-4e80-be9b-10c3a1e27917 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:15.572191 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5cb741-6441-4e80-be9b-10c3a1e27917 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:15.606547 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508864dd-bc9b-4374-8a56-848f790e9718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:15.607174 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508864dd-bc9b-4374-8a56-848f790e9718 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:15.607454 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508864dd-bc9b-4374-8a56-848f790e9718 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:15.607725 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508864dd-bc9b-4374-8a56-848f790e9718 None admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:15.608364 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508864dd-bc9b-4374-8a56-848f790e9718 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:18:15.608667 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508864dd-bc9b-4374-8a56-848f790e9718 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:15.610028 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508864dd-bc9b-4374-8a56-848f790e9718 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:15.617234 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 583/1166] 10.222.0.79 () {56 vars in 1115 bytes} [Wed Aug 31 12:18:15 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:18:17.515325 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c54f5-13b3-4e52-bf41-e7d98cffffa1 None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:17.515880 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c54f5-13b3-4e52-bf41-e7d98cffffa1 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:17.515880 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c54f5-13b3-4e52-bf41-e7d98cffffa1 None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:17.517212 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 584/1167] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:18:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:18:17.522928 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ae1fc-e869-4a9a-89c8-9511dcb70e07 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:17.523381 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ae1fc-e869-4a9a-89c8-9511dcb70e07 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:17.523480 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ae1fc-e869-4a9a-89c8-9511dcb70e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:17.541702 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-493ae1fc-e869-4a9a-89c8-9511dcb70e07 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:18:17.542909 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-493ae1fc-e869-4a9a-89c8-9511dcb70e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:18:17.577102 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:18:17.609781 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 584/1168] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:18:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 12:18:17.882592 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c54f5-13b3-4e52-bf41-e7d98cffffa1 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:17.977033 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:18:17.984713 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c54f5-13b3-4e52-bf41-e7d98cffffa1 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:18.021528 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15dba88-af4e-4c97-871b-023c2756fe42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:18.022323 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15dba88-af4e-4c97-871b-023c2756fe42 None admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:18.022606 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15dba88-af4e-4c97-871b-023c2756fe42 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:18.022908 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15dba88-af4e-4c97-871b-023c2756fe42 None admin] PATH_INFO: `/v3/domains` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:18.023611 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15dba88-af4e-4c97-871b-023c2756fe42 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:18.024997 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15dba88-af4e-4c97-871b-023c2756fe42 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:18.041888 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 585/1169] 10.222.0.79 () {60 vars in 1138 bytes} [Wed Aug 31 12:18:17 2022] POST /identity/v3/domains => generated 267 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:18:19.984222 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a412cf9-f7e7-4011-82d2-9578f152cc82 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:19.984787 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a412cf9-f7e7-4011-82d2-9578f152cc82 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:19.984787 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a412cf9-f7e7-4011-82d2-9578f152cc82 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:19.986122 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 585/1170] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:18:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:18:19.991971 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e621753e-e13e-4950-a97a-f88ccd92eb82 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:19.992523 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e621753e-e13e-4950-a97a-f88ccd92eb82 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:19.992523 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e621753e-e13e-4950-a97a-f88ccd92eb82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:20.012820 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-e621753e-e13e-4950-a97a-f88ccd92eb82 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:18:20.014039 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-e621753e-e13e-4950-a97a-f88ccd92eb82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:18:20.080804 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 586/1171] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:18:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:18:20.348048 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a412cf9-f7e7-4011-82d2-9578f152cc82 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:20.448159 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a412cf9-f7e7-4011-82d2-9578f152cc82 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:20.481402 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0ce443-6e4f-4789-b51d-e8232a056c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:20.482026 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ce443-6e4f-4789-b51d-e8232a056c07 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:20.482312 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ce443-6e4f-4789-b51d-e8232a056c07 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:20.482587 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ce443-6e4f-4789-b51d-e8232a056c07 None admin] PATH_INFO: `/v3/domains/5653dce9f063497d89c40dda4e094c7c` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:20.493403 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0ce443-6e4f-4789-b51d-e8232a056c07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=5653dce9f063497d89c40dda4e094c7c)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:20.494861 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0ce443-6e4f-4789-b51d-e8232a056c07 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:20.496466 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 586/1172] 10.222.0.79 () {56 vars in 1183 bytes} [Wed Aug 31 12:18:20 2022] GET /identity/v3/domains/5653dce9f063497d89c40dda4e094c7c => generated 267 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:18:20.502332 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e621753e-e13e-4950-a97a-f88ccd92eb82 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:20.583490 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:18:20.600637 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e621753e-e13e-4950-a97a-f88ccd92eb82 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:20.633423 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3431328-96b0-41d0-8d63-751baef79454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:20.634039 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3431328-96b0-41d0-8d63-751baef79454 None admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:20.634318 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3431328-96b0-41d0-8d63-751baef79454 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:20.634588 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3431328-96b0-41d0-8d63-751baef79454 None admin] PATH_INFO: `/v3/projects` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:20.635263 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3431328-96b0-41d0-8d63-751baef79454 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:20.636690 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3431328-96b0-41d0-8d63-751baef79454 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:20.664075 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 587/1173] 10.222.0.79 () {60 vars in 1141 bytes} [Wed Aug 31 12:18:20 2022] POST /identity/v3/projects => generated 361 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:18:22.622239 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e9aa4d-4241-4741-8e40-f55ddc7b92d8 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:22.622780 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e9aa4d-4241-4741-8e40-f55ddc7b92d8 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:22.622780 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e9aa4d-4241-4741-8e40-f55ddc7b92d8 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:22.624317 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 587/1174] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:18:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:18:22.629841 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd23e3-3a0a-4426-8a20-dac04d46065c None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:22.630309 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd23e3-3a0a-4426-8a20-dac04d46065c None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:22.630441 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd23e3-3a0a-4426-8a20-dac04d46065c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:22.649473 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-00cd23e3-3a0a-4426-8a20-dac04d46065c None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:18:22.650667 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-00cd23e3-3a0a-4426-8a20-dac04d46065c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:18:22.718963 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 588/1175] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:18:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:18:22.995244 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e9aa4d-4241-4741-8e40-f55ddc7b92d8 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:23.028117 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:18:23.105240 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e9aa4d-4241-4741-8e40-f55ddc7b92d8 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:23.139046 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c4f2fa-1932-4bee-9717-b99b77e8457e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:23.139672 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4f2fa-1932-4bee-9717-b99b77e8457e None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:23.139955 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4f2fa-1932-4bee-9717-b99b77e8457e None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:23.140229 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4f2fa-1932-4bee-9717-b99b77e8457e None admin] PATH_INFO: `/v3/domains/5653dce9f063497d89c40dda4e094c7c` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:23.141347 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c4f2fa-1932-4bee-9717-b99b77e8457e None admin] RBAC: Authorizing `identity:get_domain(domain_id=5653dce9f063497d89c40dda4e094c7c)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:23.142780 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c4f2fa-1932-4bee-9717-b99b77e8457e None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:23.144383 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 588/1176] 10.222.0.79 () {56 vars in 1183 bytes} [Wed Aug 31 12:18:22 2022] GET /identity/v3/domains/5653dce9f063497d89c40dda4e094c7c => generated 267 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:18:23.150248 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd23e3-3a0a-4426-8a20-dac04d46065c None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:23.215169 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:18:23.249675 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd23e3-3a0a-4426-8a20-dac04d46065c None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:23.282527 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4a4492-b21d-4b37-ac9e-ad9eaf244412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:23.283161 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a4492-b21d-4b37-ac9e-ad9eaf244412 None admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:23.283443 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a4492-b21d-4b37-ac9e-ad9eaf244412 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:23.283710 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a4492-b21d-4b37-ac9e-ad9eaf244412 None admin] PATH_INFO: `/v3/users` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:23.284357 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4a4492-b21d-4b37-ac9e-ad9eaf244412 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:23.285775 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4a4492-b21d-4b37-ac9e-ad9eaf244412 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:23.309685 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 589/1177] 10.222.0.79 () {60 vars in 1132 bytes} [Wed Aug 31 12:18:23 2022] POST /identity/v3/users => generated 311 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:18:25.292435 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a384b5b-fecd-4d1f-b10c-7372c892cc0f None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:25.293000 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a384b5b-fecd-4d1f-b10c-7372c892cc0f None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:25.293000 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a384b5b-fecd-4d1f-b10c-7372c892cc0f None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:25.294322 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 589/1178] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:18:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:18:25.299721 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36f430-e498-40a9-a42e-e809d34e84d7 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:25.300143 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36f430-e498-40a9-a42e-e809d34e84d7 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:25.300273 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36f430-e498-40a9-a42e-e809d34e84d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:25.320070 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-cc36f430-e498-40a9-a42e-e809d34e84d7 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:18:25.321296 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-cc36f430-e498-40a9-a42e-e809d34e84d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:18:25.391219 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 590/1179] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:18:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:18:25.672974 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a384b5b-fecd-4d1f-b10c-7372c892cc0f None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:25.774676 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:18:25.779129 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a384b5b-fecd-4d1f-b10c-7372c892cc0f None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:25.814975 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c337160e-8211-4117-a0bc-c479ace24806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:25.815595 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337160e-8211-4117-a0bc-c479ace24806 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:25.815870 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337160e-8211-4117-a0bc-c479ace24806 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:25.816137 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337160e-8211-4117-a0bc-c479ace24806 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:25.826658 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c337160e-8211-4117-a0bc-c479ace24806 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:18:25.831449 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-c337160e-8211-4117-a0bc-c479ace24806 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:18:25.831449 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:18:25.831449 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:18:25.831449 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:18:25.831449 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:18:25.831449 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:18:25.831449 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:18:25.831449 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:18:25.831449 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:18:25.831449 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:18:25.831449 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:18:25.831449 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:18:25.831449 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:18:25.831449 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:18:25.831449 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:18:25.831449 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:18:25.832552 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:18:25.832552 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:18:25.832552 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:18:25.832552 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:18:25.832552 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:18:25.832552 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:18:25.832552 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:18:25.832552 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:18:25.832552 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:18:25.832552 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:18:25.832552 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:18:25.832552 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:18:25.832552 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:18:25.832552 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:18:25.832552 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:18:25.832552 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:18:25.833478 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:18:25.833478 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:18:25.833478 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:18:25.833478 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:18:25.833478 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:18:25.833478 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:18:25.833478 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:18:25.833478 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:18:25.833478 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:18:25.833478 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:18:25.833478 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:18:25.833478 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:18:25.833478 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 590/1180] 10.222.0.79 () {56 vars in 1096 bytes} [Wed Aug 31 12:18:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:18:25.840454 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc36f430-e498-40a9-a42e-e809d34e84d7 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:25.892224 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:18:25.938201 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc36f430-e498-40a9-a42e-e809d34e84d7 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:25.973137 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da44db9-5cf2-41c7-85da-f41cb464d5f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:25.973742 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da44db9-5cf2-41c7-85da-f41cb464d5f7 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:25.974017 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da44db9-5cf2-41c7-85da-f41cb464d5f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:25.974283 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da44db9-5cf2-41c7-85da-f41cb464d5f7 None admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:25.975006 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da44db9-5cf2-41c7-85da-f41cb464d5f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:18:25.975307 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da44db9-5cf2-41c7-85da-f41cb464d5f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:25.976674 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da44db9-5cf2-41c7-85da-f41cb464d5f7 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:25.984979 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 591/1181] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 12:18:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:18:25.991294 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c337160e-8211-4117-a0bc-c479ace24806 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:26.088934 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c337160e-8211-4117-a0bc-c479ace24806 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:26.123220 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ffb656-bbc0-4e89-928c-6444569bc236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:26.123849 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ffb656-bbc0-4e89-928c-6444569bc236 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:26.124123 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ffb656-bbc0-4e89-928c-6444569bc236 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:26.124388 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ffb656-bbc0-4e89-928c-6444569bc236 None admin] PATH_INFO: `/v3/users/ce3e8bae953d4320b8b4a32856386a3b` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:26.138032 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ffb656-bbc0-4e89-928c-6444569bc236 None admin] RBAC: Authorizing `identity:get_user(user_id=ce3e8bae953d4320b8b4a32856386a3b)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:26.139509 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ffb656-bbc0-4e89-928c-6444569bc236 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:26.141131 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 591/1182] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 12:18:25 2022] GET /identity/v3/users/ce3e8bae953d4320b8b4a32856386a3b => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:18:26.147781 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da44db9-5cf2-41c7-85da-f41cb464d5f7 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:26.246239 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da44db9-5cf2-41c7-85da-f41cb464d5f7 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:26.261122 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:18:26.284316 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56a0605-46f9-4d2e-bdc6-0096cd743230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:26.284947 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a0605-46f9-4d2e-bdc6-0096cd743230 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:26.285223 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a0605-46f9-4d2e-bdc6-0096cd743230 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:26.285489 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a0605-46f9-4d2e-bdc6-0096cd743230 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:26.357210 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56a0605-46f9-4d2e-bdc6-0096cd743230 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:26.358727 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56a0605-46f9-4d2e-bdc6-0096cd743230 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:26.469146 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 592/1183] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 12:18:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 12:18:26.476476 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ffb656-bbc0-4e89-928c-6444569bc236 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:26.498394 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:18:26.586556 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ffb656-bbc0-4e89-928c-6444569bc236 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:26.622429 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751c025e-0d10-4870-878b-2833e8cf3b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:26.623088 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c025e-0d10-4870-878b-2833e8cf3b55 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:26.623370 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c025e-0d10-4870-878b-2833e8cf3b55 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:26.623642 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c025e-0d10-4870-878b-2833e8cf3b55 None admin] PATH_INFO: `/v3/projects/bcf0747fe0684679865eb2d0776506c1` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:26.624764 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751c025e-0d10-4870-878b-2833e8cf3b55 None admin] RBAC: Authorizing `identity:get_project(project_id=bcf0747fe0684679865eb2d0776506c1)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:26.626201 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751c025e-0d10-4870-878b-2833e8cf3b55 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:26.627892 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 592/1184] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 12:18:26 2022] GET /identity/v3/projects/bcf0747fe0684679865eb2d0776506c1 => generated 361 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:18:26.634138 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56a0605-46f9-4d2e-bdc6-0096cd743230 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:26.650094 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:18:26.762327 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56a0605-46f9-4d2e-bdc6-0096cd743230 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:26.798041 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c89c92-64eb-417a-a64e-f8a73d25e1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:26.798649 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c89c92-64eb-417a-a64e-f8a73d25e1c2 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:26.798955 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c89c92-64eb-417a-a64e-f8a73d25e1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:26.799226 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c89c92-64eb-417a-a64e-f8a73d25e1c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:26.800062 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c89c92-64eb-417a-a64e-f8a73d25e1c2 None admin] RBAC: Adding query filter params (role.id=a332ef951db949b0bad7019fbd28a1b9, scope.project.id=bcf0747fe0684679865eb2d0776506c1, user.id=ce3e8bae953d4320b8b4a32856386a3b) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:18:26.800371 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c89c92-64eb-417a-a64e-f8a73d25e1c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:26.801814 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c89c92-64eb-417a-a64e-f8a73d25e1c2 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:26.807779 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 593/1185] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 12:18:26 2022] GET /identity/v3/role_assignments?user.id=ce3e8bae953d4320b8b4a32856386a3b&scope.project.id=bcf0747fe0684679865eb2d0776506c1&role.id=a332ef951db949b0bad7019fbd28a1b9 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:18:28.782784 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e3677-7fb7-4703-9848-c7a99002c477 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:28.783358 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e3677-7fb7-4703-9848-c7a99002c477 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:28.783358 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e3677-7fb7-4703-9848-c7a99002c477 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:28.784700 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 593/1186] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:18:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:18:28.791346 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c93ba5-dcc9-4f08-868b-116e2cc0eae6 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:28.791798 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c93ba5-dcc9-4f08-868b-116e2cc0eae6 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:28.791909 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c93ba5-dcc9-4f08-868b-116e2cc0eae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:28.810482 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-31c93ba5-dcc9-4f08-868b-116e2cc0eae6 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:18:28.811726 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-31c93ba5-dcc9-4f08-868b-116e2cc0eae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:18:28.877862 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 594/1187] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:18:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:18:29.165493 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6e3677-7fb7-4703-9848-c7a99002c477 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:29.270312 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:18:29.289478 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6e3677-7fb7-4703-9848-c7a99002c477 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:29.325983 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844441c9-f736-4f9c-b850-b762b180be83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:29.326609 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844441c9-f736-4f9c-b850-b762b180be83 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:29.326909 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844441c9-f736-4f9c-b850-b762b180be83 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:29.327182 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844441c9-f736-4f9c-b850-b762b180be83 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:29.337691 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844441c9-f736-4f9c-b850-b762b180be83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:18:29.342780 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-844441c9-f736-4f9c-b850-b762b180be83 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:18:29.342780 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:18:29.342780 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:18:29.342780 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:18:29.342780 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:18:29.342780 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:18:29.342780 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:18:29.342780 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:18:29.342780 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:18:29.342780 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:18:29.342780 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:18:29.342780 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:18:29.342780 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:18:29.342780 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:18:29.342780 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:18:29.342780 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:18:29.344005 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:18:29.344005 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:18:29.344005 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:18:29.344005 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:18:29.344005 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:18:29.344005 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:18:29.344005 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:18:29.344005 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:18:29.344005 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:18:29.344005 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:18:29.344005 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:18:29.344005 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:18:29.344005 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:18:29.344005 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:18:29.344005 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:18:29.344005 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:18:29.345553 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:18:29.345553 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:18:29.345553 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:18:29.345553 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:18:29.345553 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:18:29.345553 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:18:29.345553 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:18:29.345553 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:18:29.345553 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:18:29.345553 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:18:29.345553 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:18:29.345553 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:18:29.345553 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 594/1188] 10.222.0.79 () {56 vars in 1096 bytes} [Wed Aug 31 12:18:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:18:29.352063 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c93ba5-dcc9-4f08-868b-116e2cc0eae6 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:29.363121 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:18:29.457964 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c93ba5-dcc9-4f08-868b-116e2cc0eae6 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:29.502039 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59003116-5e19-4633-bbd3-73a0eb3aa5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:29.502655 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59003116-5e19-4633-bbd3-73a0eb3aa5ea None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:29.502956 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59003116-5e19-4633-bbd3-73a0eb3aa5ea None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:29.503244 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59003116-5e19-4633-bbd3-73a0eb3aa5ea None admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:29.503903 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59003116-5e19-4633-bbd3-73a0eb3aa5ea None admin] RBAC: Adding query filter params (name=admin) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:18:29.504202 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59003116-5e19-4633-bbd3-73a0eb3aa5ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:29.506625 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59003116-5e19-4633-bbd3-73a0eb3aa5ea None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:29.516946 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 595/1189] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 12:18:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:18:29.523508 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844441c9-f736-4f9c-b850-b762b180be83 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:29.630171 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844441c9-f736-4f9c-b850-b762b180be83 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:29.669212 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c151e3ee-86c5-4497-bcab-b0154e89e7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:29.669840 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c151e3ee-86c5-4497-bcab-b0154e89e7d7 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:29.670118 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c151e3ee-86c5-4497-bcab-b0154e89e7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:29.670389 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c151e3ee-86c5-4497-bcab-b0154e89e7d7 None admin] PATH_INFO: `/v3/users/ce3e8bae953d4320b8b4a32856386a3b` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:29.671607 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c151e3ee-86c5-4497-bcab-b0154e89e7d7 None admin] RBAC: Authorizing `identity:get_user(user_id=ce3e8bae953d4320b8b4a32856386a3b)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:29.673042 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c151e3ee-86c5-4497-bcab-b0154e89e7d7 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:29.674756 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 595/1190] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 12:18:29 2022] GET /identity/v3/users/ce3e8bae953d4320b8b4a32856386a3b => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:18:29.682222 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59003116-5e19-4633-bbd3-73a0eb3aa5ea None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:29.754150 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:18:29.793368 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59003116-5e19-4633-bbd3-73a0eb3aa5ea None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:29.838334 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c62d84b-e253-486f-9909-24f98c0d998d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:29.839113 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c62d84b-e253-486f-9909-24f98c0d998d None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:29.839475 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c62d84b-e253-486f-9909-24f98c0d998d None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:29.839752 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c62d84b-e253-486f-9909-24f98c0d998d None admin] PATH_INFO: `/v3/projects/bcf0747fe0684679865eb2d0776506c1` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:29.841086 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c62d84b-e253-486f-9909-24f98c0d998d None admin] RBAC: Authorizing `identity:get_project(project_id=bcf0747fe0684679865eb2d0776506c1)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:29.842746 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c62d84b-e253-486f-9909-24f98c0d998d None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:29.844811 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 596/1191] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 12:18:29 2022] GET /identity/v3/projects/bcf0747fe0684679865eb2d0776506c1 => generated 361 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:18:29.851534 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c151e3ee-86c5-4497-bcab-b0154e89e7d7 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:29.879332 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:18:29.988367 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c151e3ee-86c5-4497-bcab-b0154e89e7d7 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:30.024334 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f88bc0-a0d2-4bcc-adeb-614998688b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:30.025081 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f88bc0-a0d2-4bcc-adeb-614998688b96 None admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:30.025357 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f88bc0-a0d2-4bcc-adeb-614998688b96 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:30.025629 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f88bc0-a0d2-4bcc-adeb-614998688b96 None admin] PATH_INFO: `/v3/projects/bcf0747fe0684679865eb2d0776506c1/users/ce3e8bae953d4320b8b4a32856386a3b/roles/a332ef951db949b0bad7019fbd28a1b9` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:30.027756 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f88bc0-a0d2-4bcc-adeb-614998688b96 None admin] RBAC: Authorizing `identity:create_grant(project_id=bcf0747fe0684679865eb2d0776506c1, user_id=ce3e8bae953d4320b8b4a32856386a3b, role_id=a332ef951db949b0bad7019fbd28a1b9)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:30.029273 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f88bc0-a0d2-4bcc-adeb-614998688b96 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:30.043984 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 596/1192] 10.222.0.79 () {58 vars in 1439 bytes} [Wed Aug 31 12:18:29 2022] PUT /identity/v3/projects/bcf0747fe0684679865eb2d0776506c1/users/ce3e8bae953d4320b8b4a32856386a3b/roles/a332ef951db949b0bad7019fbd28a1b9 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:18:32.094165 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53489ac-1671-4e01-a791-afef38503379 None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:32.094759 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53489ac-1671-4e01-a791-afef38503379 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:32.094759 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53489ac-1671-4e01-a791-afef38503379 None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:32.096094 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 597/1193] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:18:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:18:32.102576 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d7bf1f-1e10-4a97-aa21-4af2517a4967 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:32.103163 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d7bf1f-1e10-4a97-aa21-4af2517a4967 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:32.103163 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d7bf1f-1e10-4a97-aa21-4af2517a4967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:32.122388 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-11d7bf1f-1e10-4a97-aa21-4af2517a4967 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:18:32.123653 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-11d7bf1f-1e10-4a97-aa21-4af2517a4967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:18:32.197746 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 597/1194] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:18:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:18:32.479571 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53489ac-1671-4e01-a791-afef38503379 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:32.585902 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53489ac-1671-4e01-a791-afef38503379 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:32.621561 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e46cbb7-c189-4101-bd47-33df0b8d687f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:32.622192 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e46cbb7-c189-4101-bd47-33df0b8d687f None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:32.622473 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e46cbb7-c189-4101-bd47-33df0b8d687f None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:32.622747 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e46cbb7-c189-4101-bd47-33df0b8d687f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:32.629651 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:18:32.634231 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e46cbb7-c189-4101-bd47-33df0b8d687f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:18:32.639344 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-7e46cbb7-c189-4101-bd47-33df0b8d687f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:18:32.639344 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:18:32.639344 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:18:32.639344 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:18:32.639344 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:18:32.639344 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:18:32.639344 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:18:32.639344 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:18:32.639344 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:18:32.639344 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:18:32.639344 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:18:32.639344 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:18:32.639344 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:18:32.639344 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:18:32.639344 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:18:32.639344 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:18:32.640456 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:18:32.640456 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:18:32.640456 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:18:32.640456 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:18:32.640456 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:18:32.640456 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:18:32.640456 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:18:32.640456 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:18:32.640456 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:18:32.640456 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:18:32.640456 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:18:32.640456 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:18:32.640456 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:18:32.640456 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:18:32.640456 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:18:32.640456 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:18:32.641505 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:18:32.641505 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:18:32.641505 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:18:32.641505 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:18:32.641505 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:18:32.641505 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:18:32.641505 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:18:32.641505 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:18:32.641505 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:18:32.641505 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:18:32.641505 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:18:32.641505 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:18:32.641505 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 598/1195] 10.222.0.79 () {56 vars in 1096 bytes} [Wed Aug 31 12:18:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:18:32.647260 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d7bf1f-1e10-4a97-aa21-4af2517a4967 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:32.650372 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:18:32.754672 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d7bf1f-1e10-4a97-aa21-4af2517a4967 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:32.792200 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08716d7e-b90b-48ba-bd76-a862f18b48f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:32.792808 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08716d7e-b90b-48ba-bd76-a862f18b48f2 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:32.793089 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08716d7e-b90b-48ba-bd76-a862f18b48f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:32.793362 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08716d7e-b90b-48ba-bd76-a862f18b48f2 None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:32.794031 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08716d7e-b90b-48ba-bd76-a862f18b48f2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:18:32.794336 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08716d7e-b90b-48ba-bd76-a862f18b48f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:32.795732 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08716d7e-b90b-48ba-bd76-a862f18b48f2 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:32.804431 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 598/1196] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 12:18:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:18:32.810683 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e46cbb7-c189-4101-bd47-33df0b8d687f None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:32.915954 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e46cbb7-c189-4101-bd47-33df0b8d687f None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:32.950594 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc294c3a-91ae-4201-bab9-9bc999db91ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:32.951255 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc294c3a-91ae-4201-bab9-9bc999db91ff None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:32.951537 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc294c3a-91ae-4201-bab9-9bc999db91ff None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:32.951808 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc294c3a-91ae-4201-bab9-9bc999db91ff None admin] PATH_INFO: `/v3/users/ce3e8bae953d4320b8b4a32856386a3b` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:32.952936 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc294c3a-91ae-4201-bab9-9bc999db91ff None admin] RBAC: Authorizing `identity:get_user(user_id=ce3e8bae953d4320b8b4a32856386a3b)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:32.954364 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc294c3a-91ae-4201-bab9-9bc999db91ff None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:32.955992 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 599/1197] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 12:18:32 2022] GET /identity/v3/users/ce3e8bae953d4320b8b4a32856386a3b => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:18:32.962259 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08716d7e-b90b-48ba-bd76-a862f18b48f2 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:33.028915 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:18:33.066131 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08716d7e-b90b-48ba-bd76-a862f18b48f2 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:33.101580 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189cdc1c-e470-40d6-8a49-736249cfd11d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:33.102191 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189cdc1c-e470-40d6-8a49-736249cfd11d None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:33.102471 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189cdc1c-e470-40d6-8a49-736249cfd11d None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:33.102742 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189cdc1c-e470-40d6-8a49-736249cfd11d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:33.171112 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189cdc1c-e470-40d6-8a49-736249cfd11d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:33.172566 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189cdc1c-e470-40d6-8a49-736249cfd11d None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:33.236040 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:18:33.272489 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 599/1198] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 12:18:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 12:18:33.278445 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc294c3a-91ae-4201-bab9-9bc999db91ff None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:33.345172 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:18:33.384685 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc294c3a-91ae-4201-bab9-9bc999db91ff None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:33.424395 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56166749-8526-4f7e-a216-21e3a299c2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:33.425056 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56166749-8526-4f7e-a216-21e3a299c2ef None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:33.425337 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56166749-8526-4f7e-a216-21e3a299c2ef None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:33.425611 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56166749-8526-4f7e-a216-21e3a299c2ef None admin] PATH_INFO: `/v3/projects/bcf0747fe0684679865eb2d0776506c1` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:33.426817 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56166749-8526-4f7e-a216-21e3a299c2ef None admin] RBAC: Authorizing `identity:get_project(project_id=bcf0747fe0684679865eb2d0776506c1)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:33.429685 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56166749-8526-4f7e-a216-21e3a299c2ef None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:33.431497 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 600/1199] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 12:18:33 2022] GET /identity/v3/projects/bcf0747fe0684679865eb2d0776506c1 => generated 361 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:18:33.437941 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189cdc1c-e470-40d6-8a49-736249cfd11d None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:33.551277 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189cdc1c-e470-40d6-8a49-736249cfd11d None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:33.588963 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b89509f-4649-41cf-a50b-94a07ebeedf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:33.589578 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89509f-4649-41cf-a50b-94a07ebeedf2 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:33.589856 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89509f-4649-41cf-a50b-94a07ebeedf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:33.590126 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89509f-4649-41cf-a50b-94a07ebeedf2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:33.590886 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b89509f-4649-41cf-a50b-94a07ebeedf2 None admin] RBAC: Adding query filter params (role.id=a332ef951db949b0bad7019fbd28a1b9, scope.project.id=bcf0747fe0684679865eb2d0776506c1, user.id=ce3e8bae953d4320b8b4a32856386a3b) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:18:33.591197 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b89509f-4649-41cf-a50b-94a07ebeedf2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:33.592645 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b89509f-4649-41cf-a50b-94a07ebeedf2 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:33.599253 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 600/1200] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 12:18:33 2022] GET /identity/v3/role_assignments?user.id=ce3e8bae953d4320b8b4a32856386a3b&scope.project.id=bcf0747fe0684679865eb2d0776506c1&role.id=a332ef951db949b0bad7019fbd28a1b9 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:18:43.419866 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=33 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:18:43.596266 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=85 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:19:32.230206 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d4315a-e7c6-45b5-9819-a36f65f441c8 None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:32.230812 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d4315a-e7c6-45b5-9819-a36f65f441c8 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:32.230991 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d4315a-e7c6-45b5-9819-a36f65f441c8 None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:32.232933 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 601/1201] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:19:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:19:32.244752 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b737909-6c34-4215-b691-7f4925bbfd32 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:32.244752 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b737909-6c34-4215-b691-7f4925bbfd32 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:32.244752 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b737909-6c34-4215-b691-7f4925bbfd32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:32.270044 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-2b737909-6c34-4215-b691-7f4925bbfd32 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:19:32.271943 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-2b737909-6c34-4215-b691-7f4925bbfd32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:19:32.399123 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 601/1202] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:19:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:19:32.687968 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d4315a-e7c6-45b5-9819-a36f65f441c8 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:19:32.863510 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d4315a-e7c6-45b5-9819-a36f65f441c8 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:19:32.913546 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a83c793-0f0f-49b3-9055-e9f99caad9b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:19:32.914587 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a83c793-0f0f-49b3-9055-e9f99caad9b8 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:32.915073 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a83c793-0f0f-49b3-9055-e9f99caad9b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:32.915512 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a83c793-0f0f-49b3-9055-e9f99caad9b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:32.929176 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a83c793-0f0f-49b3-9055-e9f99caad9b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:19:32.931112 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a83c793-0f0f-49b3-9055-e9f99caad9b8 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:19:32.958903 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-9a83c793-0f0f-49b3-9055-e9f99caad9b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:19:32.958903 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:19:32.958903 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:19:32.958903 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:19:32.958903 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:19:32.958903 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:19:32.958903 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:19:32.958903 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:19:32.958903 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:19:32.958903 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:19:32.958903 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:19:32.958903 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:19:32.958903 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:19:32.958903 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:19:32.958903 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:19:32.958903 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:19:32.960750 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:19:32.960750 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:19:32.960750 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:19:32.960750 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:19:32.960750 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:19:32.960750 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:19:32.960750 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:19:32.960750 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:19:32.960750 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:19:32.960750 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:19:32.960750 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:19:32.960750 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:19:32.960750 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:19:32.960750 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:19:32.960750 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:19:32.960750 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:19:32.960750 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:19:32.962540 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:19:32.962540 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:19:32.962540 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:19:32.964633 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 602/1203] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:19:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:19:32.971865 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b737909-6c34-4215-b691-7f4925bbfd32 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:19:33.135752 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b737909-6c34-4215-b691-7f4925bbfd32 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:19:33.171655 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:19:33.178455 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756396a6-05b3-4017-83c4-4ea63467b5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:19:33.178992 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756396a6-05b3-4017-83c4-4ea63467b5e2 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:33.179505 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756396a6-05b3-4017-83c4-4ea63467b5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:33.180081 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756396a6-05b3-4017-83c4-4ea63467b5e2 None admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:33.181420 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756396a6-05b3-4017-83c4-4ea63467b5e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:19:33.181955 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756396a6-05b3-4017-83c4-4ea63467b5e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:19:33.183658 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756396a6-05b3-4017-83c4-4ea63467b5e2 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:19:33.200190 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 602/1204] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 12:19:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:19:33.207569 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a83c793-0f0f-49b3-9055-e9f99caad9b8 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:19:33.284582 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:19:33.347868 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a83c793-0f0f-49b3-9055-e9f99caad9b8 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:19:33.392724 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb1bc53-4397-4971-a0fd-a6766d2c0532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:19:33.393406 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1bc53-4397-4971-a0fd-a6766d2c0532 None admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:33.393693 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1bc53-4397-4971-a0fd-a6766d2c0532 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:33.393969 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1bc53-4397-4971-a0fd-a6766d2c0532 None admin] PATH_INFO: `/v3/users` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:33.394683 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb1bc53-4397-4971-a0fd-a6766d2c0532 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:19:33.397017 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb1bc53-4397-4971-a0fd-a6766d2c0532 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:19:33.423681 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 603/1205] 10.222.0.79 () {60 vars in 1132 bytes} [Wed Aug 31 12:19:33 2022] POST /identity/v3/users => generated 251 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:19:35.986462 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd95e92-9bec-47ca-8c13-b8d3386a06d6 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:35.988805 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd95e92-9bec-47ca-8c13-b8d3386a06d6 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:35.988805 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd95e92-9bec-47ca-8c13-b8d3386a06d6 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:35.988805 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 603/1206] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:19:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:19:35.996557 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb745cab-67eb-4624-94b0-a5cb3973405e None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:35.997208 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb745cab-67eb-4624-94b0-a5cb3973405e None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:35.997306 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb745cab-67eb-4624-94b0-a5cb3973405e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:36.022780 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-cb745cab-67eb-4624-94b0-a5cb3973405e None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:19:36.024626 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-cb745cab-67eb-4624-94b0-a5cb3973405e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:19:36.133624 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 604/1207] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:19:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:19:36.438379 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd95e92-9bec-47ca-8c13-b8d3386a06d6 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:19:36.598353 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd95e92-9bec-47ca-8c13-b8d3386a06d6 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:19:36.657040 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d419236-9f75-410b-8b7c-8d78bc422891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:19:36.657804 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d419236-9f75-410b-8b7c-8d78bc422891 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:36.658121 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d419236-9f75-410b-8b7c-8d78bc422891 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:36.658598 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d419236-9f75-410b-8b7c-8d78bc422891 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:36.677871 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d419236-9f75-410b-8b7c-8d78bc422891 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:19:36.682919 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-9d419236-9f75-410b-8b7c-8d78bc422891 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:19:36.682919 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:19:36.682919 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:19:36.682919 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:19:36.682919 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:19:36.682919 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:19:36.682919 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:19:36.682919 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:19:36.682919 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:19:36.682919 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:19:36.682919 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:19:36.682919 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:19:36.682919 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:19:36.682919 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:19:36.682919 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:19:36.682919 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:19:36.684325 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:19:36.684325 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:19:36.684325 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:19:36.684325 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:19:36.684325 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:19:36.684325 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:19:36.684325 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:19:36.684325 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:19:36.684325 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:19:36.684325 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:19:36.684325 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:19:36.684325 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:19:36.684325 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:19:36.684325 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:19:36.684325 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:19:36.684325 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:19:36.685988 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:19:36.685988 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:19:36.685988 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:19:36.685988 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:19:36.685988 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:19:36.685988 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:19:36.685988 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:19:36.685988 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:19:36.685988 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:19:36.685988 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:19:36.685988 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:19:36.685988 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:19:36.685988 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 604/1208] 10.222.0.79 () {56 vars in 1102 bytes} [Wed Aug 31 12:19:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:19:36.690976 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb745cab-67eb-4624-94b0-a5cb3973405e None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:19:36.740773 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:19:36.820305 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb745cab-67eb-4624-94b0-a5cb3973405e None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:19:36.859236 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dff35e-8425-4885-9b68-c91829581c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:19:36.859855 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dff35e-8425-4885-9b68-c91829581c64 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:36.860135 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dff35e-8425-4885-9b68-c91829581c64 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:36.860473 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dff35e-8425-4885-9b68-c91829581c64 None admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:36.861069 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dff35e-8425-4885-9b68-c91829581c64 None admin] RBAC: Adding query filter params (name=service) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:19:36.861368 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dff35e-8425-4885-9b68-c91829581c64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:19:36.862822 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dff35e-8425-4885-9b68-c91829581c64 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:19:36.874907 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 605/1209] 10.222.0.79 () {56 vars in 1103 bytes} [Wed Aug 31 12:19:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:19:36.880850 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d419236-9f75-410b-8b7c-8d78bc422891 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:19:36.956642 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:19:37.020815 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d419236-9f75-410b-8b7c-8d78bc422891 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:19:37.067756 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b9d907-b882-44c6-a437-e7ca578ae095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:19:37.068583 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b9d907-b882-44c6-a437-e7ca578ae095 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:37.068783 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b9d907-b882-44c6-a437-e7ca578ae095 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:37.069065 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b9d907-b882-44c6-a437-e7ca578ae095 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:37.082869 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b9d907-b882-44c6-a437-e7ca578ae095 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:19:37.085708 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b9d907-b882-44c6-a437-e7ca578ae095 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:19:37.108999 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-96b9d907-b882-44c6-a437-e7ca578ae095 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:19:37.108999 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:19:37.108999 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:19:37.108999 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:19:37.108999 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:19:37.108999 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:19:37.108999 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:19:37.108999 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:19:37.108999 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:19:37.108999 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:19:37.108999 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:19:37.108999 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:19:37.108999 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:19:37.108999 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:19:37.108999 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:19:37.108999 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:19:37.110297 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:19:37.110297 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:19:37.110297 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:19:37.110297 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:19:37.110297 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:19:37.110297 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:19:37.110297 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:19:37.110297 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:19:37.110297 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:19:37.110297 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:19:37.110297 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:19:37.110297 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:19:37.110297 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:19:37.110297 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:19:37.110297 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:19:37.110297 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:19:37.110297 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:19:37.120271 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:19:37.120271 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:19:37.120271 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:19:37.120271 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 605/1210] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:19:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:19:37.120725 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dff35e-8425-4885-9b68-c91829581c64 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:19:37.242740 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:19:37.246085 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dff35e-8425-4885-9b68-c91829581c64 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:19:37.285395 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c49e704-2d8a-48d4-b93f-0916122e5fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:19:37.286021 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c49e704-2d8a-48d4-b93f-0916122e5fbc None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:37.287202 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c49e704-2d8a-48d4-b93f-0916122e5fbc None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:37.287202 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c49e704-2d8a-48d4-b93f-0916122e5fbc None admin] PATH_INFO: `/v3/domains` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:37.287943 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c49e704-2d8a-48d4-b93f-0916122e5fbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:19:37.288462 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c49e704-2d8a-48d4-b93f-0916122e5fbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:19:37.289877 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c49e704-2d8a-48d4-b93f-0916122e5fbc None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:19:37.304203 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 606/1211] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 12:19:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:19:37.310382 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b9d907-b882-44c6-a437-e7ca578ae095 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:19:37.455571 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b9d907-b882-44c6-a437-e7ca578ae095 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:19:37.457461 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:19:37.504403 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1232ccd6-e8c2-4672-b549-314ba983c2c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:19:37.505861 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232ccd6-e8c2-4672-b549-314ba983c2c2 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:37.506065 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232ccd6-e8c2-4672-b549-314ba983c2c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:37.506328 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232ccd6-e8c2-4672-b549-314ba983c2c2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:37.514972 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1232ccd6-e8c2-4672-b549-314ba983c2c2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:19:37.516437 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1232ccd6-e8c2-4672-b549-314ba983c2c2 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:19:37.531467 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-1232ccd6-e8c2-4672-b549-314ba983c2c2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 12:19:37.531467 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:19:37.531467 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:19:37.531467 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:19:37.531467 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:19:37.531467 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:19:37.531467 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:19:37.531467 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:19:37.531467 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:19:37.531467 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:19:37.531467 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:19:37.531467 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:19:37.531467 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:19:37.531467 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:19:37.531467 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:19:37.531467 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:19:37.532766 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:19:37.532766 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:19:37.532766 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:19:37.532766 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:19:37.532766 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:19:37.532766 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:19:37.532766 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:19:37.532766 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:19:37.532766 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:19:37.532766 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:19:37.532766 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:19:37.532766 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:19:37.532766 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:19:37.532766 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:19:37.532766 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:19:37.532766 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:19:37.532766 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:19:37.532766 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:19:37.533737 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:19:37.533737 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:19:37.533737 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:19:37.533737 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:19:37.533737 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:19:37.533737 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:19:37.533737 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:19:37.533737 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:19:37.533737 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 12:19:37.533737 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:19:37.533737 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 606/1212] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:19:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:19:37.538835 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c49e704-2d8a-48d4-b93f-0916122e5fbc None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:19:37.704492 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c49e704-2d8a-48d4-b93f-0916122e5fbc None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:19:37.754909 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ff8b0c-5cf3-476e-8525-0824db05075a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:19:37.756406 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff8b0c-5cf3-476e-8525-0824db05075a None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:37.756824 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff8b0c-5cf3-476e-8525-0824db05075a None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:37.757268 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff8b0c-5cf3-476e-8525-0824db05075a None admin] PATH_INFO: `/v3/users` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:37.758593 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ff8b0c-5cf3-476e-8525-0824db05075a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:19:37.759154 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ff8b0c-5cf3-476e-8525-0824db05075a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:19:37.761807 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ff8b0c-5cf3-476e-8525-0824db05075a None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:19:37.797179 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 607/1213] 10.222.0.79 () {56 vars in 1143 bytes} [Wed Aug 31 12:19:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:19:37.806500 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1232ccd6-e8c2-4672-b549-314ba983c2c2 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:19:37.956718 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1232ccd6-e8c2-4672-b549-314ba983c2c2 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:19:38.015169 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b9a6cd-5b90-462d-8eca-4453ce0eb100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:19:38.015689 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b9a6cd-5b90-462d-8eca-4453ce0eb100 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:38.015965 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b9a6cd-5b90-462d-8eca-4453ce0eb100 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:38.016265 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b9a6cd-5b90-462d-8eca-4453ce0eb100 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:38.060211 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:19:38.106209 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b9a6cd-5b90-462d-8eca-4453ce0eb100 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:19:38.107714 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b9a6cd-5b90-462d-8eca-4453ce0eb100 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:19:38.232901 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 607/1214] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 12:19:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 12:19:38.240719 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ff8b0c-5cf3-476e-8525-0824db05075a None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:19:38.281110 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:19:38.394098 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ff8b0c-5cf3-476e-8525-0824db05075a None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:19:38.436421 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7223b5-9adb-44ba-8f78-b26f39376fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:19:38.437183 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7223b5-9adb-44ba-8f78-b26f39376fa4 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:38.437529 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7223b5-9adb-44ba-8f78-b26f39376fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:38.437908 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7223b5-9adb-44ba-8f78-b26f39376fa4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:38.451285 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7223b5-9adb-44ba-8f78-b26f39376fa4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:19:38.453047 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7223b5-9adb-44ba-8f78-b26f39376fa4 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:19:38.474601 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-2f7223b5-9adb-44ba-8f78-b26f39376fa4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:19:38.474601 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:19:38.474601 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:19:38.474601 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:19:38.474601 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:19:38.474601 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:19:38.474601 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:19:38.474601 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:19:38.474601 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:19:38.474601 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:19:38.474601 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:19:38.474601 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:19:38.474601 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:19:38.474601 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:19:38.474601 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:19:38.474601 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:19:38.475957 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:19:38.475957 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:19:38.475957 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:19:38.475957 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:19:38.475957 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:19:38.475957 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:19:38.475957 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:19:38.475957 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:19:38.475957 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:19:38.475957 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:19:38.475957 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:19:38.475957 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:19:38.475957 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:19:38.475957 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:19:38.475957 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:19:38.475957 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:19:38.475957 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:19:38.482178 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:19:38.482178 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:19:38.482178 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:19:38.482178 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 608/1215] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:19:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:19:38.484478 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b9a6cd-5b90-462d-8eca-4453ce0eb100 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:19:38.584854 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:19:38.649416 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b9a6cd-5b90-462d-8eca-4453ce0eb100 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:19:38.724765 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd2af85-7fdd-4be5-af35-0809e1302e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:19:38.725896 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd2af85-7fdd-4be5-af35-0809e1302e1f None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:38.726388 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd2af85-7fdd-4be5-af35-0809e1302e1f None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:38.726895 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd2af85-7fdd-4be5-af35-0809e1302e1f None admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:38.728117 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd2af85-7fdd-4be5-af35-0809e1302e1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:19:38.728756 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd2af85-7fdd-4be5-af35-0809e1302e1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:19:38.731717 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd2af85-7fdd-4be5-af35-0809e1302e1f None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:19:38.755840 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 608/1216] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 12:19:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:19:38.763305 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7223b5-9adb-44ba-8f78-b26f39376fa4 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:19:38.866621 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:19:38.905827 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7223b5-9adb-44ba-8f78-b26f39376fa4 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:19:38.950912 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c587f75-790b-4681-be3b-ebe84766aecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:19:38.951563 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c587f75-790b-4681-be3b-ebe84766aecb None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:38.951830 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c587f75-790b-4681-be3b-ebe84766aecb None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:38.952096 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c587f75-790b-4681-be3b-ebe84766aecb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:38.961770 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c587f75-790b-4681-be3b-ebe84766aecb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:19:38.963292 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c587f75-790b-4681-be3b-ebe84766aecb None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:19:38.977569 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-0c587f75-790b-4681-be3b-ebe84766aecb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:19:38.977569 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:19:38.977569 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:19:38.977569 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:19:38.977569 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:19:38.977569 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:19:38.977569 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:19:38.977569 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:19:38.977569 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:19:38.977569 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:19:38.977569 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:19:38.977569 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:19:38.977569 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:19:38.977569 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:19:38.977569 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:19:38.984017 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:19:38.984017 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:19:38.984017 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:19:38.984017 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:19:38.984017 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:19:38.984017 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:19:38.984017 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:19:38.984017 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:19:38.984017 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:19:38.984017 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:19:38.984017 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:19:38.984017 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:19:38.984017 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:19:38.984017 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:19:38.984017 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:19:38.984017 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:19:38.984017 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:19:38.984924 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:19:38.984924 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:19:38.984924 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:19:38.984924 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:19:38.984924 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:19:38.984924 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:19:38.984924 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:19:38.984924 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:19:38.984924 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 609/1217] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 12:19:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:19:38.988085 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd2af85-7fdd-4be5-af35-0809e1302e1f None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:19:39.146505 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd2af85-7fdd-4be5-af35-0809e1302e1f None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:19:39.178130 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:19:39.194200 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f9ae69-61a1-42a6-b983-fd12348b0cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:19:39.194934 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f9ae69-61a1-42a6-b983-fd12348b0cdb None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:39.195221 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f9ae69-61a1-42a6-b983-fd12348b0cdb None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:39.195498 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f9ae69-61a1-42a6-b983-fd12348b0cdb None admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:39.196198 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f9ae69-61a1-42a6-b983-fd12348b0cdb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:19:39.196504 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f9ae69-61a1-42a6-b983-fd12348b0cdb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:19:39.197937 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f9ae69-61a1-42a6-b983-fd12348b0cdb None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:19:39.216227 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 609/1218] 10.222.0.79 () {56 vars in 1148 bytes} [Wed Aug 31 12:19:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:19:39.225008 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c587f75-790b-4681-be3b-ebe84766aecb None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:19:39.365697 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c587f75-790b-4681-be3b-ebe84766aecb None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:19:39.406240 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:19:39.414358 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d7f7d7-07ca-47e5-988a-cc1f06b24f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:19:39.414996 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d7f7d7-07ca-47e5-988a-cc1f06b24f17 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:39.415284 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d7f7d7-07ca-47e5-988a-cc1f06b24f17 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:39.415554 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d7f7d7-07ca-47e5-988a-cc1f06b24f17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:39.416307 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d7f7d7-07ca-47e5-988a-cc1f06b24f17 None admin] RBAC: Adding query filter params (role.id=37fee7a104964826a0762987a1531a9a, scope.project.id=a94f4957f2a047cc844342e1c7c74ca5, user.id=b6deab40ae6244d4b9affa47b274aea3) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:19:39.416619 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d7f7d7-07ca-47e5-988a-cc1f06b24f17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:19:39.418157 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d7f7d7-07ca-47e5-988a-cc1f06b24f17 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:19:39.438883 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 610/1219] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 12:19:39 2022] GET /identity/v3/role_assignments?user.id=b6deab40ae6244d4b9affa47b274aea3&scope.project.id=a94f4957f2a047cc844342e1c7c74ca5&role.id=37fee7a104964826a0762987a1531a9a => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:19:41.623695 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a781be0-b4f6-445c-a464-2c1c49400200 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:41.624318 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a781be0-b4f6-445c-a464-2c1c49400200 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:41.624318 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a781be0-b4f6-445c-a464-2c1c49400200 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:41.625907 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 610/1220] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:19:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:19:41.635624 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fca213-6e0b-4938-a3e6-b261fd85770c None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:41.636210 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fca213-6e0b-4938-a3e6-b261fd85770c None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:41.636210 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fca213-6e0b-4938-a3e6-b261fd85770c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:41.658828 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-92fca213-6e0b-4938-a3e6-b261fd85770c None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:19:41.660432 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-92fca213-6e0b-4938-a3e6-b261fd85770c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:19:41.771128 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 611/1221] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:19:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:19:42.097811 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a781be0-b4f6-445c-a464-2c1c49400200 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:19:42.256447 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a781be0-b4f6-445c-a464-2c1c49400200 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:19:42.304066 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd89d0b-a569-4e26-b11d-f16fcbae810d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:19:42.304878 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd89d0b-a569-4e26-b11d-f16fcbae810d None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:42.305164 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd89d0b-a569-4e26-b11d-f16fcbae810d None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:42.305454 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd89d0b-a569-4e26-b11d-f16fcbae810d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:42.319612 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd89d0b-a569-4e26-b11d-f16fcbae810d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:19:42.324638 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-1bd89d0b-a569-4e26-b11d-f16fcbae810d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:19:42.324638 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:19:42.324638 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:19:42.324638 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:19:42.324638 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:19:42.324638 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:19:42.324638 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:19:42.324638 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:19:42.324638 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:19:42.324638 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:19:42.324638 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:19:42.324638 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:19:42.324638 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:19:42.324638 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:19:42.324638 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:19:42.324638 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:19:42.326021 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:19:42.326021 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:19:42.326021 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:19:42.326021 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:19:42.326021 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:19:42.326021 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:19:42.326021 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:19:42.326021 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:19:42.326021 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:19:42.326021 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:19:42.326021 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:19:42.326021 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:19:42.326021 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:19:42.326021 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:19:42.326021 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:19:42.326021 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:19:42.326989 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:19:42.326989 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:19:42.326989 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:19:42.326989 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:19:42.326989 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:19:42.326989 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:19:42.326989 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:19:42.326989 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:19:42.326989 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:19:42.326989 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:19:42.326989 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:19:42.326989 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:19:42.326989 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 611/1222] 10.222.0.79 () {56 vars in 1102 bytes} [Wed Aug 31 12:19:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:19:42.333772 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fca213-6e0b-4938-a3e6-b261fd85770c None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:19:42.471373 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fca213-6e0b-4938-a3e6-b261fd85770c None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:19:42.502924 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:19:42.516593 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a264afd-98d8-4dcf-9cb2-8aa9226a1d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:19:42.517215 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a264afd-98d8-4dcf-9cb2-8aa9226a1d90 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:42.517493 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a264afd-98d8-4dcf-9cb2-8aa9226a1d90 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:42.517761 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a264afd-98d8-4dcf-9cb2-8aa9226a1d90 None admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:42.518429 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a264afd-98d8-4dcf-9cb2-8aa9226a1d90 None admin] RBAC: Adding query filter params (name=service) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:19:42.518733 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a264afd-98d8-4dcf-9cb2-8aa9226a1d90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:19:42.520167 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a264afd-98d8-4dcf-9cb2-8aa9226a1d90 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:19:42.529535 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 612/1223] 10.222.0.79 () {56 vars in 1103 bytes} [Wed Aug 31 12:19:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:19:42.535717 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd89d0b-a569-4e26-b11d-f16fcbae810d None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:19:42.588787 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:19:42.667529 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd89d0b-a569-4e26-b11d-f16fcbae810d None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:19:42.707370 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dedaa2-3914-45a8-b14a-0d6e30cba770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:19:42.708069 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dedaa2-3914-45a8-b14a-0d6e30cba770 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:42.709043 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dedaa2-3914-45a8-b14a-0d6e30cba770 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:42.709443 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dedaa2-3914-45a8-b14a-0d6e30cba770 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:42.723362 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dedaa2-3914-45a8-b14a-0d6e30cba770 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:19:42.725065 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dedaa2-3914-45a8-b14a-0d6e30cba770 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:19:42.746604 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-89dedaa2-3914-45a8-b14a-0d6e30cba770 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:19:42.746604 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:19:42.746604 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:19:42.746604 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:19:42.746604 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:19:42.746604 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:19:42.746604 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:19:42.746604 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:19:42.746604 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:19:42.746604 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:19:42.746604 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:19:42.746604 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:19:42.746604 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:19:42.746604 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:19:42.746604 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:19:42.746604 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:19:42.747783 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:19:42.747783 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:19:42.747783 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:19:42.747783 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:19:42.747783 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:19:42.747783 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:19:42.747783 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:19:42.747783 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:19:42.747783 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:19:42.747783 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:19:42.747783 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:19:42.747783 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:19:42.747783 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:19:42.747783 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:19:42.747783 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:19:42.747783 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:19:42.747783 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:19:42.748812 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:19:42.748812 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:19:42.748812 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:19:42.748812 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 612/1224] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:19:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:19:42.754771 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a264afd-98d8-4dcf-9cb2-8aa9226a1d90 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:19:42.891803 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a264afd-98d8-4dcf-9cb2-8aa9226a1d90 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:19:42.948065 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f355fe-e2f1-472f-bed1-887ae28a5524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:19:42.948752 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f355fe-e2f1-472f-bed1-887ae28a5524 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:42.948977 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f355fe-e2f1-472f-bed1-887ae28a5524 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:42.949244 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f355fe-e2f1-472f-bed1-887ae28a5524 None admin] PATH_INFO: `/v3/domains` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:42.949916 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f355fe-e2f1-472f-bed1-887ae28a5524 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:19:42.950218 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f355fe-e2f1-472f-bed1-887ae28a5524 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:19:42.951608 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f355fe-e2f1-472f-bed1-887ae28a5524 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:19:42.968154 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 613/1225] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 12:19:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:19:42.974889 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dedaa2-3914-45a8-b14a-0d6e30cba770 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:19:43.105518 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:19:43.112907 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dedaa2-3914-45a8-b14a-0d6e30cba770 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:19:43.158948 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f63feb-aeae-409a-b18d-5e92cddcb485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:19:43.159805 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f63feb-aeae-409a-b18d-5e92cddcb485 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:43.160073 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f63feb-aeae-409a-b18d-5e92cddcb485 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:43.160340 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f63feb-aeae-409a-b18d-5e92cddcb485 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:43.169376 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f63feb-aeae-409a-b18d-5e92cddcb485 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:19:43.171135 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f63feb-aeae-409a-b18d-5e92cddcb485 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:19:43.187562 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-a3f63feb-aeae-409a-b18d-5e92cddcb485 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 12:19:43.187562 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:19:43.187562 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:19:43.187562 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:19:43.187562 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:19:43.187562 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:19:43.187562 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:19:43.187562 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:19:43.187562 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:19:43.187562 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:19:43.187562 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:19:43.187562 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:19:43.187562 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:19:43.187562 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:19:43.187562 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:19:43.187562 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:19:43.190971 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:19:43.190971 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:19:43.190971 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:19:43.190971 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:19:43.190971 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:19:43.190971 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:19:43.190971 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:19:43.190971 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:19:43.190971 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:19:43.190971 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:19:43.190971 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:19:43.190971 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:19:43.190971 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:19:43.190971 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:19:43.190971 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:19:43.190971 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:19:43.190971 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:19:43.190971 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:19:43.194494 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:19:43.194494 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:19:43.194494 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:19:43.194494 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:19:43.194494 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:19:43.194494 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:19:43.194494 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:19:43.194494 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:19:43.194494 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 12:19:43.194494 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:19:43.194494 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 613/1226] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:19:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:19:43.198050 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f355fe-e2f1-472f-bed1-887ae28a5524 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:19:43.261213 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:19:43.336156 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f355fe-e2f1-472f-bed1-887ae28a5524 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:19:43.385921 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c676b4b-8c96-40e7-b69c-2d59fcbba6ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:19:43.387029 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c676b4b-8c96-40e7-b69c-2d59fcbba6ff None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:43.387540 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c676b4b-8c96-40e7-b69c-2d59fcbba6ff None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:43.389191 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c676b4b-8c96-40e7-b69c-2d59fcbba6ff None admin] PATH_INFO: `/v3/users` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:43.389382 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c676b4b-8c96-40e7-b69c-2d59fcbba6ff None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:19:43.389886 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c676b4b-8c96-40e7-b69c-2d59fcbba6ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:19:43.392137 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c676b4b-8c96-40e7-b69c-2d59fcbba6ff None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:19:43.418932 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 614/1227] 10.222.0.79 () {56 vars in 1143 bytes} [Wed Aug 31 12:19:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:19:43.425445 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f63feb-aeae-409a-b18d-5e92cddcb485 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:19:43.574756 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f63feb-aeae-409a-b18d-5e92cddcb485 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:19:43.628245 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41809f01-81f7-4df3-971f-3d25675a5576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:19:43.629176 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41809f01-81f7-4df3-971f-3d25675a5576 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:43.629576 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41809f01-81f7-4df3-971f-3d25675a5576 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:43.629965 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41809f01-81f7-4df3-971f-3d25675a5576 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:43.651471 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41809f01-81f7-4df3-971f-3d25675a5576 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:19:43.653015 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41809f01-81f7-4df3-971f-3d25675a5576 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:19:43.671995 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-41809f01-81f7-4df3-971f-3d25675a5576 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:19:43.671995 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:19:43.671995 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:19:43.671995 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:19:43.671995 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:19:43.671995 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:19:43.671995 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:19:43.671995 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:19:43.671995 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:19:43.671995 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:19:43.671995 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:19:43.671995 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:19:43.671995 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:19:43.671995 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:19:43.671995 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:19:43.671995 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:19:43.673753 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:19:43.673753 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:19:43.673753 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:19:43.673753 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:19:43.673753 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:19:43.673753 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:19:43.673753 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:19:43.673753 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:19:43.673753 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:19:43.673753 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:19:43.673753 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:19:43.673753 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:19:43.673753 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:19:43.673753 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:19:43.673753 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:19:43.673753 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:19:43.673753 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:19:43.675907 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:19:43.675907 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:19:43.675907 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:19:43.675907 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 614/1228] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:19:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:19:43.680040 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c676b4b-8c96-40e7-b69c-2d59fcbba6ff None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:19:43.840557 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c676b4b-8c96-40e7-b69c-2d59fcbba6ff None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:19:43.843964 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:19:43.893888 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba846d3-fde7-46ec-90f5-bebd8fc65eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:19:43.894657 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba846d3-fde7-46ec-90f5-bebd8fc65eb4 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:43.894986 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba846d3-fde7-46ec-90f5-bebd8fc65eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:43.895325 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba846d3-fde7-46ec-90f5-bebd8fc65eb4 None admin] PATH_INFO: `/v3/domains` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:43.896860 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba846d3-fde7-46ec-90f5-bebd8fc65eb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:19:43.897324 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba846d3-fde7-46ec-90f5-bebd8fc65eb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:19:43.898902 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba846d3-fde7-46ec-90f5-bebd8fc65eb4 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:19:43.913359 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 615/1229] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 12:19:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:19:43.919540 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41809f01-81f7-4df3-971f-3d25675a5576 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:19:43.930795 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:19:44.046652 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41809f01-81f7-4df3-971f-3d25675a5576 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:19:44.104128 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d11c06-c103-4f2b-b23e-f28d3324b695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:19:44.104665 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d11c06-c103-4f2b-b23e-f28d3324b695 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:44.104942 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d11c06-c103-4f2b-b23e-f28d3324b695 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:44.105209 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d11c06-c103-4f2b-b23e-f28d3324b695 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:44.118661 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d11c06-c103-4f2b-b23e-f28d3324b695 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:19:44.122479 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d11c06-c103-4f2b-b23e-f28d3324b695 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:19:44.141207 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-89d11c06-c103-4f2b-b23e-f28d3324b695 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:19:44.141207 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:19:44.141207 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:19:44.141207 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:19:44.141207 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:19:44.141207 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:19:44.141207 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:19:44.141207 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:19:44.141207 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:19:44.141207 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:19:44.141207 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:19:44.141207 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:19:44.141207 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:19:44.141207 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:19:44.141207 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:19:44.143511 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:19:44.143511 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:19:44.143511 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:19:44.143511 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:19:44.143511 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:19:44.143511 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:19:44.143511 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:19:44.143511 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:19:44.143511 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:19:44.143511 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:19:44.143511 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:19:44.143511 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:19:44.143511 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:19:44.143511 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:19:44.143511 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:19:44.143511 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:19:44.143511 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:19:44.145358 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:19:44.145358 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:19:44.145358 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:19:44.145358 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:19:44.145358 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:19:44.145358 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:19:44.145358 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:19:44.145358 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:19:44.145358 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 615/1230] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 12:19:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:19:44.152657 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba846d3-fde7-46ec-90f5-bebd8fc65eb4 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:19:44.320537 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba846d3-fde7-46ec-90f5-bebd8fc65eb4 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:19:44.378951 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff6a949-585a-41e0-b2c0-8f98bc7e34c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:19:44.379607 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff6a949-585a-41e0-b2c0-8f98bc7e34c1 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:44.379797 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff6a949-585a-41e0-b2c0-8f98bc7e34c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:44.380257 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff6a949-585a-41e0-b2c0-8f98bc7e34c1 None admin] PATH_INFO: `/v3/projects` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:44.381337 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff6a949-585a-41e0-b2c0-8f98bc7e34c1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:19:44.381337 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff6a949-585a-41e0-b2c0-8f98bc7e34c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:19:44.382827 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff6a949-585a-41e0-b2c0-8f98bc7e34c1 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:19:44.398092 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 616/1231] 10.222.0.79 () {56 vars in 1148 bytes} [Wed Aug 31 12:19:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:19:44.406539 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d11c06-c103-4f2b-b23e-f28d3324b695 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:19:44.497879 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:19:44.546350 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d11c06-c103-4f2b-b23e-f28d3324b695 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:19:44.596148 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a28aa9f-ca58-4e20-b71a-29a288b72c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:19:44.597268 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a28aa9f-ca58-4e20-b71a-29a288b72c19 None admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:44.597656 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a28aa9f-ca58-4e20-b71a-29a288b72c19 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:44.598183 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a28aa9f-ca58-4e20-b71a-29a288b72c19 None admin] PATH_INFO: `/v3/projects/a94f4957f2a047cc844342e1c7c74ca5/users/b6deab40ae6244d4b9affa47b274aea3/roles/37fee7a104964826a0762987a1531a9a` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:44.623647 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a28aa9f-ca58-4e20-b71a-29a288b72c19 None admin] RBAC: Authorizing `identity:create_grant(project_id=a94f4957f2a047cc844342e1c7c74ca5, user_id=b6deab40ae6244d4b9affa47b274aea3, role_id=37fee7a104964826a0762987a1531a9a)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:19:44.626088 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a28aa9f-ca58-4e20-b71a-29a288b72c19 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:19:44.641629 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 616/1232] 10.222.0.79 () {58 vars in 1439 bytes} [Wed Aug 31 12:19:44 2022] PUT /identity/v3/projects/a94f4957f2a047cc844342e1c7c74ca5/users/b6deab40ae6244d4b9affa47b274aea3/roles/37fee7a104964826a0762987a1531a9a => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:19:46.826197 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432dee22-3ac2-4b0c-b383-f50bdc1a21f0 None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:46.826890 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432dee22-3ac2-4b0c-b383-f50bdc1a21f0 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:46.826890 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432dee22-3ac2-4b0c-b383-f50bdc1a21f0 None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:46.828179 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 617/1233] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:19:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:19:46.835440 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c1378-fac3-4259-85ee-2eafb4545110 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:46.836220 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c1378-fac3-4259-85ee-2eafb4545110 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:46.836354 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c1378-fac3-4259-85ee-2eafb4545110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:46.859079 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-6b7c1378-fac3-4259-85ee-2eafb4545110 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:19:46.860495 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-6b7c1378-fac3-4259-85ee-2eafb4545110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:19:46.944929 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 617/1234] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:19:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:19:47.411697 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432dee22-3ac2-4b0c-b383-f50bdc1a21f0 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:19:47.441371 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:19:47.569212 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432dee22-3ac2-4b0c-b383-f50bdc1a21f0 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:19:47.631828 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a667c62-5f74-469c-a4f8-0f198a520413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:19:47.632546 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a667c62-5f74-469c-a4f8-0f198a520413 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:47.632933 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a667c62-5f74-469c-a4f8-0f198a520413 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:47.633276 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a667c62-5f74-469c-a4f8-0f198a520413 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:47.652414 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a667c62-5f74-469c-a4f8-0f198a520413 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:19:47.660132 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-1a667c62-5f74-469c-a4f8-0f198a520413 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:19:47.660132 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:19:47.660132 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:19:47.660132 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:19:47.660132 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:19:47.660132 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:19:47.660132 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:19:47.660132 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:19:47.660132 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:19:47.660132 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:19:47.660132 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:19:47.660132 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:19:47.660132 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:19:47.660132 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:19:47.660132 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:19:47.660132 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:19:47.661786 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:19:47.661786 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:19:47.661786 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:19:47.661786 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:19:47.661786 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:19:47.661786 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:19:47.661786 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:19:47.661786 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:19:47.661786 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:19:47.661786 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:19:47.661786 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:19:47.661786 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:19:47.661786 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:19:47.661786 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:19:47.661786 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:19:47.661786 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:19:47.663540 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:19:47.663540 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:19:47.663540 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:19:47.663540 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:19:47.663540 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:19:47.663540 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:19:47.663540 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:19:47.663540 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:19:47.663540 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:19:47.663540 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:19:47.663540 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:19:47.663540 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:19:47.663540 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 618/1235] 10.222.0.79 () {56 vars in 1102 bytes} [Wed Aug 31 12:19:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:19:47.671145 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7c1378-fac3-4259-85ee-2eafb4545110 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:19:47.752250 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:19:47.847339 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7c1378-fac3-4259-85ee-2eafb4545110 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:19:47.902417 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc93562-4c12-421c-bdcb-066cd837656c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:19:47.903467 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc93562-4c12-421c-bdcb-066cd837656c None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:47.903779 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc93562-4c12-421c-bdcb-066cd837656c None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:47.904222 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc93562-4c12-421c-bdcb-066cd837656c None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:47.905417 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc93562-4c12-421c-bdcb-066cd837656c None admin] RBAC: Adding query filter params (name=service) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:19:47.905752 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc93562-4c12-421c-bdcb-066cd837656c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:19:47.908512 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc93562-4c12-421c-bdcb-066cd837656c None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:19:47.922027 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 618/1236] 10.222.0.79 () {56 vars in 1103 bytes} [Wed Aug 31 12:19:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:19:47.929961 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a667c62-5f74-469c-a4f8-0f198a520413 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:19:48.073802 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:19:48.097378 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a667c62-5f74-469c-a4f8-0f198a520413 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:19:48.142526 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bbd7c0-20c4-4387-bb3f-2bdd83fe4517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:19:48.143242 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bbd7c0-20c4-4387-bb3f-2bdd83fe4517 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:48.143531 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bbd7c0-20c4-4387-bb3f-2bdd83fe4517 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:48.143799 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bbd7c0-20c4-4387-bb3f-2bdd83fe4517 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:48.159498 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bbd7c0-20c4-4387-bb3f-2bdd83fe4517 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:19:48.162172 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bbd7c0-20c4-4387-bb3f-2bdd83fe4517 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:19:48.187523 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-f4bbd7c0-20c4-4387-bb3f-2bdd83fe4517 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:19:48.187523 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:19:48.187523 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:19:48.187523 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:19:48.187523 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:19:48.187523 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:19:48.187523 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:19:48.187523 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:19:48.187523 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:19:48.187523 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:19:48.187523 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:19:48.187523 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:19:48.187523 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:19:48.187523 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:19:48.187523 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:19:48.187523 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:19:48.192309 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:19:48.192309 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:19:48.192309 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:19:48.192309 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:19:48.192309 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:19:48.192309 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:19:48.192309 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:19:48.192309 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:19:48.192309 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:19:48.192309 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:19:48.192309 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:19:48.192309 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:19:48.192309 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:19:48.192309 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:19:48.192309 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:19:48.192309 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:19:48.192309 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:19:48.195274 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:19:48.195274 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:19:48.195274 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:19:48.195274 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 619/1237] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:19:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:19:48.195899 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc93562-4c12-421c-bdcb-066cd837656c None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:19:48.346959 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc93562-4c12-421c-bdcb-066cd837656c None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:19:48.362902 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:19:48.397399 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089c39e5-132c-46e8-abe6-60d44c2922f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:19:48.398152 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c39e5-132c-46e8-abe6-60d44c2922f6 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:48.398575 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c39e5-132c-46e8-abe6-60d44c2922f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:48.398956 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c39e5-132c-46e8-abe6-60d44c2922f6 None admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:48.399951 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089c39e5-132c-46e8-abe6-60d44c2922f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:19:48.400337 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089c39e5-132c-46e8-abe6-60d44c2922f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:19:48.402058 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089c39e5-132c-46e8-abe6-60d44c2922f6 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:19:48.417844 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 619/1238] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 12:19:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:19:48.425742 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bbd7c0-20c4-4387-bb3f-2bdd83fe4517 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:19:48.572515 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bbd7c0-20c4-4387-bb3f-2bdd83fe4517 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:19:48.635676 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf530e8-0718-4094-bbb4-08593020ddc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:19:48.636755 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf530e8-0718-4094-bbb4-08593020ddc0 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:48.637245 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf530e8-0718-4094-bbb4-08593020ddc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:48.637788 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf530e8-0718-4094-bbb4-08593020ddc0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:48.642473 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:19:48.654150 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf530e8-0718-4094-bbb4-08593020ddc0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:19:48.656768 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf530e8-0718-4094-bbb4-08593020ddc0 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:19:48.669922 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-eaf530e8-0718-4094-bbb4-08593020ddc0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 12:19:48.669922 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:19:48.669922 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:19:48.669922 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:19:48.669922 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:19:48.669922 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:19:48.669922 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:19:48.669922 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:19:48.669922 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:19:48.669922 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:19:48.669922 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:19:48.669922 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:19:48.669922 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:19:48.669922 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:19:48.669922 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:19:48.669922 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:19:48.671555 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:19:48.671555 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:19:48.671555 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:19:48.671555 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:19:48.671555 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:19:48.671555 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:19:48.671555 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:19:48.671555 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:19:48.671555 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:19:48.671555 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:19:48.671555 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:19:48.671555 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:19:48.671555 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:19:48.671555 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:19:48.671555 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:19:48.671555 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:19:48.671555 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:19:48.671555 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:19:48.672800 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:19:48.672800 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:19:48.672800 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:19:48.672800 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:19:48.672800 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:19:48.672800 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:19:48.672800 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:19:48.672800 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:19:48.672800 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 12:19:48.672800 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:19:48.672800 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 620/1239] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:19:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:19:48.681328 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089c39e5-132c-46e8-abe6-60d44c2922f6 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:19:48.834999 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089c39e5-132c-46e8-abe6-60d44c2922f6 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:19:48.887099 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad9b80c-0265-4b4e-8eff-5f32f0d9d35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:19:48.888225 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad9b80c-0265-4b4e-8eff-5f32f0d9d35f None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:48.888518 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad9b80c-0265-4b4e-8eff-5f32f0d9d35f None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:48.888888 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad9b80c-0265-4b4e-8eff-5f32f0d9d35f None admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:48.889765 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad9b80c-0265-4b4e-8eff-5f32f0d9d35f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:19:48.890166 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad9b80c-0265-4b4e-8eff-5f32f0d9d35f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:19:48.891796 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad9b80c-0265-4b4e-8eff-5f32f0d9d35f None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:19:48.923296 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 620/1240] 10.222.0.79 () {56 vars in 1143 bytes} [Wed Aug 31 12:19:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:19:48.931597 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf530e8-0718-4094-bbb4-08593020ddc0 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:19:49.076251 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf530e8-0718-4094-bbb4-08593020ddc0 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:19:49.125231 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd4a96-1ebc-457f-823e-d0c2ab5caeed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:19:49.125768 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd4a96-1ebc-457f-823e-d0c2ab5caeed None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:49.126047 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd4a96-1ebc-457f-823e-d0c2ab5caeed None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:49.126347 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd4a96-1ebc-457f-823e-d0c2ab5caeed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:49.218887 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:19:49.228802 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fd4a96-1ebc-457f-823e-d0c2ab5caeed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:19:49.230495 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fd4a96-1ebc-457f-823e-d0c2ab5caeed None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:19:49.367680 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 621/1241] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 12:19:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 12:19:49.376277 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad9b80c-0265-4b4e-8eff-5f32f0d9d35f None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:19:49.427471 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:19:49.531068 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad9b80c-0265-4b4e-8eff-5f32f0d9d35f None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:19:49.584201 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2325876b-0a18-4c60-b234-39f10b2c0e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:19:49.585526 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2325876b-0a18-4c60-b234-39f10b2c0e9f None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:49.585811 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2325876b-0a18-4c60-b234-39f10b2c0e9f None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:49.586101 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2325876b-0a18-4c60-b234-39f10b2c0e9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:49.598534 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2325876b-0a18-4c60-b234-39f10b2c0e9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:19:49.600639 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2325876b-0a18-4c60-b234-39f10b2c0e9f None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:19:49.618446 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-2325876b-0a18-4c60-b234-39f10b2c0e9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:19:49.618446 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:19:49.618446 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:19:49.618446 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:19:49.618446 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:19:49.618446 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:19:49.618446 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:19:49.618446 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:19:49.618446 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:19:49.618446 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:19:49.618446 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:19:49.618446 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:19:49.618446 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:19:49.618446 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:19:49.618446 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:19:49.618446 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:19:49.619996 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:19:49.619996 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:19:49.619996 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:19:49.619996 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:19:49.619996 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:19:49.619996 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:19:49.619996 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:19:49.619996 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:19:49.619996 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:19:49.619996 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:19:49.619996 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:19:49.619996 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:19:49.619996 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:19:49.619996 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:19:49.619996 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:19:49.619996 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:19:49.619996 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:19:49.621188 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:19:49.621188 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:19:49.621188 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:19:49.621188 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 621/1242] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:19:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:19:49.628073 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd4a96-1ebc-457f-823e-d0c2ab5caeed None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:19:49.781911 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:19:49.791697 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd4a96-1ebc-457f-823e-d0c2ab5caeed None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:19:49.851792 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6058ec69-ff1d-45c3-af53-08cc04a3697d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:19:49.852562 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058ec69-ff1d-45c3-af53-08cc04a3697d None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:49.852752 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058ec69-ff1d-45c3-af53-08cc04a3697d None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:49.853072 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058ec69-ff1d-45c3-af53-08cc04a3697d None admin] PATH_INFO: `/v3/domains` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:49.853779 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6058ec69-ff1d-45c3-af53-08cc04a3697d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:19:49.854109 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6058ec69-ff1d-45c3-af53-08cc04a3697d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:19:49.855593 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6058ec69-ff1d-45c3-af53-08cc04a3697d None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:19:49.881825 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 622/1243] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 12:19:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:19:49.884582 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2325876b-0a18-4c60-b234-39f10b2c0e9f None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:19:49.981643 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:19:50.014507 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2325876b-0a18-4c60-b234-39f10b2c0e9f None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:19:50.066764 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00bbe03-dc73-4d4a-a48d-9ad4c9ff6f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:19:50.067483 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00bbe03-dc73-4d4a-a48d-9ad4c9ff6f06 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:50.068305 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00bbe03-dc73-4d4a-a48d-9ad4c9ff6f06 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:50.068572 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00bbe03-dc73-4d4a-a48d-9ad4c9ff6f06 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:50.080879 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00bbe03-dc73-4d4a-a48d-9ad4c9ff6f06 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:19:50.083160 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00bbe03-dc73-4d4a-a48d-9ad4c9ff6f06 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:19:50.101234 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-b00bbe03-dc73-4d4a-a48d-9ad4c9ff6f06 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:19:50.101234 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:19:50.101234 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:19:50.101234 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:19:50.101234 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:19:50.101234 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:19:50.101234 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:19:50.101234 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:19:50.101234 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:19:50.101234 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:19:50.101234 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:19:50.101234 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:19:50.101234 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:19:50.101234 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:19:50.101234 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:19:50.102500 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:19:50.102500 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:19:50.102500 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:19:50.102500 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:19:50.102500 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:19:50.102500 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:19:50.102500 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:19:50.102500 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:19:50.102500 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:19:50.102500 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:19:50.102500 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:19:50.102500 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:19:50.102500 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:19:50.102500 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:19:50.102500 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:19:50.102500 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:19:50.102500 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:19:50.103530 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:19:50.103530 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:19:50.103530 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:19:50.103530 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:19:50.103530 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:19:50.103530 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:19:50.103530 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:19:50.103530 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:19:50.103530 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 622/1244] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 12:19:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:19:50.111414 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6058ec69-ff1d-45c3-af53-08cc04a3697d None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:19:50.256330 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6058ec69-ff1d-45c3-af53-08cc04a3697d None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:19:50.300856 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d6122a-77d7-4dd4-8dd9-155bf110aea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:19:50.302487 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d6122a-77d7-4dd4-8dd9-155bf110aea9 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:50.302951 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d6122a-77d7-4dd4-8dd9-155bf110aea9 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:50.303343 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d6122a-77d7-4dd4-8dd9-155bf110aea9 None admin] PATH_INFO: `/v3/projects` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:50.304256 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d6122a-77d7-4dd4-8dd9-155bf110aea9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:19:50.304761 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d6122a-77d7-4dd4-8dd9-155bf110aea9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:19:50.306839 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d6122a-77d7-4dd4-8dd9-155bf110aea9 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:19:50.321177 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 623/1245] 10.222.0.79 () {56 vars in 1148 bytes} [Wed Aug 31 12:19:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:19:50.327658 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00bbe03-dc73-4d4a-a48d-9ad4c9ff6f06 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:19:50.451390 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00bbe03-dc73-4d4a-a48d-9ad4c9ff6f06 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:19:50.493911 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df66c573-990d-4653-8697-1b2fd074441f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:19:50.494565 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df66c573-990d-4653-8697-1b2fd074441f None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:50.494914 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df66c573-990d-4653-8697-1b2fd074441f None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:50.495195 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df66c573-990d-4653-8697-1b2fd074441f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:50.496075 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df66c573-990d-4653-8697-1b2fd074441f None admin] RBAC: Adding query filter params (role.id=37fee7a104964826a0762987a1531a9a, scope.project.id=a94f4957f2a047cc844342e1c7c74ca5, user.id=b6deab40ae6244d4b9affa47b274aea3) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:19:50.496382 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df66c573-990d-4653-8697-1b2fd074441f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:19:50.498115 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df66c573-990d-4653-8697-1b2fd074441f None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:19:50.504813 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 623/1246] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 12:19:50 2022] GET /identity/v3/role_assignments?user.id=b6deab40ae6244d4b9affa47b274aea3&scope.project.id=a94f4957f2a047cc844342e1c7c74ca5&role.id=37fee7a104964826a0762987a1531a9a => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:19:52.737166 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ce9e0-7504-43d7-a666-fe4d976e266e None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:52.737804 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ce9e0-7504-43d7-a666-fe4d976e266e None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:52.737804 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ce9e0-7504-43d7-a666-fe4d976e266e None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:52.738994 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 624/1247] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:19:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:19:52.745782 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9896afd1-05af-41c5-89b6-a13dc3652f5a None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:52.746424 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9896afd1-05af-41c5-89b6-a13dc3652f5a None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:52.746424 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9896afd1-05af-41c5-89b6-a13dc3652f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:52.755013 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:19:52.771519 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-9896afd1-05af-41c5-89b6-a13dc3652f5a None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:19:52.773079 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-9896afd1-05af-41c5-89b6-a13dc3652f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:19:52.869676 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 624/1248] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:19:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:19:53.153920 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64ce9e0-7504-43d7-a666-fe4d976e266e None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:19:53.178802 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:19:53.279389 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64ce9e0-7504-43d7-a666-fe4d976e266e None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:19:53.323349 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c201db3-6839-44c0-a829-2911c20a5803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:19:53.323995 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c201db3-6839-44c0-a829-2911c20a5803 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:53.324279 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c201db3-6839-44c0-a829-2911c20a5803 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:53.324548 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c201db3-6839-44c0-a829-2911c20a5803 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:53.336022 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c201db3-6839-44c0-a829-2911c20a5803 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:19:53.341437 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-0c201db3-6839-44c0-a829-2911c20a5803 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:19:53.341437 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:19:53.341437 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:19:53.341437 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:19:53.341437 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:19:53.341437 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:19:53.341437 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:19:53.341437 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:19:53.341437 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:19:53.341437 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:19:53.341437 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:19:53.341437 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:19:53.341437 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:19:53.341437 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:19:53.341437 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:19:53.341437 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:19:53.342914 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:19:53.342914 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:19:53.342914 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:19:53.342914 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:19:53.342914 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:19:53.342914 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:19:53.342914 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:19:53.342914 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:19:53.342914 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:19:53.342914 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:19:53.342914 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:19:53.342914 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:19:53.342914 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:19:53.342914 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:19:53.342914 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:19:53.342914 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:19:53.344127 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:19:53.344127 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:19:53.344127 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:19:53.344127 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:19:53.344127 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:19:53.344127 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:19:53.344127 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:19:53.344127 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:19:53.344127 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:19:53.344127 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:19:53.344127 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:19:53.344127 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:19:53.344127 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 625/1249] 10.222.0.79 () {56 vars in 1096 bytes} [Wed Aug 31 12:19:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:19:53.349675 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9896afd1-05af-41c5-89b6-a13dc3652f5a None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:19:53.474451 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9896afd1-05af-41c5-89b6-a13dc3652f5a None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:19:53.512010 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:19:53.516875 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ea6a5c-8a3d-48a0-a31b-927359e1e56d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:19:53.517821 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea6a5c-8a3d-48a0-a31b-927359e1e56d None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:53.518108 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea6a5c-8a3d-48a0-a31b-927359e1e56d None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:53.518388 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea6a5c-8a3d-48a0-a31b-927359e1e56d None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:53.519095 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ea6a5c-8a3d-48a0-a31b-927359e1e56d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:19:53.519399 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ea6a5c-8a3d-48a0-a31b-927359e1e56d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:19:53.520911 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ea6a5c-8a3d-48a0-a31b-927359e1e56d None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:19:53.530201 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 625/1250] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 12:19:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:19:53.536951 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c201db3-6839-44c0-a829-2911c20a5803 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:19:53.624396 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:19:53.652761 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c201db3-6839-44c0-a829-2911c20a5803 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:19:53.692103 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba84b918-704b-4b9f-9175-a15eb5d73975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:19:53.693469 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84b918-704b-4b9f-9175-a15eb5d73975 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:53.693797 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84b918-704b-4b9f-9175-a15eb5d73975 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:53.694117 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84b918-704b-4b9f-9175-a15eb5d73975 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:53.708950 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba84b918-704b-4b9f-9175-a15eb5d73975 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:19:53.710575 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba84b918-704b-4b9f-9175-a15eb5d73975 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:19:53.731900 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-ba84b918-704b-4b9f-9175-a15eb5d73975 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:19:53.731900 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:19:53.731900 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:19:53.731900 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:19:53.731900 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:19:53.731900 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:19:53.731900 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:19:53.731900 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:19:53.731900 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:19:53.731900 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:19:53.731900 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:19:53.731900 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:19:53.731900 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:19:53.731900 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:19:53.731900 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:19:53.731900 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:19:53.733304 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:19:53.733304 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:19:53.733304 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:19:53.733304 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:19:53.733304 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:19:53.733304 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:19:53.733304 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:19:53.733304 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:19:53.733304 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:19:53.733304 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:19:53.733304 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:19:53.733304 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:19:53.733304 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:19:53.733304 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:19:53.733304 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:19:53.733304 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:19:53.733304 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:19:53.740570 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:19:53.740570 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:19:53.740570 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:19:53.740570 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 626/1251] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:19:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:19:53.741066 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ea6a5c-8a3d-48a0-a31b-927359e1e56d None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:19:53.867344 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ea6a5c-8a3d-48a0-a31b-927359e1e56d None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:19:53.923322 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a7b9dd-387b-482a-80f5-be11a9b89114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:19:53.923977 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7b9dd-387b-482a-80f5-be11a9b89114 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:53.924309 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7b9dd-387b-482a-80f5-be11a9b89114 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:53.924550 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7b9dd-387b-482a-80f5-be11a9b89114 None admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:53.925178 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a7b9dd-387b-482a-80f5-be11a9b89114 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:19:53.925474 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a7b9dd-387b-482a-80f5-be11a9b89114 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:19:53.927451 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a7b9dd-387b-482a-80f5-be11a9b89114 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:19:53.940492 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 626/1252] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 12:19:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:19:53.947103 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba84b918-704b-4b9f-9175-a15eb5d73975 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:19:54.063108 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba84b918-704b-4b9f-9175-a15eb5d73975 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:19:54.094816 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:19:54.105905 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82840de4-15fd-472b-8734-ce7a12ae9d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:19:54.106544 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82840de4-15fd-472b-8734-ce7a12ae9d76 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:54.106823 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82840de4-15fd-472b-8734-ce7a12ae9d76 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:54.107133 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82840de4-15fd-472b-8734-ce7a12ae9d76 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:54.116929 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82840de4-15fd-472b-8734-ce7a12ae9d76 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:19:54.118787 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82840de4-15fd-472b-8734-ce7a12ae9d76 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:19:54.133074 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-82840de4-15fd-472b-8734-ce7a12ae9d76 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 12:19:54.133074 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:19:54.133074 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:19:54.133074 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:19:54.133074 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:19:54.133074 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:19:54.133074 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:19:54.133074 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:19:54.133074 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:19:54.133074 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:19:54.133074 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:19:54.133074 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:19:54.133074 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:19:54.133074 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:19:54.133074 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:19:54.133074 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:19:54.134337 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:19:54.134337 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:19:54.134337 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:19:54.134337 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:19:54.134337 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:19:54.134337 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:19:54.134337 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:19:54.134337 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:19:54.134337 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:19:54.134337 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:19:54.134337 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:19:54.134337 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:19:54.134337 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:19:54.134337 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:19:54.134337 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:19:54.134337 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:19:54.134337 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:19:54.134337 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:19:54.135579 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:19:54.135579 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:19:54.135579 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:19:54.135579 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:19:54.135579 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:19:54.135579 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:19:54.135579 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:19:54.135579 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:19:54.135579 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 12:19:54.135579 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:19:54.135579 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 627/1253] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:19:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:19:54.140724 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a7b9dd-387b-482a-80f5-be11a9b89114 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:19:54.208032 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:19:54.260602 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a7b9dd-387b-482a-80f5-be11a9b89114 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:19:54.300118 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d17ca3b-72fa-482d-9a98-10e48574f999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:19:54.300826 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17ca3b-72fa-482d-9a98-10e48574f999 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:54.301115 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17ca3b-72fa-482d-9a98-10e48574f999 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:54.301378 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17ca3b-72fa-482d-9a98-10e48574f999 None admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:54.303075 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d17ca3b-72fa-482d-9a98-10e48574f999 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:19:54.303393 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d17ca3b-72fa-482d-9a98-10e48574f999 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:19:54.305103 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d17ca3b-72fa-482d-9a98-10e48574f999 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:19:54.326002 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 627/1254] 10.222.0.79 () {56 vars in 1143 bytes} [Wed Aug 31 12:19:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:19:54.331692 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82840de4-15fd-472b-8734-ce7a12ae9d76 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:19:54.451410 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82840de4-15fd-472b-8734-ce7a12ae9d76 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:19:54.493559 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aaefcd-05d1-4c7e-8f19-b4b1e6535e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:19:54.494177 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aaefcd-05d1-4c7e-8f19-b4b1e6535e63 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:54.494453 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aaefcd-05d1-4c7e-8f19-b4b1e6535e63 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:54.494716 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aaefcd-05d1-4c7e-8f19-b4b1e6535e63 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:54.565877 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:19:54.581211 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aaefcd-05d1-4c7e-8f19-b4b1e6535e63 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:19:54.582708 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aaefcd-05d1-4c7e-8f19-b4b1e6535e63 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:19:54.695159 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 628/1255] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 12:19:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 12:19:54.704350 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d17ca3b-72fa-482d-9a98-10e48574f999 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:19:54.833924 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d17ca3b-72fa-482d-9a98-10e48574f999 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:19:54.855259 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:19:54.889046 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d299ea-5b9c-4283-a6a4-c86458d5c193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:19:54.889757 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d299ea-5b9c-4283-a6a4-c86458d5c193 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:54.890047 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d299ea-5b9c-4283-a6a4-c86458d5c193 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:54.890318 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d299ea-5b9c-4283-a6a4-c86458d5c193 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:54.903875 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d299ea-5b9c-4283-a6a4-c86458d5c193 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:19:54.906767 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d299ea-5b9c-4283-a6a4-c86458d5c193 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:19:54.923938 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-17d299ea-5b9c-4283-a6a4-c86458d5c193 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:19:54.923938 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:19:54.923938 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:19:54.923938 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:19:54.923938 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:19:54.923938 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:19:54.923938 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:19:54.923938 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:19:54.923938 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:19:54.923938 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:19:54.923938 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:19:54.923938 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:19:54.923938 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:19:54.923938 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:19:54.923938 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:19:54.923938 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:19:54.926321 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:19:54.926321 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:19:54.926321 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:19:54.926321 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:19:54.926321 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:19:54.926321 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:19:54.926321 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:19:54.926321 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:19:54.926321 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:19:54.926321 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:19:54.926321 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:19:54.926321 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:19:54.926321 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:19:54.926321 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:19:54.926321 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:19:54.926321 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:19:54.926321 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:19:54.928442 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:19:54.928442 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:19:54.928442 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:19:54.930388 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 628/1256] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:19:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:19:54.931712 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aaefcd-05d1-4c7e-8f19-b4b1e6535e63 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:19:55.043422 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:19:55.061282 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aaefcd-05d1-4c7e-8f19-b4b1e6535e63 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:19:55.111647 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a1f2a-db9b-4edd-99ba-46e79e13849e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:19:55.113461 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a1f2a-db9b-4edd-99ba-46e79e13849e None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:55.113879 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a1f2a-db9b-4edd-99ba-46e79e13849e None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:55.114101 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a1f2a-db9b-4edd-99ba-46e79e13849e None admin] PATH_INFO: `/v3/domains` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:55.114773 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060a1f2a-db9b-4edd-99ba-46e79e13849e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:19:55.117200 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060a1f2a-db9b-4edd-99ba-46e79e13849e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:19:55.118628 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060a1f2a-db9b-4edd-99ba-46e79e13849e None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:19:55.134825 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 629/1257] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 12:19:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:19:55.140708 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d299ea-5b9c-4283-a6a4-c86458d5c193 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:19:55.280789 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d299ea-5b9c-4283-a6a4-c86458d5c193 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:19:55.331040 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ed2e79-786b-44eb-b737-5f99782101c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:19:55.331692 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ed2e79-786b-44eb-b737-5f99782101c8 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:55.331973 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ed2e79-786b-44eb-b737-5f99782101c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:55.332248 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ed2e79-786b-44eb-b737-5f99782101c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:55.342084 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ed2e79-786b-44eb-b737-5f99782101c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:19:55.343597 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ed2e79-786b-44eb-b737-5f99782101c8 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:19:55.358987 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-b1ed2e79-786b-44eb-b737-5f99782101c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:19:55.358987 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:19:55.358987 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:19:55.358987 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:19:55.358987 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:19:55.358987 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:19:55.358987 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:19:55.358987 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:19:55.358987 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:19:55.358987 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:19:55.358987 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:19:55.358987 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:19:55.358987 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:19:55.358987 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:19:55.358987 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:19:55.360573 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:19:55.360573 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:19:55.360573 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:19:55.360573 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:19:55.360573 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:19:55.360573 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:19:55.360573 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:19:55.360573 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:19:55.360573 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:19:55.360573 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:19:55.360573 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:19:55.360573 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:19:55.360573 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:19:55.360573 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:19:55.360573 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:19:55.360573 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:19:55.360573 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:19:55.362258 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:19:55.362258 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:19:55.362258 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:19:55.362258 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:19:55.362258 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:19:55.362258 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:19:55.362258 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:19:55.362258 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:19:55.362258 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 629/1258] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 12:19:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:19:55.368557 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a1f2a-db9b-4edd-99ba-46e79e13849e None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:19:55.526699 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a1f2a-db9b-4edd-99ba-46e79e13849e None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:19:55.579761 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f287e5-724d-4d72-a581-a2fafe789482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:19:55.580621 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f287e5-724d-4d72-a581-a2fafe789482 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:55.581028 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f287e5-724d-4d72-a581-a2fafe789482 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:55.581406 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f287e5-724d-4d72-a581-a2fafe789482 None admin] PATH_INFO: `/v3/projects` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:55.582443 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f287e5-724d-4d72-a581-a2fafe789482 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:19:55.583283 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f287e5-724d-4d72-a581-a2fafe789482 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:19:55.585435 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f287e5-724d-4d72-a581-a2fafe789482 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:19:55.615003 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 630/1259] 10.222.0.79 () {56 vars in 1148 bytes} [Wed Aug 31 12:19:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:19:55.617060 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ed2e79-786b-44eb-b737-5f99782101c8 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:19:55.647822 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:19:55.775461 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ed2e79-786b-44eb-b737-5f99782101c8 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:19:55.834987 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6441b097-18ea-4046-af06-efe3fa592ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:19:55.835645 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6441b097-18ea-4046-af06-efe3fa592ce8 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:55.835928 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6441b097-18ea-4046-af06-efe3fa592ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:55.836199 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6441b097-18ea-4046-af06-efe3fa592ce8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:55.837367 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6441b097-18ea-4046-af06-efe3fa592ce8 None admin] RBAC: Adding query filter params (role.id=a332ef951db949b0bad7019fbd28a1b9, scope.project.id=a94f4957f2a047cc844342e1c7c74ca5, user.id=b6deab40ae6244d4b9affa47b274aea3) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:19:55.837909 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6441b097-18ea-4046-af06-efe3fa592ce8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:19:55.840395 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6441b097-18ea-4046-af06-efe3fa592ce8 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:19:55.848699 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 630/1260] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 12:19:55 2022] GET /identity/v3/role_assignments?user.id=b6deab40ae6244d4b9affa47b274aea3&scope.project.id=a94f4957f2a047cc844342e1c7c74ca5&role.id=a332ef951db949b0bad7019fbd28a1b9 => generated 259 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:19:57.968498 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded475d-fc71-4943-a557-3e6ef6772bde None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:57.969045 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded475d-fc71-4943-a557-3e6ef6772bde None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:57.969045 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded475d-fc71-4943-a557-3e6ef6772bde None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:57.971296 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 631/1261] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:19:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:19:57.976603 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f32cab-60c6-4884-9c7b-c89f27aabead None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:57.977050 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f32cab-60c6-4884-9c7b-c89f27aabead None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:57.977139 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f32cab-60c6-4884-9c7b-c89f27aabead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:57.995258 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-b2f32cab-60c6-4884-9c7b-c89f27aabead None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:19:57.996474 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-b2f32cab-60c6-4884-9c7b-c89f27aabead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:19:58.063094 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 631/1262] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:19:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:19:58.332159 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ded475d-fc71-4943-a557-3e6ef6772bde None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:19:58.343889 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:19:58.452191 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ded475d-fc71-4943-a557-3e6ef6772bde None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:19:58.494628 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b931feb-cc8c-48e7-aef4-80d54dd23c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:19:58.495482 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b931feb-cc8c-48e7-aef4-80d54dd23c10 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:58.495826 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b931feb-cc8c-48e7-aef4-80d54dd23c10 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:58.496193 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b931feb-cc8c-48e7-aef4-80d54dd23c10 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:58.508505 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b931feb-cc8c-48e7-aef4-80d54dd23c10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:19:58.513372 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-4b931feb-cc8c-48e7-aef4-80d54dd23c10 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:19:58.513372 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:19:58.513372 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:19:58.513372 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:19:58.513372 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:19:58.513372 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:19:58.513372 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:19:58.513372 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:19:58.513372 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:19:58.513372 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:19:58.513372 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:19:58.513372 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:19:58.513372 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:19:58.513372 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:19:58.513372 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:19:58.513372 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:19:58.514904 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:19:58.514904 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:19:58.514904 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:19:58.514904 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:19:58.514904 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:19:58.514904 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:19:58.514904 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:19:58.514904 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:19:58.514904 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:19:58.514904 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:19:58.514904 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:19:58.514904 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:19:58.514904 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:19:58.514904 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:19:58.514904 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:19:58.514904 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:19:58.516323 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:19:58.516323 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:19:58.516323 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:19:58.516323 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:19:58.516323 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:19:58.516323 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:19:58.516323 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:19:58.516323 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:19:58.516323 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:19:58.516323 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:19:58.516323 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:19:58.516323 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:19:58.516323 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 632/1263] 10.222.0.79 () {56 vars in 1096 bytes} [Wed Aug 31 12:19:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:19:58.521262 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f32cab-60c6-4884-9c7b-c89f27aabead None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:19:58.539951 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:19:58.624506 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f32cab-60c6-4884-9c7b-c89f27aabead None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:19:58.657843 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149ca45e-27fd-4753-8601-27e21d0b9ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:19:58.658444 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ca45e-27fd-4753-8601-27e21d0b9ae6 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:58.658715 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ca45e-27fd-4753-8601-27e21d0b9ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:58.659009 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ca45e-27fd-4753-8601-27e21d0b9ae6 None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:58.659667 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149ca45e-27fd-4753-8601-27e21d0b9ae6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:19:58.659964 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149ca45e-27fd-4753-8601-27e21d0b9ae6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:19:58.661844 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149ca45e-27fd-4753-8601-27e21d0b9ae6 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:19:58.669793 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 632/1264] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 12:19:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:19:58.675728 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b931feb-cc8c-48e7-aef4-80d54dd23c10 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:19:58.751181 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:19:58.785771 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b931feb-cc8c-48e7-aef4-80d54dd23c10 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:19:58.822038 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a1b6d0-133f-49a3-abbd-4191d8177383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:19:58.822672 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a1b6d0-133f-49a3-abbd-4191d8177383 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:58.822986 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a1b6d0-133f-49a3-abbd-4191d8177383 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:58.823261 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a1b6d0-133f-49a3-abbd-4191d8177383 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:58.834290 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a1b6d0-133f-49a3-abbd-4191d8177383 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:19:58.836156 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a1b6d0-133f-49a3-abbd-4191d8177383 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:19:58.855001 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-61a1b6d0-133f-49a3-abbd-4191d8177383 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:19:58.855001 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:19:58.855001 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:19:58.855001 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:19:58.855001 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:19:58.855001 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:19:58.855001 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:19:58.855001 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:19:58.855001 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:19:58.855001 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:19:58.855001 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:19:58.855001 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:19:58.855001 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:19:58.855001 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:19:58.855001 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:19:58.855001 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:19:58.856260 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:19:58.856260 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:19:58.856260 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:19:58.856260 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:19:58.856260 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:19:58.856260 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:19:58.856260 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:19:58.856260 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:19:58.856260 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:19:58.856260 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:19:58.856260 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:19:58.856260 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:19:58.856260 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:19:58.856260 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:19:58.856260 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:19:58.856260 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:19:58.856260 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:19:58.857358 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:19:58.857358 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:19:58.857358 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:19:58.857358 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 633/1265] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:19:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:19:58.862745 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149ca45e-27fd-4753-8601-27e21d0b9ae6 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:19:58.942518 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:19:58.961564 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149ca45e-27fd-4753-8601-27e21d0b9ae6 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:19:58.994734 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f782bbb5-a7b5-46ef-9fc2-2072abc3b84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:19:58.995398 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782bbb5-a7b5-46ef-9fc2-2072abc3b84c None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:58.995621 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782bbb5-a7b5-46ef-9fc2-2072abc3b84c None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:58.995887 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782bbb5-a7b5-46ef-9fc2-2072abc3b84c None admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:58.996520 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f782bbb5-a7b5-46ef-9fc2-2072abc3b84c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:19:58.996815 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f782bbb5-a7b5-46ef-9fc2-2072abc3b84c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:19:58.998175 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f782bbb5-a7b5-46ef-9fc2-2072abc3b84c None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:19:59.009973 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 633/1266] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 12:19:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:19:59.015820 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a1b6d0-133f-49a3-abbd-4191d8177383 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:19:59.116705 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a1b6d0-133f-49a3-abbd-4191d8177383 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:19:59.136317 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:19:59.151017 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9608ddba-4ea2-4f0f-a6c5-7d785e5bfb05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:19:59.151648 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608ddba-4ea2-4f0f-a6c5-7d785e5bfb05 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:59.151925 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608ddba-4ea2-4f0f-a6c5-7d785e5bfb05 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:59.152193 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608ddba-4ea2-4f0f-a6c5-7d785e5bfb05 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:59.159842 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9608ddba-4ea2-4f0f-a6c5-7d785e5bfb05 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:19:59.161853 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9608ddba-4ea2-4f0f-a6c5-7d785e5bfb05 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:19:59.172995 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-9608ddba-4ea2-4f0f-a6c5-7d785e5bfb05 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 12:19:59.172995 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:19:59.172995 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:19:59.172995 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:19:59.172995 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:19:59.172995 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:19:59.172995 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:19:59.172995 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:19:59.172995 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:19:59.172995 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:19:59.172995 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:19:59.172995 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:19:59.172995 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:19:59.172995 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:19:59.172995 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:19:59.172995 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:19:59.174139 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:19:59.174139 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:19:59.174139 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:19:59.174139 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:19:59.174139 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:19:59.174139 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:19:59.174139 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:19:59.174139 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:19:59.174139 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:19:59.174139 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:19:59.174139 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:19:59.174139 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:19:59.174139 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:19:59.174139 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:19:59.174139 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:19:59.174139 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:19:59.174139 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:19:59.174139 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:19:59.175494 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:19:59.175494 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:19:59.175494 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:19:59.175494 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:19:59.175494 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:19:59.175494 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:19:59.175494 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:19:59.175494 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:19:59.175494 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 12:19:59.175494 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:19:59.179045 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 634/1267] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:19:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:19:59.180451 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f782bbb5-a7b5-46ef-9fc2-2072abc3b84c None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:19:59.279786 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f782bbb5-a7b5-46ef-9fc2-2072abc3b84c None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:19:59.314682 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a8e455-efa7-4ac4-9a2d-c52998d4fb39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:19:59.315327 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a8e455-efa7-4ac4-9a2d-c52998d4fb39 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:59.315607 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a8e455-efa7-4ac4-9a2d-c52998d4fb39 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:59.315882 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a8e455-efa7-4ac4-9a2d-c52998d4fb39 None admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:59.316609 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a8e455-efa7-4ac4-9a2d-c52998d4fb39 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:19:59.316914 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a8e455-efa7-4ac4-9a2d-c52998d4fb39 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:19:59.319062 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a8e455-efa7-4ac4-9a2d-c52998d4fb39 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:19:59.328252 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:19:59.338786 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 634/1268] 10.222.0.79 () {56 vars in 1143 bytes} [Wed Aug 31 12:19:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:19:59.344760 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9608ddba-4ea2-4f0f-a6c5-7d785e5bfb05 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:19:59.444232 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9608ddba-4ea2-4f0f-a6c5-7d785e5bfb05 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:19:59.479053 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d5fdbb-ecde-4e88-8ffc-01aa6d3002f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:19:59.479692 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d5fdbb-ecde-4e88-8ffc-01aa6d3002f6 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:59.479970 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d5fdbb-ecde-4e88-8ffc-01aa6d3002f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:59.480239 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d5fdbb-ecde-4e88-8ffc-01aa6d3002f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:59.491406 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d5fdbb-ecde-4e88-8ffc-01aa6d3002f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:19:59.492870 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d5fdbb-ecde-4e88-8ffc-01aa6d3002f6 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:19:59.506935 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-80d5fdbb-ecde-4e88-8ffc-01aa6d3002f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:19:59.506935 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:19:59.506935 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:19:59.506935 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:19:59.506935 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:19:59.506935 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:19:59.506935 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:19:59.506935 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:19:59.506935 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:19:59.506935 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:19:59.506935 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:19:59.506935 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:19:59.506935 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:19:59.506935 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:19:59.506935 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:19:59.506935 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:19:59.508069 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:19:59.508069 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:19:59.508069 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:19:59.508069 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:19:59.508069 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:19:59.508069 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:19:59.508069 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:19:59.508069 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:19:59.508069 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:19:59.508069 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:19:59.508069 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:19:59.508069 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:19:59.508069 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:19:59.508069 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:19:59.508069 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:19:59.508069 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:19:59.508069 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:19:59.509353 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:19:59.509353 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:19:59.509353 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:19:59.509353 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 635/1269] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:19:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:19:59.513953 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a8e455-efa7-4ac4-9a2d-c52998d4fb39 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:19:59.612798 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a8e455-efa7-4ac4-9a2d-c52998d4fb39 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:19:59.646776 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94368e3e-cb01-45c9-889d-8f4e0381cd46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:19:59.647422 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94368e3e-cb01-45c9-889d-8f4e0381cd46 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:59.647698 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94368e3e-cb01-45c9-889d-8f4e0381cd46 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:59.647968 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94368e3e-cb01-45c9-889d-8f4e0381cd46 None admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:59.648604 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94368e3e-cb01-45c9-889d-8f4e0381cd46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:19:59.648902 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94368e3e-cb01-45c9-889d-8f4e0381cd46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:19:59.650264 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94368e3e-cb01-45c9-889d-8f4e0381cd46 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:19:59.662196 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 635/1270] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 12:19:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:19:59.667872 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d5fdbb-ecde-4e88-8ffc-01aa6d3002f6 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:19:59.700505 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:19:59.820874 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d5fdbb-ecde-4e88-8ffc-01aa6d3002f6 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:19:59.872664 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443274a7-ef65-4d4e-b2e0-6d42e7d4bddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:19:59.873274 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443274a7-ef65-4d4e-b2e0-6d42e7d4bddc None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:59.873544 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443274a7-ef65-4d4e-b2e0-6d42e7d4bddc None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:59.873859 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443274a7-ef65-4d4e-b2e0-6d42e7d4bddc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:59.882308 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443274a7-ef65-4d4e-b2e0-6d42e7d4bddc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:19:59.883885 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443274a7-ef65-4d4e-b2e0-6d42e7d4bddc None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:19:59.896857 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-443274a7-ef65-4d4e-b2e0-6d42e7d4bddc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:19:59.896857 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:19:59.896857 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:19:59.896857 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:19:59.896857 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:19:59.896857 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:19:59.896857 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:19:59.896857 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:19:59.896857 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:19:59.896857 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:19:59.896857 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:19:59.896857 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:19:59.896857 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:19:59.896857 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:19:59.896857 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:19:59.898006 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:19:59.898006 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:19:59.898006 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:19:59.898006 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:19:59.898006 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:19:59.898006 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:19:59.898006 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:19:59.898006 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:19:59.898006 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:19:59.898006 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:19:59.898006 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:19:59.898006 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:19:59.898006 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:19:59.898006 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:19:59.898006 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:19:59.898006 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:19:59.898006 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:19:59.903971 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:19:59.903971 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:19:59.903971 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:19:59.903971 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:19:59.903971 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:19:59.903971 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:19:59.903971 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:19:59.903971 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:19:59.903971 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 636/1271] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 12:19:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:19:59.904634 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94368e3e-cb01-45c9-889d-8f4e0381cd46 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:19:59.968796 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:20:00.023966 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94368e3e-cb01-45c9-889d-8f4e0381cd46 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:20:00.058543 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4e32df-b663-4170-84ce-dd3cf002d9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:20:00.059221 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4e32df-b663-4170-84ce-dd3cf002d9e0 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:00.059445 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4e32df-b663-4170-84ce-dd3cf002d9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:00.059709 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4e32df-b663-4170-84ce-dd3cf002d9e0 None admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:00.060389 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4e32df-b663-4170-84ce-dd3cf002d9e0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:20:00.060688 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4e32df-b663-4170-84ce-dd3cf002d9e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:20:00.062115 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4e32df-b663-4170-84ce-dd3cf002d9e0 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:20:00.083027 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 636/1272] 10.222.0.79 () {56 vars in 1148 bytes} [Wed Aug 31 12:19:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:20:00.089073 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443274a7-ef65-4d4e-b2e0-6d42e7d4bddc None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:20:00.182564 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:20:00.193890 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443274a7-ef65-4d4e-b2e0-6d42e7d4bddc None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:20:00.237244 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810fbdc6-dae4-4f55-ad76-1dc4ed6fbb1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:20:00.238134 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810fbdc6-dae4-4f55-ad76-1dc4ed6fbb1f None admin] REQUEST_METHOD: `PUT` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:00.238457 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810fbdc6-dae4-4f55-ad76-1dc4ed6fbb1f None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:00.238883 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810fbdc6-dae4-4f55-ad76-1dc4ed6fbb1f None admin] PATH_INFO: `/v3/projects/a94f4957f2a047cc844342e1c7c74ca5/users/b6deab40ae6244d4b9affa47b274aea3/roles/a332ef951db949b0bad7019fbd28a1b9` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:00.241373 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810fbdc6-dae4-4f55-ad76-1dc4ed6fbb1f None admin] RBAC: Authorizing `identity:create_grant(project_id=a94f4957f2a047cc844342e1c7c74ca5, user_id=b6deab40ae6244d4b9affa47b274aea3, role_id=a332ef951db949b0bad7019fbd28a1b9)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:20:00.242841 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810fbdc6-dae4-4f55-ad76-1dc4ed6fbb1f None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:20:00.256299 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 637/1273] 10.222.0.79 () {58 vars in 1439 bytes} [Wed Aug 31 12:20:00 2022] PUT /identity/v3/projects/a94f4957f2a047cc844342e1c7c74ca5/users/b6deab40ae6244d4b9affa47b274aea3/roles/a332ef951db949b0bad7019fbd28a1b9 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:20:02.232993 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60631fc7-cb2a-4bd4-b98b-4dbb94da1b97 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:02.233553 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60631fc7-cb2a-4bd4-b98b-4dbb94da1b97 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:02.233553 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60631fc7-cb2a-4bd4-b98b-4dbb94da1b97 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:02.234926 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 637/1274] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:20:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:20:02.240461 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3998eb4-0e65-4c91-915d-586be32b26b2 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:02.240923 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3998eb4-0e65-4c91-915d-586be32b26b2 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:02.241015 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3998eb4-0e65-4c91-915d-586be32b26b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:02.259748 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-d3998eb4-0e65-4c91-915d-586be32b26b2 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:20:02.260965 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-d3998eb4-0e65-4c91-915d-586be32b26b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:20:02.327339 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 638/1275] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:20:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 12:20:02.604101 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60631fc7-cb2a-4bd4-b98b-4dbb94da1b97 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:20:02.712669 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60631fc7-cb2a-4bd4-b98b-4dbb94da1b97 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:20:02.739993 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:20:02.760398 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99b3e32-2295-47a0-9b56-f574fe52c695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:20:02.761143 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99b3e32-2295-47a0-9b56-f574fe52c695 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:02.761412 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99b3e32-2295-47a0-9b56-f574fe52c695 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:02.761741 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99b3e32-2295-47a0-9b56-f574fe52c695 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:02.775486 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99b3e32-2295-47a0-9b56-f574fe52c695 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:20:02.780588 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-d99b3e32-2295-47a0-9b56-f574fe52c695 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:20:02.780588 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:20:02.780588 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:20:02.780588 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:20:02.780588 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:20:02.780588 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:20:02.780588 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:20:02.780588 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:20:02.780588 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:20:02.780588 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:20:02.780588 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:20:02.780588 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:20:02.780588 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:20:02.780588 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:20:02.780588 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:20:02.780588 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:20:02.781764 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:20:02.781764 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:20:02.781764 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:20:02.781764 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:20:02.781764 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:20:02.781764 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:20:02.781764 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:20:02.781764 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:20:02.781764 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:20:02.781764 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:20:02.781764 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:20:02.781764 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:20:02.781764 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:20:02.781764 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:20:02.781764 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:20:02.781764 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:20:02.782996 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:20:02.782996 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:20:02.782996 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:20:02.782996 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:20:02.782996 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:20:02.782996 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:20:02.782996 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:20:02.782996 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:20:02.782996 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:20:02.782996 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:20:02.782996 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:20:02.782996 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:20:02.782996 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 638/1276] 10.222.0.79 () {56 vars in 1096 bytes} [Wed Aug 31 12:20:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:20:02.790495 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3998eb4-0e65-4c91-915d-586be32b26b2 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:20:02.889470 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:20:02.907888 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3998eb4-0e65-4c91-915d-586be32b26b2 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:20:02.941620 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05a8758-2ef4-408f-8968-255218913496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:20:02.942246 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a8758-2ef4-408f-8968-255218913496 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:02.943234 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a8758-2ef4-408f-8968-255218913496 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:02.943679 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a8758-2ef4-408f-8968-255218913496 None admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:02.944404 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05a8758-2ef4-408f-8968-255218913496 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:20:02.944708 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05a8758-2ef4-408f-8968-255218913496 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:20:02.946083 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05a8758-2ef4-408f-8968-255218913496 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:20:02.954253 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 639/1277] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 12:20:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:20:02.960601 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99b3e32-2295-47a0-9b56-f574fe52c695 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:20:03.064893 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99b3e32-2295-47a0-9b56-f574fe52c695 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:20:03.100225 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0082e0f7-fdac-4456-b4b6-c5fdb36860b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:20:03.100857 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0082e0f7-fdac-4456-b4b6-c5fdb36860b4 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:03.101161 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0082e0f7-fdac-4456-b4b6-c5fdb36860b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:03.101433 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0082e0f7-fdac-4456-b4b6-c5fdb36860b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:03.111729 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0082e0f7-fdac-4456-b4b6-c5fdb36860b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:20:03.113180 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0082e0f7-fdac-4456-b4b6-c5fdb36860b4 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:20:03.128887 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-0082e0f7-fdac-4456-b4b6-c5fdb36860b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:20:03.128887 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:20:03.128887 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:20:03.128887 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:20:03.128887 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:20:03.128887 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:20:03.128887 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:20:03.128887 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:20:03.128887 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:20:03.128887 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:20:03.128887 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:20:03.128887 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:20:03.128887 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:20:03.128887 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:20:03.128887 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:20:03.128887 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:20:03.130104 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:20:03.130104 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:20:03.130104 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:20:03.130104 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:20:03.130104 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:20:03.130104 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:20:03.130104 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:20:03.130104 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:20:03.130104 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:20:03.130104 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:20:03.130104 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:20:03.130104 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:20:03.130104 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:20:03.130104 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:20:03.130104 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:20:03.130104 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:20:03.130104 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:20:03.131242 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:20:03.131242 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:20:03.131242 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:20:03.131242 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 639/1278] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:20:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:20:03.136965 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05a8758-2ef4-408f-8968-255218913496 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:20:03.268732 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05a8758-2ef4-408f-8968-255218913496 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:20:03.313257 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dd7adf-01c7-4ee8-ac7d-a664d4724afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:20:03.313869 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dd7adf-01c7-4ee8-ac7d-a664d4724afa None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:03.314147 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dd7adf-01c7-4ee8-ac7d-a664d4724afa None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:03.314419 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dd7adf-01c7-4ee8-ac7d-a664d4724afa None admin] PATH_INFO: `/v3/domains` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:03.315083 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dd7adf-01c7-4ee8-ac7d-a664d4724afa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:20:03.315386 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dd7adf-01c7-4ee8-ac7d-a664d4724afa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:20:03.316851 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dd7adf-01c7-4ee8-ac7d-a664d4724afa None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:20:03.333566 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 640/1279] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 12:20:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:20:03.341159 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0082e0f7-fdac-4456-b4b6-c5fdb36860b4 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:20:03.372830 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:20:03.442744 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0082e0f7-fdac-4456-b4b6-c5fdb36860b4 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:20:03.477217 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8710f2-f029-4109-9b02-949e5c9ba6cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:20:03.477840 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8710f2-f029-4109-9b02-949e5c9ba6cd None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:03.478112 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8710f2-f029-4109-9b02-949e5c9ba6cd None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:03.478376 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8710f2-f029-4109-9b02-949e5c9ba6cd None admin] PATH_INFO: `/v3/users/placement` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:03.485993 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8710f2-f029-4109-9b02-949e5c9ba6cd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:20:03.487466 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8710f2-f029-4109-9b02-949e5c9ba6cd None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:20:03.499245 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-9b8710f2-f029-4109-9b02-949e5c9ba6cd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 12:20:03.499245 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:20:03.499245 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:20:03.499245 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:20:03.499245 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:20:03.499245 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:20:03.499245 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:20:03.499245 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:20:03.499245 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:20:03.499245 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:20:03.499245 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:20:03.499245 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:20:03.499245 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:20:03.499245 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:20:03.499245 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:20:03.499245 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:20:03.500434 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:20:03.500434 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:20:03.500434 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:20:03.500434 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:20:03.500434 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:20:03.500434 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:20:03.500434 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:20:03.500434 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:20:03.500434 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:20:03.500434 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:20:03.500434 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:20:03.500434 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:20:03.500434 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:20:03.500434 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:20:03.500434 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:20:03.500434 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:20:03.500434 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:20:03.500434 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:20:03.501429 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:20:03.501429 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:20:03.501429 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:20:03.501429 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:20:03.501429 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:20:03.501429 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:20:03.501429 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:20:03.501429 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:20:03.501429 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 12:20:03.501429 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:20:03.501429 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 640/1280] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:20:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:20:03.507071 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dd7adf-01c7-4ee8-ac7d-a664d4724afa None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:20:03.512418 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:20:03.621023 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dd7adf-01c7-4ee8-ac7d-a664d4724afa None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:20:03.655996 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853b2ba2-07d1-4fcb-a524-4fbbd6eef09c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:20:03.656615 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b2ba2-07d1-4fcb-a524-4fbbd6eef09c None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:03.656892 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b2ba2-07d1-4fcb-a524-4fbbd6eef09c None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:03.657161 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b2ba2-07d1-4fcb-a524-4fbbd6eef09c None admin] PATH_INFO: `/v3/users` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:03.657885 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853b2ba2-07d1-4fcb-a524-4fbbd6eef09c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:20:03.658192 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853b2ba2-07d1-4fcb-a524-4fbbd6eef09c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:20:03.659677 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853b2ba2-07d1-4fcb-a524-4fbbd6eef09c None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:20:03.677078 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 641/1281] 10.222.0.79 () {56 vars in 1143 bytes} [Wed Aug 31 12:20:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:20:03.683135 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8710f2-f029-4109-9b02-949e5c9ba6cd None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:20:03.780533 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:20:03.792446 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8710f2-f029-4109-9b02-949e5c9ba6cd None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:20:03.826760 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791276d5-67b0-431b-9ec4-69dcbc155c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:20:03.827397 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791276d5-67b0-431b-9ec4-69dcbc155c61 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:03.827677 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791276d5-67b0-431b-9ec4-69dcbc155c61 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:03.827950 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791276d5-67b0-431b-9ec4-69dcbc155c61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:03.896195 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791276d5-67b0-431b-9ec4-69dcbc155c61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:20:03.897672 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791276d5-67b0-431b-9ec4-69dcbc155c61 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:20:03.983308 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:20:03.993648 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 641/1282] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 12:20:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 12:20:03.999543 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853b2ba2-07d1-4fcb-a524-4fbbd6eef09c None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:20:04.071595 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:20:04.119156 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853b2ba2-07d1-4fcb-a524-4fbbd6eef09c None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:20:04.159484 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3333e5-7847-49b0-9e36-19a33cd32d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:20:04.160379 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3333e5-7847-49b0-9e36-19a33cd32d1e None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:04.160906 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3333e5-7847-49b0-9e36-19a33cd32d1e None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:04.162261 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3333e5-7847-49b0-9e36-19a33cd32d1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:04.173922 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3333e5-7847-49b0-9e36-19a33cd32d1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:20:04.175399 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3333e5-7847-49b0-9e36-19a33cd32d1e None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:20:04.194385 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-1d3333e5-7847-49b0-9e36-19a33cd32d1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:20:04.194385 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:20:04.194385 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:20:04.194385 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:20:04.194385 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:20:04.194385 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:20:04.194385 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:20:04.194385 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:20:04.194385 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:20:04.194385 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:20:04.194385 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:20:04.194385 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:20:04.194385 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:20:04.194385 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:20:04.194385 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:20:04.194385 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:20:04.195632 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:20:04.195632 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:20:04.195632 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:20:04.195632 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:20:04.195632 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:20:04.195632 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:20:04.195632 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:20:04.195632 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:20:04.195632 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:20:04.195632 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:20:04.195632 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:20:04.195632 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:20:04.195632 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:20:04.195632 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:20:04.195632 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:20:04.195632 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:20:04.195632 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:20:04.196700 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:20:04.196700 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:20:04.196700 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:20:04.196700 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 642/1283] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:20:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:20:04.201911 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791276d5-67b0-431b-9ec4-69dcbc155c61 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:20:04.300209 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791276d5-67b0-431b-9ec4-69dcbc155c61 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:20:04.332577 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e81f39f-f380-4c97-a686-342c677b1dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:20:04.333743 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e81f39f-f380-4c97-a686-342c677b1dc8 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:04.334024 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e81f39f-f380-4c97-a686-342c677b1dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:04.334269 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e81f39f-f380-4c97-a686-342c677b1dc8 None admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:04.334921 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e81f39f-f380-4c97-a686-342c677b1dc8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:20:04.335219 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e81f39f-f380-4c97-a686-342c677b1dc8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:20:04.336568 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e81f39f-f380-4c97-a686-342c677b1dc8 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:20:04.347747 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 642/1284] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 12:20:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:20:04.353828 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3333e5-7847-49b0-9e36-19a33cd32d1e None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:20:04.451520 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3333e5-7847-49b0-9e36-19a33cd32d1e None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:20:04.465479 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:20:04.485251 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aadd9c6-baa6-4a50-8b69-9aede6769dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:20:04.485861 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aadd9c6-baa6-4a50-8b69-9aede6769dec None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:04.486136 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aadd9c6-baa6-4a50-8b69-9aede6769dec None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:04.486403 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aadd9c6-baa6-4a50-8b69-9aede6769dec None admin] PATH_INFO: `/v3/projects/service` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:04.493510 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aadd9c6-baa6-4a50-8b69-9aede6769dec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:20:04.494965 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aadd9c6-baa6-4a50-8b69-9aede6769dec None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:20:04.506368 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application [None req-8aadd9c6-baa6-4a50-8b69-9aede6769dec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:20:04.506368 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:20:04.506368 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:20:04.506368 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:20:04.506368 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:20:04.506368 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:20:04.506368 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:20:04.506368 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:20:04.506368 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:20:04.506368 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:20:04.506368 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:20:04.506368 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:20:04.506368 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:20:04.506368 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:20:04.506368 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:20:04.511809 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:20:04.511809 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:20:04.511809 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:20:04.511809 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:20:04.511809 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:20:04.511809 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:20:04.511809 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:20:04.511809 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:20:04.511809 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application with Lock( Aug 31 12:20:04.511809 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:20:04.511809 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:20:04.511809 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:20:04.511809 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:20:04.511809 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:20:04.511809 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:20:04.511809 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:20:04.511809 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:20:04.513275 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:20:04.513275 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:20:04.513275 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:20:04.513275 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:20:04.513275 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:20:04.513275 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:20:04.513275 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:20:04.513275 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: ERROR keystone.server.flask.application Aug 31 12:20:04.513275 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 643/1285] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 12:20:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:20:04.513903 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e81f39f-f380-4c97-a686-342c677b1dc8 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:20:04.563788 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:20:04.613151 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e81f39f-f380-4c97-a686-342c677b1dc8 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:20:04.647816 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f342379-9916-4a37-bbd5-05ef304abf3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:20:04.648582 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f342379-9916-4a37-bbd5-05ef304abf3b None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:04.648871 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f342379-9916-4a37-bbd5-05ef304abf3b None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:04.649157 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f342379-9916-4a37-bbd5-05ef304abf3b None admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:04.650176 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f342379-9916-4a37-bbd5-05ef304abf3b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:20:04.650494 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f342379-9916-4a37-bbd5-05ef304abf3b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:20:04.652269 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f342379-9916-4a37-bbd5-05ef304abf3b None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:20:04.667275 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 643/1286] 10.222.0.79 () {56 vars in 1148 bytes} [Wed Aug 31 12:20:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:20:04.673408 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aadd9c6-baa6-4a50-8b69-9aede6769dec None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:20:04.780627 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aadd9c6-baa6-4a50-8b69-9aede6769dec None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:20:04.815963 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1571d996-8a8d-48f1-9b73-a5ca1580abcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:20:04.816576 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1571d996-8a8d-48f1-9b73-a5ca1580abcb None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:04.816860 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1571d996-8a8d-48f1-9b73-a5ca1580abcb None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:04.817136 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1571d996-8a8d-48f1-9b73-a5ca1580abcb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:04.819353 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1571d996-8a8d-48f1-9b73-a5ca1580abcb None admin] RBAC: Adding query filter params (role.id=a332ef951db949b0bad7019fbd28a1b9, scope.project.id=a94f4957f2a047cc844342e1c7c74ca5, user.id=b6deab40ae6244d4b9affa47b274aea3) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:20:04.819669 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1571d996-8a8d-48f1-9b73-a5ca1580abcb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:20:04.821137 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1571d996-8a8d-48f1-9b73-a5ca1580abcb None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:20:04.827405 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 644/1287] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 12:20:04 2022] GET /identity/v3/role_assignments?user.id=b6deab40ae6244d4b9affa47b274aea3&scope.project.id=a94f4957f2a047cc844342e1c7c74ca5&role.id=a332ef951db949b0bad7019fbd28a1b9 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:20:06.769428 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb0b67a-ee39-4de8-913a-9cf5a1ffd232 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:06.769967 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb0b67a-ee39-4de8-913a-9cf5a1ffd232 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:06.769967 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb0b67a-ee39-4de8-913a-9cf5a1ffd232 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:06.772131 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 644/1288] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:20:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:20:06.777385 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2038c1da-a871-4298-a10d-ec903ba2f5d1 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:06.777841 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2038c1da-a871-4298-a10d-ec903ba2f5d1 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:06.777938 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2038c1da-a871-4298-a10d-ec903ba2f5d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:06.797499 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-2038c1da-a871-4298-a10d-ec903ba2f5d1 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:20:06.798685 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-2038c1da-a871-4298-a10d-ec903ba2f5d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:20:06.827710 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:20:06.866069 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 645/1289] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:20:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:20:07.130465 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb0b67a-ee39-4de8-913a-9cf5a1ffd232 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:20:07.244100 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb0b67a-ee39-4de8-913a-9cf5a1ffd232 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:20:07.255350 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:20:07.278829 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2006a28d-702f-4e1e-829c-89f2d9b3cfc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:20:07.279482 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2006a28d-702f-4e1e-829c-89f2d9b3cfc7 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:07.279756 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2006a28d-702f-4e1e-829c-89f2d9b3cfc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:07.280019 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2006a28d-702f-4e1e-829c-89f2d9b3cfc7 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:07.280593 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2006a28d-702f-4e1e-829c-89f2d9b3cfc7 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:20:07.281940 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2006a28d-702f-4e1e-829c-89f2d9b3cfc7 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:20:07.290752 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-2006a28d-702f-4e1e-829c-89f2d9b3cfc7 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 12:20:07.290752 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:20:07.290752 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 12:20:07.290752 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 12:20:07.290752 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 12:20:07.290752 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 12:20:07.290752 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 12:20:07.290752 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:20:07.290752 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 12:20:07.290752 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:20:07.290752 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:20:07.290752 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:20:07.290752 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:20:07.290752 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:20:07.290752 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:20:07.290752 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:20:07.290752 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:20:07.292134 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:20:07.292134 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:20:07.292134 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:20:07.292134 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:20:07.292134 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:20:07.292134 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:20:07.292134 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 12:20:07.292134 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 12:20:07.292134 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 12:20:07.292134 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 12:20:07.292134 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:20:07.292134 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:20:07.292134 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:20:07.292134 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:20:07.292134 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:20:07.292134 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:20:07.293319 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:20:07.293319 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:20:07.293319 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:20:07.293319 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:20:07.293319 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:20:07.293319 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:20:07.293319 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:20:07.293319 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:20:07.293319 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:20:07.293319 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:20:07.293319 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 12:20:07.293319 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:20:07.293319 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 12:20:07.293319 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:20:07.293319 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 645/1290] 10.222.0.79 () {56 vars in 1117 bytes} [Wed Aug 31 12:20:07 2022] GET /identity/v3/services/placement => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:20:07.297799 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2038c1da-a871-4298-a10d-ec903ba2f5d1 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:20:07.396249 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2038c1da-a871-4298-a10d-ec903ba2f5d1 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:20:07.430388 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17aed4e-6c5f-4196-939e-6be2cc91e646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:20:07.431044 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17aed4e-6c5f-4196-939e-6be2cc91e646 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:07.431328 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17aed4e-6c5f-4196-939e-6be2cc91e646 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:07.431601 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17aed4e-6c5f-4196-939e-6be2cc91e646 None admin] PATH_INFO: `/v3/services` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:07.432264 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17aed4e-6c5f-4196-939e-6be2cc91e646 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:20:07.432540 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17aed4e-6c5f-4196-939e-6be2cc91e646 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:20:07.433912 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17aed4e-6c5f-4196-939e-6be2cc91e646 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:20:07.438950 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 646/1291] 10.222.0.79 () {56 vars in 1116 bytes} [Wed Aug 31 12:20:07 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:20:07.445087 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2006a28d-702f-4e1e-829c-89f2d9b3cfc7 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:20:07.546382 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2006a28d-702f-4e1e-829c-89f2d9b3cfc7 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:20:07.584662 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aa53d9-1b5f-4042-8c5c-b78310871801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:20:07.585271 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa53d9-1b5f-4042-8c5c-b78310871801 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:07.585554 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa53d9-1b5f-4042-8c5c-b78310871801 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:07.585821 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa53d9-1b5f-4042-8c5c-b78310871801 None admin] PATH_INFO: `/v3/services` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:07.586444 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aa53d9-1b5f-4042-8c5c-b78310871801 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:20:07.586742 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aa53d9-1b5f-4042-8c5c-b78310871801 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:20:07.588133 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aa53d9-1b5f-4042-8c5c-b78310871801 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:20:07.594689 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 646/1292] 10.222.0.79 () {56 vars in 1116 bytes} [Wed Aug 31 12:20:07 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:20:09.665764 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287c5fd-8f60-41b7-a47a-1bf8f41cde01 None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:09.666304 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287c5fd-8f60-41b7-a47a-1bf8f41cde01 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:09.666304 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287c5fd-8f60-41b7-a47a-1bf8f41cde01 None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:09.668028 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 647/1293] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:20:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:20:09.673964 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb5e1c0-68c8-4445-b624-de473ceeb6b8 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:09.674422 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb5e1c0-68c8-4445-b624-de473ceeb6b8 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:09.674530 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb5e1c0-68c8-4445-b624-de473ceeb6b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:09.696890 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-fcb5e1c0-68c8-4445-b624-de473ceeb6b8 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:20:09.698014 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-fcb5e1c0-68c8-4445-b624-de473ceeb6b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:20:09.740747 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:20:09.790307 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 647/1294] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:20:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:20:10.073976 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c287c5fd-8f60-41b7-a47a-1bf8f41cde01 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:20:10.107402 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:20:10.182831 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c287c5fd-8f60-41b7-a47a-1bf8f41cde01 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:20:10.218725 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61428fa-053b-449a-8f2f-3a16947c34b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:20:10.219363 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61428fa-053b-449a-8f2f-3a16947c34b5 None admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:10.219640 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61428fa-053b-449a-8f2f-3a16947c34b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:10.219909 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61428fa-053b-449a-8f2f-3a16947c34b5 None admin] PATH_INFO: `/v3/services` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:10.220575 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61428fa-053b-449a-8f2f-3a16947c34b5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:20:10.222066 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61428fa-053b-449a-8f2f-3a16947c34b5 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:20:10.237335 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 648/1295] 10.222.0.79 () {60 vars in 1141 bytes} [Wed Aug 31 12:20:10 2022] POST /identity/v3/services => generated 246 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:20:12.204547 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63dd79c-46a2-44d3-9f55-5633abdb750b None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:12.205086 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63dd79c-46a2-44d3-9f55-5633abdb750b None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:12.205086 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63dd79c-46a2-44d3-9f55-5633abdb750b None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:12.206454 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 648/1296] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:20:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:20:12.213334 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45e4bad-50a7-499d-986f-08d9159b1fad None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:12.213805 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45e4bad-50a7-499d-986f-08d9159b1fad None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:12.213944 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45e4bad-50a7-499d-986f-08d9159b1fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:12.234028 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-a45e4bad-50a7-499d-986f-08d9159b1fad None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:20:12.235345 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-a45e4bad-50a7-499d-986f-08d9159b1fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:20:12.313831 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 649/1297] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:20:12 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:20:12.654926 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63dd79c-46a2-44d3-9f55-5633abdb750b None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:20:12.803173 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63dd79c-46a2-44d3-9f55-5633abdb750b None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:20:12.845207 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cb492b-2b59-4e7e-8580-a32db7119731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:20:12.845835 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cb492b-2b59-4e7e-8580-a32db7119731 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:12.846108 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cb492b-2b59-4e7e-8580-a32db7119731 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:12.846375 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cb492b-2b59-4e7e-8580-a32db7119731 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:12.846986 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cb492b-2b59-4e7e-8580-a32db7119731 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:20:12.848364 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cb492b-2b59-4e7e-8580-a32db7119731 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:20:12.857603 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-12cb492b-2b59-4e7e-8580-a32db7119731 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 12:20:12.857603 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:20:12.857603 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 12:20:12.857603 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 12:20:12.857603 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 12:20:12.857603 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 12:20:12.857603 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 12:20:12.857603 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:20:12.857603 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 12:20:12.857603 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:20:12.857603 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:20:12.857603 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:20:12.857603 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:20:12.857603 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:20:12.857603 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:20:12.857603 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:20:12.857603 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:20:12.859316 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:20:12.859316 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:20:12.859316 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:20:12.859316 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:20:12.859316 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:20:12.859316 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:20:12.859316 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 12:20:12.859316 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 12:20:12.859316 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 12:20:12.859316 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 12:20:12.859316 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:20:12.859316 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:20:12.859316 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:20:12.859316 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:20:12.859316 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:20:12.859316 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:20:12.860408 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:20:12.860408 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:20:12.860408 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:20:12.860408 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:20:12.860408 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:20:12.860408 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:20:12.860408 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:20:12.860408 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:20:12.860408 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:20:12.860408 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:20:12.860408 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 12:20:12.860408 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:20:12.860408 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 12:20:12.860408 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:20:12.860408 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 649/1298] 10.222.0.79 () {56 vars in 1117 bytes} [Wed Aug 31 12:20:12 2022] GET /identity/v3/services/placement => generated 90 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:20:12.866270 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45e4bad-50a7-499d-986f-08d9159b1fad None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:20:12.885568 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:20:12.977839 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45e4bad-50a7-499d-986f-08d9159b1fad None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:20:13.021501 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2740cae-e7ae-4032-815d-b6be28e33d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:20:13.022331 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2740cae-e7ae-4032-815d-b6be28e33d45 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:13.022623 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2740cae-e7ae-4032-815d-b6be28e33d45 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:13.023022 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2740cae-e7ae-4032-815d-b6be28e33d45 None admin] PATH_INFO: `/v3/services` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:13.023702 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2740cae-e7ae-4032-815d-b6be28e33d45 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:20:13.024006 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2740cae-e7ae-4032-815d-b6be28e33d45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:20:13.025404 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2740cae-e7ae-4032-815d-b6be28e33d45 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:20:13.032775 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 650/1299] 10.222.0.79 () {56 vars in 1116 bytes} [Wed Aug 31 12:20:12 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:20:13.040148 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cb492b-2b59-4e7e-8580-a32db7119731 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:20:13.076198 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:20:13.155006 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cb492b-2b59-4e7e-8580-a32db7119731 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:20:13.194597 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e778a7-b4a5-444b-8a05-ac2f8094bb83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:20:13.195413 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e778a7-b4a5-444b-8a05-ac2f8094bb83 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:13.195855 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e778a7-b4a5-444b-8a05-ac2f8094bb83 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:13.196172 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e778a7-b4a5-444b-8a05-ac2f8094bb83 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:13.197174 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e778a7-b4a5-444b-8a05-ac2f8094bb83 None admin] RBAC: Adding query filter params (interface=public, service_id=274e9869ebbc40f895d6c011ccc92d7a, region_id=RegionOne) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:20:13.197538 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e778a7-b4a5-444b-8a05-ac2f8094bb83 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:20:13.199110 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e778a7-b4a5-444b-8a05-ac2f8094bb83 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:20:13.205205 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 650/1300] 10.222.0.79 () {56 vars in 1251 bytes} [Wed Aug 31 12:20:13 2022] GET /identity/v3/endpoints?service_id=274e9869ebbc40f895d6c011ccc92d7a&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:20:13.211797 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2740cae-e7ae-4032-815d-b6be28e33d45 None admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:20:13.300398 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:20:13.320716 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2740cae-e7ae-4032-815d-b6be28e33d45 None admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:20:13.358489 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b86eb-8594-4f21-9811-c4efca4824f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:20:13.359137 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b86eb-8594-4f21-9811-c4efca4824f2 None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:13.359547 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b86eb-8594-4f21-9811-c4efca4824f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:13.359829 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b86eb-8594-4f21-9811-c4efca4824f2 None admin] PATH_INFO: `/v3/services` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:13.360440 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764b86eb-8594-4f21-9811-c4efca4824f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:20:13.361823 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764b86eb-8594-4f21-9811-c4efca4824f2 None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:20:13.369648 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 651/1301] 10.222.0.79 () {56 vars in 1087 bytes} [Wed Aug 31 12:20:13 2022] GET /identity/v3/services => generated 2191 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 12:20:15.488857 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83a6bd-a965-407a-877e-e7d03f13c00a None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:15.489709 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83a6bd-a965-407a-877e-e7d03f13c00a None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:15.489906 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83a6bd-a965-407a-877e-e7d03f13c00a None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:15.492281 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 651/1302] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:20:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:20:15.498030 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ceb693-d4ae-416e-a43a-f7a061f12b04 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:15.498519 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ceb693-d4ae-416e-a43a-f7a061f12b04 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:15.498627 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ceb693-d4ae-416e-a43a-f7a061f12b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:15.518149 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-26ceb693-d4ae-416e-a43a-f7a061f12b04 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:20:15.519407 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-26ceb693-d4ae-416e-a43a-f7a061f12b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:20:15.593879 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 652/1303] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:20:15 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 12:20:15.881122 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc83a6bd-a965-407a-877e-e7d03f13c00a None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:20:15.991300 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:20:16.002450 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc83a6bd-a965-407a-877e-e7d03f13c00a None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:20:16.043882 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c04b97-f472-4e39-87fb-7e77a4c3c38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:20:16.044609 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c04b97-f472-4e39-87fb-7e77a4c3c38d None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:16.044893 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c04b97-f472-4e39-87fb-7e77a4c3c38d None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:16.045244 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c04b97-f472-4e39-87fb-7e77a4c3c38d None admin] PATH_INFO: `/v3/services/placement` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:16.045923 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c04b97-f472-4e39-87fb-7e77a4c3c38d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:20:16.047422 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c04b97-f472-4e39-87fb-7e77a4c3c38d None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:20:16.059038 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-59c04b97-f472-4e39-87fb-7e77a4c3c38d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 12:20:16.059038 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:20:16.059038 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 12:20:16.059038 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 12:20:16.059038 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 12:20:16.059038 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 12:20:16.059038 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 12:20:16.059038 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:20:16.059038 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 12:20:16.059038 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:20:16.059038 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:20:16.059038 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:20:16.059038 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:20:16.059038 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:20:16.059038 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:20:16.059038 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:20:16.059038 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:20:16.062624 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:20:16.062624 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:20:16.062624 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:20:16.062624 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:20:16.062624 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:20:16.062624 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:20:16.062624 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 12:20:16.062624 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 12:20:16.062624 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 12:20:16.062624 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 12:20:16.062624 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:20:16.062624 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:20:16.062624 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:20:16.062624 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:20:16.062624 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:20:16.062624 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:20:16.064717 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:20:16.064717 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Aug 31 12:20:16.064717 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:20:16.064717 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:20:16.064717 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:20:16.064717 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:20:16.064717 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:20:16.064717 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:20:16.064717 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:20:16.064717 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:20:16.064717 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 12:20:16.064717 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:20:16.064717 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 12:20:16.064717 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: ERROR keystone.server.flask.application Aug 31 12:20:16.064717 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 652/1304] 10.222.0.79 () {56 vars in 1117 bytes} [Wed Aug 31 12:20:15 2022] GET /identity/v3/services/placement => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:20:16.070973 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ceb693-d4ae-416e-a43a-f7a061f12b04 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:20:16.178259 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:20:16.202894 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ceb693-d4ae-416e-a43a-f7a061f12b04 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:20:16.244146 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdcfcaf-0a44-4ae3-91fc-ea76ba54e4fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:20:16.244988 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdcfcaf-0a44-4ae3-91fc-ea76ba54e4fb None admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:16.245386 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdcfcaf-0a44-4ae3-91fc-ea76ba54e4fb None admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:16.245660 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdcfcaf-0a44-4ae3-91fc-ea76ba54e4fb None admin] PATH_INFO: `/v3/services` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:16.246301 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdcfcaf-0a44-4ae3-91fc-ea76ba54e4fb None admin] RBAC: Adding query filter params (name=placement) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:20:16.246613 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdcfcaf-0a44-4ae3-91fc-ea76ba54e4fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:20:16.248471 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdcfcaf-0a44-4ae3-91fc-ea76ba54e4fb None admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:20:16.254097 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 653/1305] 10.222.0.79 () {56 vars in 1116 bytes} [Wed Aug 31 12:20:16 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:20:16.261714 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c04b97-f472-4e39-87fb-7e77a4c3c38d None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:20:16.371374 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c04b97-f472-4e39-87fb-7e77a4c3c38d None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:20:16.409812 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf88b59-68f2-4c1b-b5fa-fbaef217dd50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:20:16.410430 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf88b59-68f2-4c1b-b5fa-fbaef217dd50 None admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:16.410708 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf88b59-68f2-4c1b-b5fa-fbaef217dd50 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:16.411085 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf88b59-68f2-4c1b-b5fa-fbaef217dd50 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:16.412304 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf88b59-68f2-4c1b-b5fa-fbaef217dd50 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:20:16.413722 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf88b59-68f2-4c1b-b5fa-fbaef217dd50 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:20:16.435382 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 653/1306] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:20:16 2022] POST /identity/v3/endpoints => generated 331 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:20:26.251277 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=30 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:20:26.430107 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:21:24.936673 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62392b46-db02-4274-8cb5-bb97eb01c6e9 None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:21:24.937368 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62392b46-db02-4274-8cb5-bb97eb01c6e9 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:21:24.937368 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62392b46-db02-4274-8cb5-bb97eb01c6e9 None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:21:24.938568 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 654/1307] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:21:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:21:24.944413 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944231c8-d105-4c98-83be-ed752c5092f9 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:21:24.945590 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944231c8-d105-4c98-83be-ed752c5092f9 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:21:24.946084 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944231c8-d105-4c98-83be-ed752c5092f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:21:25.068032 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-944231c8-d105-4c98-83be-ed752c5092f9 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:21:25.069316 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-944231c8-d105-4c98-83be-ed752c5092f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:21:25.212900 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 654/1308] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:21:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:21:25.514876 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a71ab7-2d2e-442c-9337-be9a922f796d None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:21:25.515161 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a71ab7-2d2e-442c-9337-be9a922f796d None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:21:25.515630 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a71ab7-2d2e-442c-9337-be9a922f796d None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:21:25.517197 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 655/1309] 10.222.0.79 () {54 vars in 965 bytes} [Wed Aug 31 12:21:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:21:25.525355 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74adfa8-fea4-456d-b283-f24f168a6fb4 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:21:25.525797 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74adfa8-fea4-456d-b283-f24f168a6fb4 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:21:25.526174 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74adfa8-fea4-456d-b283-f24f168a6fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:21:25.774942 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-e74adfa8-fea4-456d-b283-f24f168a6fb4 None None] MFA Rules not processed for user `1569b43c774c45ff80577d879ba9d819`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:21:25.776264 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-e74adfa8-fea4-456d-b283-f24f168a6fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:21:25.800502 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:21:25.871612 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 655/1310] 10.222.0.79 () {58 vars in 1062 bytes} [Wed Aug 31 12:21:25 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:21:25.881428 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a71ab7-2d2e-442c-9337-be9a922f796d None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:21:25.883308 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-27a71ab7-2d2e-442c-9337-be9a922f796d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:21:26.049375 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a71ab7-2d2e-442c-9337-be9a922f796d None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:21:26.165331 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62475b79-d3ed-40cd-88d6-9d27eea9a71e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:21:26.166044 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62475b79-d3ed-40cd-88d6-9d27eea9a71e service neutron] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:21:26.166412 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62475b79-d3ed-40cd-88d6-9d27eea9a71e service neutron] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:21:26.166751 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62475b79-d3ed-40cd-88d6-9d27eea9a71e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:21:26.168504 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-62475b79-d3ed-40cd-88d6-9d27eea9a71e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:21:26.237082 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:21:26.303027 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62475b79-d3ed-40cd-88d6-9d27eea9a71e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:21:26.304567 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62475b79-d3ed-40cd-88d6-9d27eea9a71e service neutron] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:21:26.326349 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 656/1311] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:21:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:21:28.623117 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c2846-2ea5-4541-8a8e-e1bb0342fd20 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:21:28.623663 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c2846-2ea5-4541-8a8e-e1bb0342fd20 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:21:28.623757 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c2846-2ea5-4541-8a8e-e1bb0342fd20 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:21:28.625060 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 656/1312] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:21:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:21:28.632269 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8320ea7-f2ca-4747-99f0-3831490e75a6 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:21:28.632860 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8320ea7-f2ca-4747-99f0-3831490e75a6 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:21:28.632860 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8320ea7-f2ca-4747-99f0-3831490e75a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:21:28.711331 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-b8320ea7-f2ca-4747-99f0-3831490e75a6 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:21:28.712482 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-b8320ea7-f2ca-4747-99f0-3831490e75a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:21:28.818775 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 657/1313] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:21:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:21:29.106243 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16c2846-2ea5-4541-8a8e-e1bb0342fd20 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:21:29.107814 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-d16c2846-2ea5-4541-8a8e-e1bb0342fd20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:21:29.218817 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16c2846-2ea5-4541-8a8e-e1bb0342fd20 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:21:29.291646 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:21:29.294238 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37324550-8036-4696-8b47-fdbad81b5ffa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:21:29.295092 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37324550-8036-4696-8b47-fdbad81b5ffa service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:21:29.295569 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37324550-8036-4696-8b47-fdbad81b5ffa service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:21:29.296050 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37324550-8036-4696-8b47-fdbad81b5ffa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:21:29.297843 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-37324550-8036-4696-8b47-fdbad81b5ffa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:21:29.413114 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37324550-8036-4696-8b47-fdbad81b5ffa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:21:29.414577 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37324550-8036-4696-8b47-fdbad81b5ffa service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:21:29.434621 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 657/1314] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:21:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:21:31.741869 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002adf3b-4aae-4c94-99ed-bfcdcf5fe795 None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:21:31.742451 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002adf3b-4aae-4c94-99ed-bfcdcf5fe795 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:21:31.742451 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002adf3b-4aae-4c94-99ed-bfcdcf5fe795 None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:21:31.744032 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 658/1315] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:21:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:21:31.749767 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64209dda-92d3-41ff-a849-1cacda2d55a5 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:21:31.750326 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64209dda-92d3-41ff-a849-1cacda2d55a5 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:21:31.750465 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64209dda-92d3-41ff-a849-1cacda2d55a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:21:31.833203 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-64209dda-92d3-41ff-a849-1cacda2d55a5 None None] MFA Rules not processed for user `76d206fbf63149e689df0067d9be2dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:21:31.834621 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-64209dda-92d3-41ff-a849-1cacda2d55a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:21:31.893830 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:21:31.944493 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 658/1316] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:21:31 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:21:32.231080 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002adf3b-4aae-4c94-99ed-bfcdcf5fe795 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:21:32.232920 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-002adf3b-4aae-4c94-99ed-bfcdcf5fe795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:21:32.244866 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:21:32.349396 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002adf3b-4aae-4c94-99ed-bfcdcf5fe795 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:21:32.437376 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8cce50-1577-4bd9-81ca-3cb552874c1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:21:32.437997 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8cce50-1577-4bd9-81ca-3cb552874c1c service neutron] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:21:32.438277 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8cce50-1577-4bd9-81ca-3cb552874c1c service neutron] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:21:32.438548 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8cce50-1577-4bd9-81ca-3cb552874c1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:21:32.440284 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-de8cce50-1577-4bd9-81ca-3cb552874c1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:21:32.517647 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:21:32.569263 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8cce50-1577-4bd9-81ca-3cb552874c1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:21:32.570691 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8cce50-1577-4bd9-81ca-3cb552874c1c service neutron] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:21:32.589081 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 659/1317] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:21:32 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:21:35.123953 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f6cf26-893e-430a-a297-7238e72177c2 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:21:35.124539 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f6cf26-893e-430a-a297-7238e72177c2 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:21:35.124539 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f6cf26-893e-430a-a297-7238e72177c2 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:21:35.125914 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 659/1318] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:21:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:21:35.132457 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68403ed-c91e-4c86-88b6-33dfdbd7ff65 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:21:35.132987 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68403ed-c91e-4c86-88b6-33dfdbd7ff65 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:21:35.132987 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68403ed-c91e-4c86-88b6-33dfdbd7ff65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:21:35.205760 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-e68403ed-c91e-4c86-88b6-33dfdbd7ff65 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:21:35.206971 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-e68403ed-c91e-4c86-88b6-33dfdbd7ff65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:21:35.321728 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 660/1319] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:21:35 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:21:35.610104 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f6cf26-893e-430a-a297-7238e72177c2 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:21:35.611716 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-c4f6cf26-893e-430a-a297-7238e72177c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:21:35.720802 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f6cf26-893e-430a-a297-7238e72177c2 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:21:35.798659 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98a6854-fc78-434d-a481-37a077f8739b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:21:35.799295 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a6854-fc78-434d-a481-37a077f8739b service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:21:35.799568 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a6854-fc78-434d-a481-37a077f8739b service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:21:35.799835 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a6854-fc78-434d-a481-37a077f8739b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:21:35.801522 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-b98a6854-fc78-434d-a481-37a077f8739b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:21:35.809377 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:21:35.918561 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98a6854-fc78-434d-a481-37a077f8739b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:21:35.919947 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98a6854-fc78-434d-a481-37a077f8739b service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:21:35.937971 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 660/1320] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:21:35 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:21:38.612110 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c166f57-6549-4243-a2a7-44c5afdb19e5 None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:21:38.612650 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c166f57-6549-4243-a2a7-44c5afdb19e5 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:21:38.612650 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c166f57-6549-4243-a2a7-44c5afdb19e5 None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:21:38.614104 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 661/1321] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:21:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:21:38.619679 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a830905-bb4f-4dcb-bfc9-0de12fb79cc7 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:21:38.620162 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a830905-bb4f-4dcb-bfc9-0de12fb79cc7 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:21:38.620376 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a830905-bb4f-4dcb-bfc9-0de12fb79cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:21:38.695434 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-8a830905-bb4f-4dcb-bfc9-0de12fb79cc7 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:21:38.696729 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-8a830905-bb4f-4dcb-bfc9-0de12fb79cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:21:38.760396 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:21:38.806965 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 661/1322] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:21:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:21:39.088319 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c166f57-6549-4243-a2a7-44c5afdb19e5 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:21:39.089932 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-5c166f57-6549-4243-a2a7-44c5afdb19e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:21:39.112394 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:21:39.218741 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c166f57-6549-4243-a2a7-44c5afdb19e5 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:21:39.305769 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b16d81-c4ca-47d2-99ac-9d262870564b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:21:39.306383 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b16d81-c4ca-47d2-99ac-9d262870564b service neutron] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:21:39.306666 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b16d81-c4ca-47d2-99ac-9d262870564b service neutron] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:21:39.306967 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b16d81-c4ca-47d2-99ac-9d262870564b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:21:39.308630 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-c3b16d81-c4ca-47d2-99ac-9d262870564b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:21:39.429856 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:21:39.491064 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b16d81-c4ca-47d2-99ac-9d262870564b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:21:39.493246 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b16d81-c4ca-47d2-99ac-9d262870564b service neutron] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:21:39.520079 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 662/1323] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:21:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:21:41.588555 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393258ce-8409-49f4-8769-5e8669321655 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:21:41.589107 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393258ce-8409-49f4-8769-5e8669321655 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:21:41.589107 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393258ce-8409-49f4-8769-5e8669321655 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:21:41.590476 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 662/1324] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:21:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:21:41.596097 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23711f93-7617-47e0-8bc8-91c27969e0b7 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:21:41.596533 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23711f93-7617-47e0-8bc8-91c27969e0b7 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:21:41.596653 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23711f93-7617-47e0-8bc8-91c27969e0b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:21:41.668488 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-23711f93-7617-47e0-8bc8-91c27969e0b7 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:21:41.669627 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-23711f93-7617-47e0-8bc8-91c27969e0b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:21:41.776984 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 663/1325] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:21:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:21:42.064534 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393258ce-8409-49f4-8769-5e8669321655 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:21:42.065600 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-393258ce-8409-49f4-8769-5e8669321655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:21:42.173143 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393258ce-8409-49f4-8769-5e8669321655 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:21:42.261308 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30522a86-f295-46e5-82d9-135952505666 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:21:42.261932 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30522a86-f295-46e5-82d9-135952505666 service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:21:42.262209 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30522a86-f295-46e5-82d9-135952505666 service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:21:42.262481 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30522a86-f295-46e5-82d9-135952505666 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:21:42.264219 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-30522a86-f295-46e5-82d9-135952505666 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:21:42.283591 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:21:42.382464 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30522a86-f295-46e5-82d9-135952505666 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:21:42.383938 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30522a86-f295-46e5-82d9-135952505666 service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:21:42.404216 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 663/1326] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:21:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:21:44.407231 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffcb4a3-f187-4d66-9bfd-b50f8cd69b38 None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:21:44.407683 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffcb4a3-f187-4d66-9bfd-b50f8cd69b38 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:21:44.407788 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffcb4a3-f187-4d66-9bfd-b50f8cd69b38 None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:21:44.409176 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 664/1327] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:21:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:21:44.415770 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2969788-5dba-4c3a-9ad2-7bcbb91a6b0b None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:21:44.416278 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2969788-5dba-4c3a-9ad2-7bcbb91a6b0b None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:21:44.416503 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2969788-5dba-4c3a-9ad2-7bcbb91a6b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:21:44.493037 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-b2969788-5dba-4c3a-9ad2-7bcbb91a6b0b None None] MFA Rules not processed for user `76d206fbf63149e689df0067d9be2dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:21:44.494313 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-b2969788-5dba-4c3a-9ad2-7bcbb91a6b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:21:44.563419 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:21:44.597017 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 664/1328] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:21:44 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:21:44.889601 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffcb4a3-f187-4d66-9bfd-b50f8cd69b38 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:21:44.891806 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-2ffcb4a3-f187-4d66-9bfd-b50f8cd69b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:21:44.934203 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:21:45.033734 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffcb4a3-f187-4d66-9bfd-b50f8cd69b38 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:21:45.126454 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df415e8-fde1-4b40-b93d-f472a5fe4d01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:21:45.127146 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df415e8-fde1-4b40-b93d-f472a5fe4d01 service neutron] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:21:45.127422 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df415e8-fde1-4b40-b93d-f472a5fe4d01 service neutron] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:21:45.127688 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df415e8-fde1-4b40-b93d-f472a5fe4d01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:21:45.130141 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-5df415e8-fde1-4b40-b93d-f472a5fe4d01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:21:45.232757 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:21:45.281468 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df415e8-fde1-4b40-b93d-f472a5fe4d01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:21:45.284714 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df415e8-fde1-4b40-b93d-f472a5fe4d01 service neutron] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:21:45.324953 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 665/1329] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:21:44 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:21:47.534722 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c734a5-754a-4d47-bef8-fe134f53cddc None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:21:47.535752 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c734a5-754a-4d47-bef8-fe134f53cddc None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:21:47.535752 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c734a5-754a-4d47-bef8-fe134f53cddc None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:21:47.536694 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 665/1330] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:21:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:21:47.542792 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb6753-dfdd-4926-9204-a7442ffa8015 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:21:47.543366 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb6753-dfdd-4926-9204-a7442ffa8015 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:21:47.543366 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb6753-dfdd-4926-9204-a7442ffa8015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:21:47.611515 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-a1fb6753-dfdd-4926-9204-a7442ffa8015 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:21:47.612742 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-a1fb6753-dfdd-4926-9204-a7442ffa8015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:21:47.726582 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 666/1331] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:21:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:21:48.020808 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c734a5-754a-4d47-bef8-fe134f53cddc None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:21:48.022343 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-f5c734a5-754a-4d47-bef8-fe134f53cddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:21:48.126399 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c734a5-754a-4d47-bef8-fe134f53cddc None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:21:48.204506 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bea4a95-2ae5-4de6-9c8d-d2054dc33275 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:21:48.205121 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea4a95-2ae5-4de6-9c8d-d2054dc33275 service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:21:48.205396 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea4a95-2ae5-4de6-9c8d-d2054dc33275 service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:21:48.205665 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea4a95-2ae5-4de6-9c8d-d2054dc33275 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:21:48.208010 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-4bea4a95-2ae5-4de6-9c8d-d2054dc33275 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:21:48.236785 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:21:48.322403 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bea4a95-2ae5-4de6-9c8d-d2054dc33275 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:21:48.323870 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bea4a95-2ae5-4de6-9c8d-d2054dc33275 service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:21:48.342303 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 666/1332] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:21:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:21:50.356260 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a56576-2be4-4162-9384-fe0c6daaac46 None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:21:50.356844 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a56576-2be4-4162-9384-fe0c6daaac46 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:21:50.356844 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a56576-2be4-4162-9384-fe0c6daaac46 None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:21:50.358193 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 667/1333] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:21:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:21:50.363932 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5934ea48-230f-4404-9dc3-d5ba193c9520 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:21:50.364399 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5934ea48-230f-4404-9dc3-d5ba193c9520 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:21:50.364516 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5934ea48-230f-4404-9dc3-d5ba193c9520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:21:50.435649 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-5934ea48-230f-4404-9dc3-d5ba193c9520 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:21:50.436892 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-5934ea48-230f-4404-9dc3-d5ba193c9520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:21:50.516764 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:21:50.549226 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 667/1334] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:21:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:21:50.834737 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a56576-2be4-4162-9384-fe0c6daaac46 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:21:50.836317 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-17a56576-2be4-4162-9384-fe0c6daaac46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:21:50.879245 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:21:50.950683 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a56576-2be4-4162-9384-fe0c6daaac46 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:21:51.033951 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1523242-bb3f-4918-9884-c6b80ddc2375 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:21:51.034584 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1523242-bb3f-4918-9884-c6b80ddc2375 service neutron] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:21:51.034883 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1523242-bb3f-4918-9884-c6b80ddc2375 service neutron] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:21:51.035725 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1523242-bb3f-4918-9884-c6b80ddc2375 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:21:51.037507 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-f1523242-bb3f-4918-9884-c6b80ddc2375 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:21:51.125760 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:21:51.156647 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1523242-bb3f-4918-9884-c6b80ddc2375 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:21:51.158144 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1523242-bb3f-4918-9884-c6b80ddc2375 service neutron] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:21:51.178842 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 668/1335] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:21:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:21:53.520415 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ec3be-661f-4be3-b59a-36fcab74f0cf None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:21:53.521051 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ec3be-661f-4be3-b59a-36fcab74f0cf None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:21:53.521051 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ec3be-661f-4be3-b59a-36fcab74f0cf None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:21:53.522376 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 668/1336] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:21:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:21:53.528693 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b98fb-2ce1-4f26-8bc3-cec2c9e7d336 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:21:53.529291 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b98fb-2ce1-4f26-8bc3-cec2c9e7d336 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:21:53.529291 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b98fb-2ce1-4f26-8bc3-cec2c9e7d336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:21:53.606057 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-4a7b98fb-2ce1-4f26-8bc3-cec2c9e7d336 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:21:53.607330 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-4a7b98fb-2ce1-4f26-8bc3-cec2c9e7d336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:21:53.718428 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 669/1337] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:21:53 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:21:54.011899 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6ec3be-661f-4be3-b59a-36fcab74f0cf None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:21:54.013465 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-5c6ec3be-661f-4be3-b59a-36fcab74f0cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:21:54.119456 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6ec3be-661f-4be3-b59a-36fcab74f0cf None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:21:54.194812 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a884d68c-7b09-4981-97cb-d80bf695c168 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:21:54.195443 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884d68c-7b09-4981-97cb-d80bf695c168 service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:21:54.195721 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884d68c-7b09-4981-97cb-d80bf695c168 service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:21:54.195994 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884d68c-7b09-4981-97cb-d80bf695c168 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:21:54.197597 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-a884d68c-7b09-4981-97cb-d80bf695c168 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:21:54.240699 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:21:54.316951 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a884d68c-7b09-4981-97cb-d80bf695c168 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:21:54.318395 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a884d68c-7b09-4981-97cb-d80bf695c168 service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:21:54.336497 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 669/1338] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:21:54 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:21:58.399003 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f527fd7b-93a0-476b-a132-9c7f960c8721 None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:21:58.399552 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f527fd7b-93a0-476b-a132-9c7f960c8721 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:21:58.399552 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f527fd7b-93a0-476b-a132-9c7f960c8721 None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:21:58.400859 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 670/1339] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:21:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:21:58.406672 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb6cad3-cbe5-4f0a-b884-3db1cc01e128 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:21:58.407612 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb6cad3-cbe5-4f0a-b884-3db1cc01e128 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:21:58.407886 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb6cad3-cbe5-4f0a-b884-3db1cc01e128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:21:58.484058 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-cbb6cad3-cbe5-4f0a-b884-3db1cc01e128 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:21:58.485421 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-cbb6cad3-cbe5-4f0a-b884-3db1cc01e128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:21:58.588761 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:21:58.605410 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 670/1340] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:21:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:21:58.894937 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f527fd7b-93a0-476b-a132-9c7f960c8721 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:21:58.896500 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-f527fd7b-93a0-476b-a132-9c7f960c8721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:21:58.968255 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:21:59.044234 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f527fd7b-93a0-476b-a132-9c7f960c8721 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:21:59.142218 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc38b5d2-dc0d-4fa0-9b6c-de829ffd60a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:21:59.142748 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc38b5d2-dc0d-4fa0-9b6c-de829ffd60a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:21:59.143056 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc38b5d2-dc0d-4fa0-9b6c-de829ffd60a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:21:59.143330 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc38b5d2-dc0d-4fa0-9b6c-de829ffd60a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:21:59.148048 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-fc38b5d2-dc0d-4fa0-9b6c-de829ffd60a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:21:59.280562 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:21:59.302305 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc38b5d2-dc0d-4fa0-9b6c-de829ffd60a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:21:59.303860 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc38b5d2-dc0d-4fa0-9b6c-de829ffd60a4 service neutron] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:21:59.327636 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 671/1341] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:21:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:22:02.244450 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56627abd-a845-4856-a1f0-f776004e7944 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:22:02.245038 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56627abd-a845-4856-a1f0-f776004e7944 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:22:02.245038 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56627abd-a845-4856-a1f0-f776004e7944 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:22:02.246391 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 671/1342] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:22:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:22:02.253117 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd5678-c6ba-4d7b-8923-4b6d760cb3d5 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:22:02.253657 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd5678-c6ba-4d7b-8923-4b6d760cb3d5 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:22:02.253777 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd5678-c6ba-4d7b-8923-4b6d760cb3d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:22:02.337763 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-a1fd5678-c6ba-4d7b-8923-4b6d760cb3d5 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:22:02.339920 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-a1fd5678-c6ba-4d7b-8923-4b6d760cb3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:22:02.455275 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 672/1343] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:22:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:22:02.764753 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f887383-32ca-4fca-8af0-a81bf11f79d7 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:22:02.765243 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f887383-32ca-4fca-8af0-a81bf11f79d7 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:22:02.765756 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f887383-32ca-4fca-8af0-a81bf11f79d7 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:22:02.767723 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 672/1344] 10.222.0.79 () {54 vars in 965 bytes} [Wed Aug 31 12:22:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:22:02.774730 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fca0ab-aa80-410c-bb48-6c16eedf2ad9 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:22:02.775046 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fca0ab-aa80-410c-bb48-6c16eedf2ad9 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:22:02.775324 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fca0ab-aa80-410c-bb48-6c16eedf2ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:22:02.850612 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:22:02.859912 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-a8fca0ab-aa80-410c-bb48-6c16eedf2ad9 None None] MFA Rules not processed for user `1569b43c774c45ff80577d879ba9d819`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:22:02.861121 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-a8fca0ab-aa80-410c-bb48-6c16eedf2ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:22:02.937085 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 673/1345] 10.222.0.79 () {58 vars in 1062 bytes} [Wed Aug 31 12:22:02 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:22:02.946095 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f887383-32ca-4fca-8af0-a81bf11f79d7 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:22:02.947639 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-1f887383-32ca-4fca-8af0-a81bf11f79d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:22:03.072666 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f887383-32ca-4fca-8af0-a81bf11f79d7 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:22:03.172046 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c82358a-a867-492c-a599-b8422f26793d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:22:03.172740 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c82358a-a867-492c-a599-b8422f26793d service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:22:03.173025 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c82358a-a867-492c-a599-b8422f26793d service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:22:03.173302 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c82358a-a867-492c-a599-b8422f26793d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:22:03.177021 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-9c82358a-a867-492c-a599-b8422f26793d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:22:03.248733 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:22:03.324977 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c82358a-a867-492c-a599-b8422f26793d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:22:03.326341 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c82358a-a867-492c-a599-b8422f26793d service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:22:03.348641 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 673/1346] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:22:02 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:22:08.841313 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be7d69a-3f6a-4ea9-8a78-9a2ddfb68800 None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:22:08.842000 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be7d69a-3f6a-4ea9-8a78-9a2ddfb68800 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:22:08.842280 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be7d69a-3f6a-4ea9-8a78-9a2ddfb68800 None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:22:08.844956 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 674/1347] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:22:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:22:08.853957 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b392591b-728f-4c81-bae6-9a0960d656f4 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:22:08.854790 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b392591b-728f-4c81-bae6-9a0960d656f4 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:22:08.855008 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b392591b-728f-4c81-bae6-9a0960d656f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:22:08.969240 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-b392591b-728f-4c81-bae6-9a0960d656f4 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:22:08.973970 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-b392591b-728f-4c81-bae6-9a0960d656f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:22:09.166720 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:22:09.172502 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 674/1348] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:22:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:22:09.580746 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be7d69a-3f6a-4ea9-8a78-9a2ddfb68800 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:22:09.583339 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-4be7d69a-3f6a-4ea9-8a78-9a2ddfb68800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:22:09.743370 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be7d69a-3f6a-4ea9-8a78-9a2ddfb68800 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:22:09.797209 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:22:09.827675 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4541a2bc-7fc3-48d3-85be-f777f9583f28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:22:09.828404 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4541a2bc-7fc3-48d3-85be-f777f9583f28 service neutron] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:22:09.828726 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4541a2bc-7fc3-48d3-85be-f777f9583f28 service neutron] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:22:09.829040 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4541a2bc-7fc3-48d3-85be-f777f9583f28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:22:09.830708 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-4541a2bc-7fc3-48d3-85be-f777f9583f28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:22:09.956716 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4541a2bc-7fc3-48d3-85be-f777f9583f28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:22:09.958399 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4541a2bc-7fc3-48d3-85be-f777f9583f28 service neutron] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:22:09.979550 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 675/1349] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:22:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:22:15.364445 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a103e8be-2908-48b0-af6f-c4008918cbec None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:22:15.365009 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a103e8be-2908-48b0-af6f-c4008918cbec None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:22:15.365009 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a103e8be-2908-48b0-af6f-c4008918cbec None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:22:15.369105 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 675/1350] 10.222.0.79 () {54 vars in 921 bytes} [Wed Aug 31 12:22:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:22:15.374810 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ca11c-92f4-404a-889c-c318e3cbf361 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:22:15.375907 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ca11c-92f4-404a-889c-c318e3cbf361 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:22:15.377297 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ca11c-92f4-404a-889c-c318e3cbf361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:22:15.484862 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-7c3ca11c-92f4-404a-889c-c318e3cbf361 None None] MFA Rules not processed for user `b6deab40ae6244d4b9affa47b274aea3`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:22:15.486640 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-7c3ca11c-92f4-404a-889c-c318e3cbf361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:22:15.512208 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:22:15.663478 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 676/1351] 10.222.0.79 () {58 vars in 1018 bytes} [Wed Aug 31 12:22:15 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:22:20.603409 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb90420b-1e19-4aa6-bbbb-1c0c0a27cc8f None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:22:20.604286 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb90420b-1e19-4aa6-bbbb-1c0c0a27cc8f None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:22:20.604286 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb90420b-1e19-4aa6-bbbb-1c0c0a27cc8f None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:22:20.606652 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 676/1352] 10.222.0.79 () {54 vars in 921 bytes} [Wed Aug 31 12:22:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:22:20.613156 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd6afa6-ac68-4181-af62-1979052bbc36 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:22:20.613986 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd6afa6-ac68-4181-af62-1979052bbc36 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:22:20.614141 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd6afa6-ac68-4181-af62-1979052bbc36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:22:20.723777 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-bcd6afa6-ac68-4181-af62-1979052bbc36 None None] MFA Rules not processed for user `b6deab40ae6244d4b9affa47b274aea3`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:22:20.725148 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-bcd6afa6-ac68-4181-af62-1979052bbc36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:22:20.838842 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:22:20.911093 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 677/1353] 10.222.0.79 () {58 vars in 1018 bytes} [Wed Aug 31 12:22:20 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:22:22.783362 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a492068c-877c-46c2-9284-777ebc446157 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:22:22.784298 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a492068c-877c-46c2-9284-777ebc446157 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:22:22.784298 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a492068c-877c-46c2-9284-777ebc446157 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:22:22.787183 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 677/1354] 10.222.0.79 () {54 vars in 921 bytes} [Wed Aug 31 12:22:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:22:22.793320 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e682a-d0c5-4de6-b407-6656ae2fc291 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:22:22.793921 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e682a-d0c5-4de6-b407-6656ae2fc291 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:22:22.793921 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e682a-d0c5-4de6-b407-6656ae2fc291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:22:22.904807 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-553e682a-d0c5-4de6-b407-6656ae2fc291 None None] MFA Rules not processed for user `b6deab40ae6244d4b9affa47b274aea3`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:22:22.906064 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-553e682a-d0c5-4de6-b407-6656ae2fc291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:22:23.048346 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 678/1355] 10.222.0.79 () {58 vars in 1018 bytes} [Wed Aug 31 12:22:22 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:22:26.225042 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3049025e-08a5-435b-b02f-bc3104226702 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:22:26.225583 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3049025e-08a5-435b-b02f-bc3104226702 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:22:26.225583 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3049025e-08a5-435b-b02f-bc3104226702 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:22:26.226845 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 678/1356] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:22:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:22:26.232783 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0003a19d-a937-446e-beca-68a22c0cf24f None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:22:26.233256 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0003a19d-a937-446e-beca-68a22c0cf24f None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:22:26.233350 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0003a19d-a937-446e-beca-68a22c0cf24f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:22:26.273592 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:22:26.310396 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-0003a19d-a937-446e-beca-68a22c0cf24f None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:22:26.311647 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-0003a19d-a937-446e-beca-68a22c0cf24f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:22:26.425257 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 679/1357] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:22:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:22:26.778073 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c0963-81b5-4123-aceb-4fb26156c521 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:22:26.778555 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c0963-81b5-4123-aceb-4fb26156c521 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:22:26.782201 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c0963-81b5-4123-aceb-4fb26156c521 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:22:26.787544 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 679/1358] 10.222.0.79 () {54 vars in 962 bytes} [Wed Aug 31 12:22:26 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:22:26.806437 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06854435-74cd-4ca8-8d9f-9bd6701526ea None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:22:26.806437 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06854435-74cd-4ca8-8d9f-9bd6701526ea None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:22:26.807317 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06854435-74cd-4ca8-8d9f-9bd6701526ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:22:26.924165 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-06854435-74cd-4ca8-8d9f-9bd6701526ea None None] MFA Rules not processed for user `62401c8e1457450590f4147e0665265a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:22:26.926139 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-06854435-74cd-4ca8-8d9f-9bd6701526ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:22:27.013427 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:22:27.146265 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 680/1359] 10.222.0.79 () {58 vars in 1059 bytes} [Wed Aug 31 12:22:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:22:27.154187 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365c0963-81b5-4123-aceb-4fb26156c521 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:22:27.155783 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-365c0963-81b5-4123-aceb-4fb26156c521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:22:27.321694 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365c0963-81b5-4123-aceb-4fb26156c521 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:22:27.415214 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:22:27.493709 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2105a8-b6a8-457f-95be-1cd7f69674f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62401c8e1457450590f4147e0665265a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:22:27.494660 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2105a8-b6a8-457f-95be-1cd7f69674f2 service nova] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:22:27.495160 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2105a8-b6a8-457f-95be-1cd7f69674f2 service nova] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:22:27.495635 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2105a8-b6a8-457f-95be-1cd7f69674f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:22:27.498766 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-ee2105a8-b6a8-457f-95be-1cd7f69674f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:22:27.645447 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2105a8-b6a8-457f-95be-1cd7f69674f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:22:27.647091 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2105a8-b6a8-457f-95be-1cd7f69674f2 service nova] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:22:27.670212 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 680/1360] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:22:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:22:30.477099 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df2a890-4caf-4a6a-b52c-613da664aedb None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:22:30.477765 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df2a890-4caf-4a6a-b52c-613da664aedb None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:22:30.478052 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df2a890-4caf-4a6a-b52c-613da664aedb None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:22:30.480536 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 681/1361] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:22:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:22:30.486477 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c75153-fd31-45f3-a87b-252465a32819 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:22:30.487223 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c75153-fd31-45f3-a87b-252465a32819 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:22:30.487223 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c75153-fd31-45f3-a87b-252465a32819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:22:30.582547 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-97c75153-fd31-45f3-a87b-252465a32819 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:22:30.584549 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-97c75153-fd31-45f3-a87b-252465a32819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:22:30.648793 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:22:30.751636 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 681/1362] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:22:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:22:31.074477 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df2a890-4caf-4a6a-b52c-613da664aedb None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:22:31.076643 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-5df2a890-4caf-4a6a-b52c-613da664aedb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:22:31.262047 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df2a890-4caf-4a6a-b52c-613da664aedb None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:22:31.299591 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:22:31.446721 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2fb4d2-136e-4db9-b9d0-f759940bf107 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62401c8e1457450590f4147e0665265a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:22:31.447449 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2fb4d2-136e-4db9-b9d0-f759940bf107 service nova] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:22:31.447741 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2fb4d2-136e-4db9-b9d0-f759940bf107 service nova] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:22:31.448161 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2fb4d2-136e-4db9-b9d0-f759940bf107 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:22:31.450052 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-2e2fb4d2-136e-4db9-b9d0-f759940bf107 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:22:31.564966 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2fb4d2-136e-4db9-b9d0-f759940bf107 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:22:31.566797 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2fb4d2-136e-4db9-b9d0-f759940bf107 service nova] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:22:31.590031 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 682/1363] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:22:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:22:33.948216 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9699abb-028c-4a84-ac35-10c1393f84a3 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:22:33.949002 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9699abb-028c-4a84-ac35-10c1393f84a3 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:22:33.949002 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9699abb-028c-4a84-ac35-10c1393f84a3 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:22:33.950167 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 682/1364] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:22:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:22:33.958304 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097346c7-01d7-4cab-a2af-6489d510f3f6 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:22:33.959127 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097346c7-01d7-4cab-a2af-6489d510f3f6 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:22:33.959271 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097346c7-01d7-4cab-a2af-6489d510f3f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:22:33.989510 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:22:34.094192 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-097346c7-01d7-4cab-a2af-6489d510f3f6 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:22:34.096225 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-097346c7-01d7-4cab-a2af-6489d510f3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:22:34.257286 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 683/1365] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:22:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:22:34.613115 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea354ea-3012-483c-a537-3d46ef54ea59 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:22:34.613482 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea354ea-3012-483c-a537-3d46ef54ea59 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:22:34.613764 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea354ea-3012-483c-a537-3d46ef54ea59 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:22:34.615177 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 683/1366] 10.222.0.79 () {54 vars in 962 bytes} [Wed Aug 31 12:22:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:22:34.621257 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c40afbb-6a2e-4ce7-9fb2-92bdb2b71645 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:22:34.621691 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c40afbb-6a2e-4ce7-9fb2-92bdb2b71645 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:22:34.622070 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c40afbb-6a2e-4ce7-9fb2-92bdb2b71645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:22:34.726194 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-8c40afbb-6a2e-4ce7-9fb2-92bdb2b71645 None None] MFA Rules not processed for user `62401c8e1457450590f4147e0665265a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:22:34.727901 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-8c40afbb-6a2e-4ce7-9fb2-92bdb2b71645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:22:34.796393 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:22:34.955018 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 684/1367] 10.222.0.79 () {58 vars in 1059 bytes} [Wed Aug 31 12:22:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:22:34.963279 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea354ea-3012-483c-a537-3d46ef54ea59 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:22:34.965201 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-9ea354ea-3012-483c-a537-3d46ef54ea59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:22:35.146385 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea354ea-3012-483c-a537-3d46ef54ea59 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:22:35.169236 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:22:35.274921 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb64ccfe-9a3d-43a0-be0d-8cb3321a002f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62401c8e1457450590f4147e0665265a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:22:35.275776 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb64ccfe-9a3d-43a0-be0d-8cb3321a002f service nova] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:22:35.276051 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb64ccfe-9a3d-43a0-be0d-8cb3321a002f service nova] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:22:35.276319 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb64ccfe-9a3d-43a0-be0d-8cb3321a002f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:22:35.277967 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-eb64ccfe-9a3d-43a0-be0d-8cb3321a002f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:22:35.391110 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb64ccfe-9a3d-43a0-be0d-8cb3321a002f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:22:35.392771 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb64ccfe-9a3d-43a0-be0d-8cb3321a002f service nova] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:22:35.414189 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 684/1368] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:22:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:22:35.975605 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae284ef-65e8-4ade-81a4-b12963aa6764 None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:22:35.976152 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae284ef-65e8-4ade-81a4-b12963aa6764 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:22:35.976152 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae284ef-65e8-4ade-81a4-b12963aa6764 None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:22:35.977535 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 685/1369] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:22:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:22:35.983599 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3e1b3-2141-4f01-bde8-7f7794b1f01e None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:22:35.984116 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3e1b3-2141-4f01-bde8-7f7794b1f01e None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:22:35.984229 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3e1b3-2141-4f01-bde8-7f7794b1f01e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:22:36.024612 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:22:36.067705 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-faa3e1b3-2141-4f01-bde8-7f7794b1f01e None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:22:36.068958 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-faa3e1b3-2141-4f01-bde8-7f7794b1f01e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:22:36.184045 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 685/1370] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:22:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:22:36.911027 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f5dda-087d-4eed-aa80-f104571933f9 None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:22:36.911488 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f5dda-087d-4eed-aa80-f104571933f9 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:22:36.911793 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f5dda-087d-4eed-aa80-f104571933f9 None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:22:36.913677 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 686/1371] 10.222.0.79 () {54 vars in 964 bytes} [Wed Aug 31 12:22:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:22:36.922055 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd8dc08-d719-4f0e-af3c-7c2abfe15898 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:22:36.922488 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd8dc08-d719-4f0e-af3c-7c2abfe15898 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:22:36.923127 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd8dc08-d719-4f0e-af3c-7c2abfe15898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:22:37.077204 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-2cd8dc08-d719-4f0e-af3c-7c2abfe15898 None None] MFA Rules not processed for user `e79503178ac54e62ba385467d5617ea1`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:22:37.080196 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-2cd8dc08-d719-4f0e-af3c-7c2abfe15898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:22:37.159058 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:22:37.218251 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 686/1372] 10.222.0.79 () {58 vars in 1061 bytes} [Wed Aug 31 12:22:36 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:22:37.234736 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3f5dda-087d-4eed-aa80-f104571933f9 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:22:37.236062 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-ba3f5dda-087d-4eed-aa80-f104571933f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:22:37.393715 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3f5dda-087d-4eed-aa80-f104571933f9 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:22:37.485569 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:22:37.560097 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88821b5-8e74-48df-82db-79b4382913cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e79503178ac54e62ba385467d5617ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:22:37.560097 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88821b5-8e74-48df-82db-79b4382913cd service cinder] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:22:37.561362 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88821b5-8e74-48df-82db-79b4382913cd service cinder] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:22:37.561362 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88821b5-8e74-48df-82db-79b4382913cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:22:37.565754 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-f88821b5-8e74-48df-82db-79b4382913cd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:22:37.703967 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88821b5-8e74-48df-82db-79b4382913cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:22:37.705453 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88821b5-8e74-48df-82db-79b4382913cd service cinder] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:22:37.728957 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 687/1373] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:22:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:22:37.835112 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add067aa-3ee1-4cd6-b1ae-c1aac88eb7c1 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:22:37.835520 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add067aa-3ee1-4cd6-b1ae-c1aac88eb7c1 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:22:37.835873 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add067aa-3ee1-4cd6-b1ae-c1aac88eb7c1 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:22:37.837377 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 687/1374] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:22:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:22:37.843306 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e5f7eb-9740-4118-8dee-de649654dcea None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:22:37.843871 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e5f7eb-9740-4118-8dee-de649654dcea None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:22:37.844157 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e5f7eb-9740-4118-8dee-de649654dcea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:22:37.931653 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-b9e5f7eb-9740-4118-8dee-de649654dcea None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:22:37.932808 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-b9e5f7eb-9740-4118-8dee-de649654dcea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:22:37.958444 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:22:38.052507 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 688/1375] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:22:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:22:38.367487 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add067aa-3ee1-4cd6-b1ae-c1aac88eb7c1 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:22:38.369888 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-add067aa-3ee1-4cd6-b1ae-c1aac88eb7c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:22:38.570569 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add067aa-3ee1-4cd6-b1ae-c1aac88eb7c1 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:22:38.643809 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:22:38.719030 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f4f947-ca9f-41df-9a63-81fcaa8cf162 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62401c8e1457450590f4147e0665265a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:22:38.719928 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f4f947-ca9f-41df-9a63-81fcaa8cf162 service nova] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:22:38.720238 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f4f947-ca9f-41df-9a63-81fcaa8cf162 service nova] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:22:38.720529 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f4f947-ca9f-41df-9a63-81fcaa8cf162 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:22:38.722203 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-19f4f947-ca9f-41df-9a63-81fcaa8cf162 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:22:38.836180 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f4f947-ca9f-41df-9a63-81fcaa8cf162 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:22:38.837819 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f4f947-ca9f-41df-9a63-81fcaa8cf162 service nova] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:22:38.858191 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 688/1376] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:22:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:22:40.913327 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b957c8-3187-4ee4-9aae-4161d4c6c76c None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:22:40.913962 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b957c8-3187-4ee4-9aae-4161d4c6c76c None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:22:40.913962 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b957c8-3187-4ee4-9aae-4161d4c6c76c None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:22:40.915173 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 689/1377] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:22:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:22:40.921948 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e76b8-8c91-40ec-b3b9-57e1fd057a20 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:22:40.922614 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e76b8-8c91-40ec-b3b9-57e1fd057a20 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:22:40.922986 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e76b8-8c91-40ec-b3b9-57e1fd057a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:22:41.033266 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-7e8e76b8-8c91-40ec-b3b9-57e1fd057a20 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:22:41.034493 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-7e8e76b8-8c91-40ec-b3b9-57e1fd057a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:22:41.043038 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:22:41.203990 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 689/1378] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:22:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:22:41.505687 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b957c8-3187-4ee4-9aae-4161d4c6c76c None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:22:41.507828 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-60b957c8-3187-4ee4-9aae-4161d4c6c76c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:22:41.794144 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b957c8-3187-4ee4-9aae-4161d4c6c76c None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:22:41.800246 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:22:41.935546 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b69c387-0da3-4176-baaa-6ec959de63d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62401c8e1457450590f4147e0665265a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:22:41.936406 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b69c387-0da3-4176-baaa-6ec959de63d9 service nova] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:22:41.936720 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b69c387-0da3-4176-baaa-6ec959de63d9 service nova] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:22:41.936997 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b69c387-0da3-4176-baaa-6ec959de63d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:22:41.938648 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-6b69c387-0da3-4176-baaa-6ec959de63d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:22:42.040422 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b69c387-0da3-4176-baaa-6ec959de63d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:22:42.042043 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b69c387-0da3-4176-baaa-6ec959de63d9 service nova] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:22:42.070412 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 690/1379] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:22:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:22:44.361281 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9532ac-5077-4da9-b57d-0b51cb432558 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:22:44.361918 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9532ac-5077-4da9-b57d-0b51cb432558 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:22:44.361918 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9532ac-5077-4da9-b57d-0b51cb432558 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:22:44.363956 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 690/1380] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:22:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:22:44.369967 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e8fe6f-e6aa-4e05-b1b8-41f275e49394 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:22:44.370529 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e8fe6f-e6aa-4e05-b1b8-41f275e49394 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:22:44.370696 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e8fe6f-e6aa-4e05-b1b8-41f275e49394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:22:44.384634 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:22:44.447701 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-f7e8fe6f-e6aa-4e05-b1b8-41f275e49394 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:22:44.449021 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-f7e8fe6f-e6aa-4e05-b1b8-41f275e49394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:22:44.586923 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 691/1381] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:22:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:22:44.885548 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9532ac-5077-4da9-b57d-0b51cb432558 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:22:44.887133 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-8a9532ac-5077-4da9-b57d-0b51cb432558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:22:45.075570 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:22:45.089549 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9532ac-5077-4da9-b57d-0b51cb432558 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:22:45.238811 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5779135-a57b-45dd-9444-908cef23119d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62401c8e1457450590f4147e0665265a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:22:45.239515 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5779135-a57b-45dd-9444-908cef23119d service nova] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:22:45.239890 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5779135-a57b-45dd-9444-908cef23119d service nova] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:22:45.240256 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5779135-a57b-45dd-9444-908cef23119d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:22:45.242014 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-f5779135-a57b-45dd-9444-908cef23119d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:22:45.369694 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5779135-a57b-45dd-9444-908cef23119d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:22:45.372913 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5779135-a57b-45dd-9444-908cef23119d service nova] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:22:45.392892 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:22:45.404482 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 691/1382] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:22:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:22:47.584662 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd38af-65e4-47aa-a29c-523d52e6fc69 None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:22:47.585314 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd38af-65e4-47aa-a29c-523d52e6fc69 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:22:47.585509 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd38af-65e4-47aa-a29c-523d52e6fc69 None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:22:47.587458 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 692/1383] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:22:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:22:47.594559 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e328ae-a7b4-4968-bb6e-c965058c8ec9 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:22:47.595135 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e328ae-a7b4-4968-bb6e-c965058c8ec9 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:22:47.595356 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e328ae-a7b4-4968-bb6e-c965058c8ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:22:47.705921 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-58e328ae-a7b4-4968-bb6e-c965058c8ec9 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:22:47.708008 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-58e328ae-a7b4-4968-bb6e-c965058c8ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:22:47.859482 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 692/1384] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:22:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:22:48.177252 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd38af-65e4-47aa-a29c-523d52e6fc69 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:22:48.178892 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-2fcd38af-65e4-47aa-a29c-523d52e6fc69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:22:48.298467 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:22:48.395695 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd38af-65e4-47aa-a29c-523d52e6fc69 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:22:48.576096 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d25ff84-49cf-4f31-b192-35de9ea2b4a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62401c8e1457450590f4147e0665265a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:22:48.576731 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25ff84-49cf-4f31-b192-35de9ea2b4a4 service nova] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:22:48.577015 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25ff84-49cf-4f31-b192-35de9ea2b4a4 service nova] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:22:48.577288 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25ff84-49cf-4f31-b192-35de9ea2b4a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:22:48.579035 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-1d25ff84-49cf-4f31-b192-35de9ea2b4a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:22:48.645899 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:22:48.695193 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d25ff84-49cf-4f31-b192-35de9ea2b4a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:22:48.696923 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d25ff84-49cf-4f31-b192-35de9ea2b4a4 service nova] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:22:48.719628 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 693/1385] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:22:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:22:50.930968 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fafcaf-9383-4ab9-b124-e274a33fb4ee None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:22:50.931825 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fafcaf-9383-4ab9-b124-e274a33fb4ee None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:22:50.932094 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fafcaf-9383-4ab9-b124-e274a33fb4ee None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:22:50.934752 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 693/1386] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:22:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:22:50.941926 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce075b5-2eca-433f-b124-b1a11454264e None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:22:50.943347 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce075b5-2eca-433f-b124-b1a11454264e None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:22:50.943347 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce075b5-2eca-433f-b124-b1a11454264e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:22:51.065444 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-9ce075b5-2eca-433f-b124-b1a11454264e None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:22:51.067349 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-9ce075b5-2eca-433f-b124-b1a11454264e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:22:51.215406 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 694/1387] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:22:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:22:51.537084 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fafcaf-9383-4ab9-b124-e274a33fb4ee None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:22:51.539607 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-c3fafcaf-9383-4ab9-b124-e274a33fb4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:22:51.662003 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:22:51.747822 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fafcaf-9383-4ab9-b124-e274a33fb4ee None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:22:51.892750 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2603259e-c357-43a6-8e67-9295217d1d19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62401c8e1457450590f4147e0665265a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:22:51.893736 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2603259e-c357-43a6-8e67-9295217d1d19 service nova] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:22:51.894711 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2603259e-c357-43a6-8e67-9295217d1d19 service nova] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:22:51.895251 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2603259e-c357-43a6-8e67-9295217d1d19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:22:51.898568 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-2603259e-c357-43a6-8e67-9295217d1d19 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:22:51.962203 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:22:52.032623 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2603259e-c357-43a6-8e67-9295217d1d19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:22:52.036520 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2603259e-c357-43a6-8e67-9295217d1d19 service nova] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:22:52.065063 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 694/1388] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:22:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:22:53.952540 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d0cf69-6f69-4ef3-9df1-6db811b49d52 None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:22:53.953109 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d0cf69-6f69-4ef3-9df1-6db811b49d52 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:22:53.953420 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d0cf69-6f69-4ef3-9df1-6db811b49d52 None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:22:53.955918 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 695/1389] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:22:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:22:53.965926 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d772e262-2951-4c66-b7cb-1b6e68cc8a89 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:22:53.966503 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d772e262-2951-4c66-b7cb-1b6e68cc8a89 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:22:53.966931 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d772e262-2951-4c66-b7cb-1b6e68cc8a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:22:54.094723 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-d772e262-2951-4c66-b7cb-1b6e68cc8a89 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:22:54.096857 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-d772e262-2951-4c66-b7cb-1b6e68cc8a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:22:54.246436 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 695/1390] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:22:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:22:54.562393 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00c054-20db-46bf-b036-de2e3b568d9f None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:22:54.562787 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00c054-20db-46bf-b036-de2e3b568d9f None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:22:54.563134 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00c054-20db-46bf-b036-de2e3b568d9f None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:22:54.564568 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 696/1391] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:22:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:22:54.571310 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17b0d8-7e11-42f5-b853-b5b73f91f25e None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:22:54.571596 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17b0d8-7e11-42f5-b853-b5b73f91f25e None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:22:54.571862 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17b0d8-7e11-42f5-b853-b5b73f91f25e None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:22:54.572168 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f620a4-0830-4a7a-9e75-3fc7f2159f8b None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:22:54.572481 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f620a4-0830-4a7a-9e75-3fc7f2159f8b None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:22:54.572764 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f620a4-0830-4a7a-9e75-3fc7f2159f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:22:54.573256 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 696/1392] 10.222.0.79 () {54 vars in 967 bytes} [Wed Aug 31 12:22:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:22:54.578768 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c41bc8-197d-4eb3-ba77-2681788824b1 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:22:54.579115 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c41bc8-197d-4eb3-ba77-2681788824b1 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:22:54.579428 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c41bc8-197d-4eb3-ba77-2681788824b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:22:54.599714 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:22:54.621833 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:22:54.662389 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-d1f620a4-0830-4a7a-9e75-3fc7f2159f8b None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:22:54.663871 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-d1f620a4-0830-4a7a-9e75-3fc7f2159f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:22:54.692614 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-a1c41bc8-197d-4eb3-ba77-2681788824b1 None None] MFA Rules not processed for user `d8b3bb8f689b45b99ed43f672264a26d`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:22:54.694731 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-a1c41bc8-197d-4eb3-ba77-2681788824b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:22:54.788150 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 697/1393] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:22:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:22:54.813138 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 697/1394] 10.222.0.79 () {58 vars in 1064 bytes} [Wed Aug 31 12:22:54 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:22:54.824238 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f620a4-0830-4a7a-9e75-3fc7f2159f8b None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:22:54.826436 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-d1f620a4-0830-4a7a-9e75-3fc7f2159f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:22:55.001524 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f620a4-0830-4a7a-9e75-3fc7f2159f8b None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:22:55.036217 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:22:55.103296 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c41bc8-197d-4eb3-ba77-2681788824b1 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:22:55.104567 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-a1c41bc8-197d-4eb3-ba77-2681788824b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:22:55.115393 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7e681c-ee07-40f4-920f-d727bd894e47 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8b3bb8f689b45b99ed43f672264a26d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:22:55.116001 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7e681c-ee07-40f4-920f-d727bd894e47 service glance] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:22:55.116277 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7e681c-ee07-40f4-920f-d727bd894e47 service glance] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:22:55.116547 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7e681c-ee07-40f4-920f-d727bd894e47 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:22:55.118222 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-aa7e681c-ee07-40f4-920f-d727bd894e47 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:22:55.246567 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7e681c-ee07-40f4-920f-d727bd894e47 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:22:55.248318 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:22:55.248965 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7e681c-ee07-40f4-920f-d727bd894e47 service glance] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:22:55.266910 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c41bc8-197d-4eb3-ba77-2681788824b1 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:22:55.273997 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 698/1395] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:22:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:22:55.416822 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cd1048-1088-455f-a173-834f0ca6d5b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62401c8e1457450590f4147e0665265a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:22:55.417344 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd1048-1088-455f-a173-834f0ca6d5b6 service nova] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:22:55.417624 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd1048-1088-455f-a173-834f0ca6d5b6 service nova] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:22:55.417898 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd1048-1088-455f-a173-834f0ca6d5b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:22:55.419548 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-30cd1048-1088-455f-a173-834f0ca6d5b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:22:55.545562 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cd1048-1088-455f-a173-834f0ca6d5b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:22:55.547260 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cd1048-1088-455f-a173-834f0ca6d5b6 service nova] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:22:55.560464 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:22:55.571094 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 698/1396] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:22:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:22:56.084713 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65afeca5-a8a6-475c-a859-5fac8d5cfa7a None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:22:56.085592 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65afeca5-a8a6-475c-a859-5fac8d5cfa7a None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:22:56.085592 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65afeca5-a8a6-475c-a859-5fac8d5cfa7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:22:56.183820 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:22:56.189074 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-65afeca5-a8a6-475c-a859-5fac8d5cfa7a None None] MFA Rules not processed for user `149aa48acd504354a1d021885ca51334`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:22:56.191480 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-65afeca5-a8a6-475c-a859-5fac8d5cfa7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:22:56.316077 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 699/1397] 10.222.0.79 () {58 vars in 1009 bytes} [Wed Aug 31 12:22:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:22:56.377002 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650c378-b39a-4748-8d3d-7d969c83b146 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:22:56.377542 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650c378-b39a-4748-8d3d-7d969c83b146 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:22:56.377542 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650c378-b39a-4748-8d3d-7d969c83b146 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:22:56.379512 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 699/1398] 10.222.0.79 () {54 vars in 943 bytes} [Wed Aug 31 12:22:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:22:56.386598 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e688e21-c8d2-4d09-a5d3-85c77f48ab13 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:22:56.386953 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e688e21-c8d2-4d09-a5d3-85c77f48ab13 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:22:56.387385 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e688e21-c8d2-4d09-a5d3-85c77f48ab13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:22:56.492407 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-0e688e21-c8d2-4d09-a5d3-85c77f48ab13 None None] MFA Rules not processed for user `4896540cc14f40b08d05ade32cfd0f37`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:22:56.494458 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-0e688e21-c8d2-4d09-a5d3-85c77f48ab13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:22:56.610535 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:22:56.650441 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 700/1399] 10.222.0.79 () {58 vars in 1040 bytes} [Wed Aug 31 12:22:56 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:22:56.664404 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4650c378-b39a-4748-8d3d-7d969c83b146 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:22:56.667311 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-4650c378-b39a-4748-8d3d-7d969c83b146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:22:56.868594 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4650c378-b39a-4748-8d3d-7d969c83b146 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:22:56.985946 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:22:57.016670 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f694bb-781a-4337-b6f3-d5abdabb31fc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896540cc14f40b08d05ade32cfd0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:22:57.017286 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f694bb-781a-4337-b6f3-d5abdabb31fc service swift] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:22:57.017567 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f694bb-781a-4337-b6f3-d5abdabb31fc service swift] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:22:57.017836 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f694bb-781a-4337-b6f3-d5abdabb31fc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:22:57.020218 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-c7f694bb-781a-4337-b6f3-d5abdabb31fc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:22:57.152601 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f694bb-781a-4337-b6f3-d5abdabb31fc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:22:57.154126 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f694bb-781a-4337-b6f3-d5abdabb31fc service swift] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:22:57.164123 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 700/1400] 10.222.0.79 () {60 vars in 1384 bytes} [Wed Aug 31 12:22:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 12:22:57.657102 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db128ac-1cd9-4e7d-913d-95f5524e6602 None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:22:57.657982 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db128ac-1cd9-4e7d-913d-95f5524e6602 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:22:57.657982 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db128ac-1cd9-4e7d-913d-95f5524e6602 None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:22:57.660922 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 701/1401] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:22:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:22:57.670428 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ae30a-0d66-4dba-b9e3-3cdf36e26c1f None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:22:57.671350 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ae30a-0d66-4dba-b9e3-3cdf36e26c1f None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:22:57.671350 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ae30a-0d66-4dba-b9e3-3cdf36e26c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:22:57.799306 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-ce8ae30a-0d66-4dba-b9e3-3cdf36e26c1f None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:22:57.801653 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-ce8ae30a-0d66-4dba-b9e3-3cdf36e26c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:22:57.913502 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:22:57.962919 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 701/1402] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:22:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:22:58.272989 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db128ac-1cd9-4e7d-913d-95f5524e6602 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:22:58.274621 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-9db128ac-1cd9-4e7d-913d-95f5524e6602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:22:58.489965 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db128ac-1cd9-4e7d-913d-95f5524e6602 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:22:58.576534 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:22:58.690750 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d758bedd-d9de-409b-8990-4db4694ea6ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62401c8e1457450590f4147e0665265a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:22:58.692553 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758bedd-d9de-409b-8990-4db4694ea6ed service nova] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:22:58.693098 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758bedd-d9de-409b-8990-4db4694ea6ed service nova] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:22:58.693792 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758bedd-d9de-409b-8990-4db4694ea6ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:22:58.697355 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-d758bedd-d9de-409b-8990-4db4694ea6ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:22:58.826235 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d758bedd-d9de-409b-8990-4db4694ea6ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:22:58.828093 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d758bedd-d9de-409b-8990-4db4694ea6ed service nova] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:22:58.850157 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 702/1403] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:22:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 578 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:23:01.050349 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9721dde-3eb1-423a-918e-aa2391ebdffd None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:23:01.051164 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9721dde-3eb1-423a-918e-aa2391ebdffd None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:23:01.051164 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9721dde-3eb1-423a-918e-aa2391ebdffd None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:23:01.056562 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 702/1404] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:23:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:23:01.057990 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5056cea-a290-4518-86d0-f2306293236d None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:23:01.058706 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5056cea-a290-4518-86d0-f2306293236d None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:23:01.058706 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5056cea-a290-4518-86d0-f2306293236d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:23:01.150630 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-f5056cea-a290-4518-86d0-f2306293236d None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:23:01.153001 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-f5056cea-a290-4518-86d0-f2306293236d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:23:01.166208 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:23:01.342562 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 703/1405] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:23:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:23:01.719865 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9721dde-3eb1-423a-918e-aa2391ebdffd None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:23:01.721704 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-b9721dde-3eb1-423a-918e-aa2391ebdffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:23:02.001149 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9721dde-3eb1-423a-918e-aa2391ebdffd None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:23:02.088340 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:23:02.180252 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed85ffb-3d42-4850-bfbc-7d52cd563f3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62401c8e1457450590f4147e0665265a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:23:02.180869 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed85ffb-3d42-4850-bfbc-7d52cd563f3c service nova] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:23:02.181199 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed85ffb-3d42-4850-bfbc-7d52cd563f3c service nova] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:23:02.181473 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed85ffb-3d42-4850-bfbc-7d52cd563f3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:23:02.183344 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-0ed85ffb-3d42-4850-bfbc-7d52cd563f3c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:23:02.284219 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed85ffb-3d42-4850-bfbc-7d52cd563f3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:23:02.286000 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed85ffb-3d42-4850-bfbc-7d52cd563f3c service nova] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:23:02.311491 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 703/1406] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:23:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 592 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:23:04.454358 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea7346b-a098-4d3c-9379-42fbe4f2b9d3 None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:23:04.454936 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea7346b-a098-4d3c-9379-42fbe4f2b9d3 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:23:04.454936 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea7346b-a098-4d3c-9379-42fbe4f2b9d3 None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:23:04.456349 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 704/1407] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:23:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:23:04.462784 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eab45e-10ca-41e7-8261-550027171c0d None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:23:04.463338 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eab45e-10ca-41e7-8261-550027171c0d None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:23:04.463338 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eab45e-10ca-41e7-8261-550027171c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:23:04.557969 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-57eab45e-10ca-41e7-8261-550027171c0d None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:23:04.559266 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-57eab45e-10ca-41e7-8261-550027171c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:23:04.574304 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:23:04.720385 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 704/1408] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:23:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:23:05.038563 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea7346b-a098-4d3c-9379-42fbe4f2b9d3 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:23:05.040209 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-8ea7346b-a098-4d3c-9379-42fbe4f2b9d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:23:05.238281 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:23:05.251486 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea7346b-a098-4d3c-9379-42fbe4f2b9d3 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:23:05.388413 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f752441-4617-45ff-9b2b-0d3b8aea4259 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62401c8e1457450590f4147e0665265a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:23:05.389146 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f752441-4617-45ff-9b2b-0d3b8aea4259 service nova] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:23:05.389497 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f752441-4617-45ff-9b2b-0d3b8aea4259 service nova] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:23:05.389780 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f752441-4617-45ff-9b2b-0d3b8aea4259 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:23:05.391683 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-0f752441-4617-45ff-9b2b-0d3b8aea4259 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:23:05.496448 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f752441-4617-45ff-9b2b-0d3b8aea4259 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:23:05.498175 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f752441-4617-45ff-9b2b-0d3b8aea4259 service nova] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:23:05.513774 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:23:05.524115 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 705/1409] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:23:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:23:14.718214 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=39 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:23:15.520481 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=1 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:23:19.944531 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8837ea0-b556-4b64-9e87-690afe263021 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:23:19.945084 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8837ea0-b556-4b64-9e87-690afe263021 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:23:19.945084 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8837ea0-b556-4b64-9e87-690afe263021 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:23:19.946397 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 705/1410] 10.222.0.79 () {54 vars in 918 bytes} [Wed Aug 31 12:23:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:23:19.952254 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc52c975-7d84-475e-a241-9b826d2acd0b None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:23:19.952795 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc52c975-7d84-475e-a241-9b826d2acd0b None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:23:19.952795 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc52c975-7d84-475e-a241-9b826d2acd0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:23:20.030378 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-dc52c975-7d84-475e-a241-9b826d2acd0b None None] MFA Rules not processed for user `b6deab40ae6244d4b9affa47b274aea3`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:23:20.031623 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-dc52c975-7d84-475e-a241-9b826d2acd0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:23:20.147604 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 706/1411] 10.222.0.79 () {58 vars in 1015 bytes} [Wed Aug 31 12:23:19 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:23:20.163011 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6aa9a8-cefb-4460-855b-ccc3e3e61f72 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:23:20.163298 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6aa9a8-cefb-4460-855b-ccc3e3e61f72 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:23:20.163574 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6aa9a8-cefb-4460-855b-ccc3e3e61f72 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:23:20.164922 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 706/1412] 10.222.0.79 () {54 vars in 918 bytes} [Wed Aug 31 12:23:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:23:20.170778 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98e8c6-5ee0-4cee-a508-78fea076bc7d None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:23:20.171292 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98e8c6-5ee0-4cee-a508-78fea076bc7d None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:23:20.171769 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98e8c6-5ee0-4cee-a508-78fea076bc7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:23:20.251683 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:23:20.255390 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-2a98e8c6-5ee0-4cee-a508-78fea076bc7d None None] MFA Rules not processed for user `62401c8e1457450590f4147e0665265a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:23:20.257162 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-2a98e8c6-5ee0-4cee-a508-78fea076bc7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:23:20.379081 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 707/1413] 10.222.0.79 () {58 vars in 1015 bytes} [Wed Aug 31 12:23:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:23:22.843714 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4bf60f-202b-48eb-9dbe-163ccefba01e None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:23:22.844285 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4bf60f-202b-48eb-9dbe-163ccefba01e None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:23:22.844285 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4bf60f-202b-48eb-9dbe-163ccefba01e None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:23:22.845892 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 707/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 12:23:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:23:22.851923 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37920e9-d78b-40bb-be21-e87592f427b6 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:23:22.852394 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37920e9-d78b-40bb-be21-e87592f427b6 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:23:22.852491 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37920e9-d78b-40bb-be21-e87592f427b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:23:22.921186 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-a37920e9-d78b-40bb-be21-e87592f427b6 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:23:22.922395 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-a37920e9-d78b-40bb-be21-e87592f427b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:23:22.981892 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:23:23.029530 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 708/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 12:23:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:23:23.324959 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4bf60f-202b-48eb-9dbe-163ccefba01e None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:23:23.326490 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-7b4bf60f-202b-48eb-9dbe-163ccefba01e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:23:23.482171 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4bf60f-202b-48eb-9dbe-163ccefba01e None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:23:23.561026 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:23:23.601258 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb8b8e3-2ee8-4ad6-be81-2175ce515b72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62401c8e1457450590f4147e0665265a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:23:23.601860 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb8b8e3-2ee8-4ad6-be81-2175ce515b72 service nova] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:23:23.602132 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb8b8e3-2ee8-4ad6-be81-2175ce515b72 service nova] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:23:23.602398 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb8b8e3-2ee8-4ad6-be81-2175ce515b72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:23:23.604026 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-dbb8b8e3-2ee8-4ad6-be81-2175ce515b72 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:23:23.692603 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb8b8e3-2ee8-4ad6-be81-2175ce515b72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:23:23.694221 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb8b8e3-2ee8-4ad6-be81-2175ce515b72 service nova] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:23:23.714077 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 708/1416] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:23:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:23:24.634624 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4a2f9f-b93f-46d5-9a48-1896ed4d2998 None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:23:24.635208 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4a2f9f-b93f-46d5-9a48-1896ed4d2998 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:23:24.635208 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4a2f9f-b93f-46d5-9a48-1896ed4d2998 None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:23:24.636613 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 709/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 12:23:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:23:24.641842 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc1dbac-4619-4a77-8691-d927ec187184 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:23:24.642295 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc1dbac-4619-4a77-8691-d927ec187184 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:23:24.642401 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc1dbac-4619-4a77-8691-d927ec187184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:23:24.731942 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-9dc1dbac-4619-4a77-8691-d927ec187184 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:23:24.733066 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-9dc1dbac-4619-4a77-8691-d927ec187184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:23:24.761308 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:23:24.842118 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 709/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 12:23:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:23:24.994365 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4a2f9f-b93f-46d5-9a48-1896ed4d2998 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:23:24.995856 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-0b4a2f9f-b93f-46d5-9a48-1896ed4d2998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:23:25.157951 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4a2f9f-b93f-46d5-9a48-1896ed4d2998 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:23:25.199206 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:23:25.274911 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75961d6-1538-4497-a131-ecee2615548d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62401c8e1457450590f4147e0665265a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:23:25.275528 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75961d6-1538-4497-a131-ecee2615548d service nova] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:23:25.275857 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75961d6-1538-4497-a131-ecee2615548d service nova] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:23:25.276071 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75961d6-1538-4497-a131-ecee2615548d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:23:25.277701 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-f75961d6-1538-4497-a131-ecee2615548d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:23:25.374367 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75961d6-1538-4497-a131-ecee2615548d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:23:25.376035 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75961d6-1538-4497-a131-ecee2615548d service nova] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:23:25.395456 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 710/1419] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:23:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:23:26.305798 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c7770-aa2e-40ba-9928-6e40f13ff65d None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:23:26.306403 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c7770-aa2e-40ba-9928-6e40f13ff65d None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:23:26.306403 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c7770-aa2e-40ba-9928-6e40f13ff65d None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:23:26.307748 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 710/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 12:23:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:23:26.312592 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d5e97-cce0-4483-b7a2-223b6b41f523 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:23:26.313042 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d5e97-cce0-4483-b7a2-223b6b41f523 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:23:26.313154 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d5e97-cce0-4483-b7a2-223b6b41f523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:23:26.369658 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:23:26.393104 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-e45d5e97-cce0-4483-b7a2-223b6b41f523 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:23:26.395109 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-e45d5e97-cce0-4483-b7a2-223b6b41f523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:23:26.494481 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 711/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 12:23:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:23:26.649158 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8c7770-aa2e-40ba-9928-6e40f13ff65d None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:23:26.650590 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-5f8c7770-aa2e-40ba-9928-6e40f13ff65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:23:26.805723 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8c7770-aa2e-40ba-9928-6e40f13ff65d None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:23:26.818574 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:23:26.927918 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc4cbe8-2291-4286-b818-473569b8a329 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62401c8e1457450590f4147e0665265a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:23:26.928444 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4cbe8-2291-4286-b818-473569b8a329 service nova] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:23:26.928737 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4cbe8-2291-4286-b818-473569b8a329 service nova] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:23:26.928990 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4cbe8-2291-4286-b818-473569b8a329 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:23:26.930636 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-2cc4cbe8-2291-4286-b818-473569b8a329 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:23:27.024573 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc4cbe8-2291-4286-b818-473569b8a329 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:23:27.026179 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc4cbe8-2291-4286-b818-473569b8a329 service nova] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:23:27.047108 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 711/1422] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:23:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:23:27.959328 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a9ff8b-1942-48c2-8fa5-cf26a07c3fba None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:23:27.959912 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a9ff8b-1942-48c2-8fa5-cf26a07c3fba None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:23:27.960034 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a9ff8b-1942-48c2-8fa5-cf26a07c3fba None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:23:27.961442 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 712/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 12:23:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:23:27.966565 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db91bd3-2eb6-4a67-a215-9068e7a86005 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:23:27.967034 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db91bd3-2eb6-4a67-a215-9068e7a86005 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:23:27.967139 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db91bd3-2eb6-4a67-a215-9068e7a86005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:23:27.988907 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:23:28.050820 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-4db91bd3-2eb6-4a67-a215-9068e7a86005 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:23:28.052101 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-4db91bd3-2eb6-4a67-a215-9068e7a86005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:23:28.157492 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 712/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 12:23:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:23:28.311598 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a9ff8b-1942-48c2-8fa5-cf26a07c3fba None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:23:28.313317 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-a9a9ff8b-1942-48c2-8fa5-cf26a07c3fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:23:28.427362 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:23:28.467763 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a9ff8b-1942-48c2-8fa5-cf26a07c3fba None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:23:28.601018 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d15258-2d98-4652-a3e1-b27a87816c70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62401c8e1457450590f4147e0665265a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:23:28.601545 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d15258-2d98-4652-a3e1-b27a87816c70 service nova] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:23:28.601881 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d15258-2d98-4652-a3e1-b27a87816c70 service nova] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:23:28.602102 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d15258-2d98-4652-a3e1-b27a87816c70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:23:28.603763 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-d6d15258-2d98-4652-a3e1-b27a87816c70 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:23:28.687681 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:23:28.702246 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d15258-2d98-4652-a3e1-b27a87816c70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:23:28.703902 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d15258-2d98-4652-a3e1-b27a87816c70 service nova] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:23:28.724574 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 713/1425] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:23:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:23:29.607836 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a0246-a332-48f7-8623-712f0deb4793 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:23:29.608528 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a0246-a332-48f7-8623-712f0deb4793 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:23:29.608528 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a0246-a332-48f7-8623-712f0deb4793 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:23:29.609732 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 713/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 12:23:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:23:29.615598 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b674b6-86cb-4214-b57e-b1eed6420bc4 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:23:29.616127 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b674b6-86cb-4214-b57e-b1eed6420bc4 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:23:29.616280 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b674b6-86cb-4214-b57e-b1eed6420bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:23:29.695776 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-73b674b6-86cb-4214-b57e-b1eed6420bc4 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:23:29.696921 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-73b674b6-86cb-4214-b57e-b1eed6420bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:23:29.798374 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 714/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 12:23:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:23:29.948702 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1a0246-a332-48f7-8623-712f0deb4793 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:23:29.950101 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-cc1a0246-a332-48f7-8623-712f0deb4793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:23:30.038284 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:23:30.114615 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1a0246-a332-48f7-8623-712f0deb4793 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:23:30.228937 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f6c82-d57e-4099-8745-bc95be900325 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62401c8e1457450590f4147e0665265a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:23:30.229445 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f6c82-d57e-4099-8745-bc95be900325 service nova] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:23:30.229720 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f6c82-d57e-4099-8745-bc95be900325 service nova] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:23:30.229988 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f6c82-d57e-4099-8745-bc95be900325 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:23:30.231621 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-2b5f6c82-d57e-4099-8745-bc95be900325 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:23:30.281284 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:23:30.323848 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5f6c82-d57e-4099-8745-bc95be900325 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:23:30.325455 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5f6c82-d57e-4099-8745-bc95be900325 service nova] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:23:30.347386 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 714/1428] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:23:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:23:31.164046 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbfada3-5191-408b-86cc-f0633622fcb9 None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:23:31.164615 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbfada3-5191-408b-86cc-f0633622fcb9 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:23:31.164615 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbfada3-5191-408b-86cc-f0633622fcb9 None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:23:31.165933 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 715/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 12:23:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:23:31.171187 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40322d3-3b0a-4d39-b84f-330c75752729 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:23:31.171690 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40322d3-3b0a-4d39-b84f-330c75752729 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:23:31.171800 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40322d3-3b0a-4d39-b84f-330c75752729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:23:31.251020 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-e40322d3-3b0a-4d39-b84f-330c75752729 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:23:31.252248 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-e40322d3-3b0a-4d39-b84f-330c75752729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:23:31.357937 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 715/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 12:23:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:23:31.510526 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbfada3-5191-408b-86cc-f0633622fcb9 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:23:31.512182 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-abbfada3-5191-408b-86cc-f0633622fcb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:23:31.564267 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:23:31.665434 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbfada3-5191-408b-86cc-f0633622fcb9 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:23:31.794435 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b93659f-789a-4855-849b-ffbb85f8479a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62401c8e1457450590f4147e0665265a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:23:31.795094 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b93659f-789a-4855-849b-ffbb85f8479a service nova] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:23:31.795378 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b93659f-789a-4855-849b-ffbb85f8479a service nova] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:23:31.795659 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b93659f-789a-4855-849b-ffbb85f8479a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:23:31.797358 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-5b93659f-789a-4855-849b-ffbb85f8479a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:23:31.805689 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:23:31.896834 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b93659f-789a-4855-849b-ffbb85f8479a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:23:31.898375 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b93659f-789a-4855-849b-ffbb85f8479a service nova] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:23:31.917327 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 716/1431] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:23:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:23:32.737273 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a9649-0ec3-4522-894d-7fb7659861fc None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:23:32.737806 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a9649-0ec3-4522-894d-7fb7659861fc None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:23:32.737972 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a9649-0ec3-4522-894d-7fb7659861fc None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:23:32.739548 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 716/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 12:23:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:23:32.744859 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6dd6f-9c20-47f4-914a-59d3f2cc02c3 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:23:32.745350 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6dd6f-9c20-47f4-914a-59d3f2cc02c3 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:23:32.745463 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6dd6f-9c20-47f4-914a-59d3f2cc02c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:23:32.827370 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-ddf6dd6f-9c20-47f4-914a-59d3f2cc02c3 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:23:32.828619 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-ddf6dd6f-9c20-47f4-914a-59d3f2cc02c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:23:32.903294 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:23:32.933497 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 717/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 12:23:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:23:33.087110 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a9649-0ec3-4522-894d-7fb7659861fc None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:23:33.088618 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-a53a9649-0ec3-4522-894d-7fb7659861fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:23:33.106411 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:23:33.242216 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a9649-0ec3-4522-894d-7fb7659861fc None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:23:33.331698 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:23:33.360620 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c3c488-fbbd-4035-ab76-51115518a3a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62401c8e1457450590f4147e0665265a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:23:33.361247 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c3c488-fbbd-4035-ab76-51115518a3a4 service nova] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:23:33.361525 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c3c488-fbbd-4035-ab76-51115518a3a4 service nova] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:23:33.361794 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c3c488-fbbd-4035-ab76-51115518a3a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:23:33.363469 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-72c3c488-fbbd-4035-ab76-51115518a3a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:23:33.453967 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c3c488-fbbd-4035-ab76-51115518a3a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:23:33.455619 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c3c488-fbbd-4035-ab76-51115518a3a4 service nova] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:23:33.473991 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 717/1434] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:23:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:23:34.293924 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19641321-0d9b-4433-b55a-2962a6695e3b None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:23:34.294514 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19641321-0d9b-4433-b55a-2962a6695e3b None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:23:34.294514 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19641321-0d9b-4433-b55a-2962a6695e3b None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:23:34.295890 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 718/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 12:23:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:23:34.301114 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2cfc05-bb67-4511-806a-218f9c58e72c None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:23:34.301688 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2cfc05-bb67-4511-806a-218f9c58e72c None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:23:34.301688 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2cfc05-bb67-4511-806a-218f9c58e72c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:23:34.383549 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-8f2cfc05-bb67-4511-806a-218f9c58e72c None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:23:34.384800 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-8f2cfc05-bb67-4511-806a-218f9c58e72c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:23:34.431761 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:23:34.492583 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 718/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 12:23:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:23:34.646974 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19641321-0d9b-4433-b55a-2962a6695e3b None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:23:34.648398 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-19641321-0d9b-4433-b55a-2962a6695e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:23:34.803090 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19641321-0d9b-4433-b55a-2962a6695e3b None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:23:34.872942 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:23:34.952066 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc809914-385d-4352-bb85-e18f4f8704bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62401c8e1457450590f4147e0665265a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:23:34.952602 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc809914-385d-4352-bb85-e18f4f8704bc service nova] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:23:34.952881 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc809914-385d-4352-bb85-e18f4f8704bc service nova] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:23:34.953151 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc809914-385d-4352-bb85-e18f4f8704bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:23:34.954905 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-fc809914-385d-4352-bb85-e18f4f8704bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:23:35.062638 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc809914-385d-4352-bb85-e18f4f8704bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:23:35.064320 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc809914-385d-4352-bb85-e18f4f8704bc service nova] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:23:35.085563 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 719/1437] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:23:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:23:35.906740 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3643d9aa-74f0-471e-9975-6f1b55e44ad1 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:23:35.907360 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3643d9aa-74f0-471e-9975-6f1b55e44ad1 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:23:35.907360 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3643d9aa-74f0-471e-9975-6f1b55e44ad1 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:23:35.908674 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 719/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 12:23:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:23:35.914671 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a10e5-0643-49cc-94a2-300c67c43aa3 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:23:35.915238 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a10e5-0643-49cc-94a2-300c67c43aa3 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:23:35.915238 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a10e5-0643-49cc-94a2-300c67c43aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:23:35.993547 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-788a10e5-0643-49cc-94a2-300c67c43aa3 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:23:35.994770 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-788a10e5-0643-49cc-94a2-300c67c43aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:23:35.996856 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:23:36.096449 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 720/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 12:23:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:23:36.248764 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3643d9aa-74f0-471e-9975-6f1b55e44ad1 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:23:36.250196 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-3643d9aa-74f0-471e-9975-6f1b55e44ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:23:36.405178 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3643d9aa-74f0-471e-9975-6f1b55e44ad1 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:23:36.433363 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:23:36.525103 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7363812-9afd-455d-a9be-7a9e0a69de83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62401c8e1457450590f4147e0665265a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:23:36.525717 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7363812-9afd-455d-a9be-7a9e0a69de83 service nova] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:23:36.525988 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7363812-9afd-455d-a9be-7a9e0a69de83 service nova] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:23:36.526435 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7363812-9afd-455d-a9be-7a9e0a69de83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:23:36.528577 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-a7363812-9afd-455d-a9be-7a9e0a69de83 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:23:36.624044 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7363812-9afd-455d-a9be-7a9e0a69de83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:23:36.625680 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7363812-9afd-455d-a9be-7a9e0a69de83 service nova] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:23:36.645962 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 720/1440] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:23:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:23:38.492279 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc49bb4-5461-4bfd-aa94-ec6bc2936a71 None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:23:38.492819 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc49bb4-5461-4bfd-aa94-ec6bc2936a71 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:23:38.492819 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc49bb4-5461-4bfd-aa94-ec6bc2936a71 None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:23:38.494179 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 721/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 12:23:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:23:38.499451 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd6049b-1814-4946-90a4-5b689da3fa7b None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:23:38.499901 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd6049b-1814-4946-90a4-5b689da3fa7b None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:23:38.500001 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd6049b-1814-4946-90a4-5b689da3fa7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:23:38.546021 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:23:38.574234 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-2fd6049b-1814-4946-90a4-5b689da3fa7b None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:23:38.575511 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-2fd6049b-1814-4946-90a4-5b689da3fa7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:23:38.677264 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 721/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 12:23:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:23:38.964933 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc49bb4-5461-4bfd-aa94-ec6bc2936a71 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:23:38.966514 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-7cc49bb4-5461-4bfd-aa94-ec6bc2936a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:23:39.073261 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc49bb4-5461-4bfd-aa94-ec6bc2936a71 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:23:39.106839 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:23:39.151284 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62838b9a-1c2f-4dea-ad05-c28b2523fa0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:23:39.151905 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62838b9a-1c2f-4dea-ad05-c28b2523fa0b service neutron] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:23:39.152187 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62838b9a-1c2f-4dea-ad05-c28b2523fa0b service neutron] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:23:39.152460 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62838b9a-1c2f-4dea-ad05-c28b2523fa0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:23:39.154083 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-62838b9a-1c2f-4dea-ad05-c28b2523fa0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:23:39.266396 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62838b9a-1c2f-4dea-ad05-c28b2523fa0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:23:39.267896 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62838b9a-1c2f-4dea-ad05-c28b2523fa0b service neutron] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:23:39.287504 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 722/1443] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:23:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:23:41.399951 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da53f3b-4555-4cf3-a209-c1ab52e0c019 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:23:41.400535 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da53f3b-4555-4cf3-a209-c1ab52e0c019 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:23:41.400535 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da53f3b-4555-4cf3-a209-c1ab52e0c019 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:23:41.401858 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 722/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 12:23:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:23:41.407380 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d46ba6-f733-4816-8a89-dddf8cca062e None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:23:41.407814 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d46ba6-f733-4816-8a89-dddf8cca062e None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:23:41.408111 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d46ba6-f733-4816-8a89-dddf8cca062e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:23:41.476884 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-69d46ba6-f733-4816-8a89-dddf8cca062e None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:23:41.478161 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-69d46ba6-f733-4816-8a89-dddf8cca062e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:23:41.491675 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:23:41.583186 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 723/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 12:23:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:23:41.867816 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da53f3b-4555-4cf3-a209-c1ab52e0c019 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:23:41.869377 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-3da53f3b-4555-4cf3-a209-c1ab52e0c019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:23:41.973150 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da53f3b-4555-4cf3-a209-c1ab52e0c019 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:23:41.985342 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:23:42.047674 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ea7ce5-e136-47e6-80cc-62db33514e75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:23:42.048286 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea7ce5-e136-47e6-80cc-62db33514e75 service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:23:42.048564 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea7ce5-e136-47e6-80cc-62db33514e75 service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:23:42.048839 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea7ce5-e136-47e6-80cc-62db33514e75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:23:42.050623 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-64ea7ce5-e136-47e6-80cc-62db33514e75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:23:42.163133 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ea7ce5-e136-47e6-80cc-62db33514e75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:23:42.164514 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ea7ce5-e136-47e6-80cc-62db33514e75 service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:23:42.182927 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 723/1446] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:23:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:23:44.448133 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13a17eb-cd30-4be2-b463-417418bb5a8f None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:23:44.448596 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13a17eb-cd30-4be2-b463-417418bb5a8f None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:23:44.448701 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13a17eb-cd30-4be2-b463-417418bb5a8f None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:23:44.450102 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 724/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 12:23:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:23:44.455662 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af614b-2d04-4fb7-9d3b-59bc9c0c8a94 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:23:44.456668 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af614b-2d04-4fb7-9d3b-59bc9c0c8a94 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:23:44.456829 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af614b-2d04-4fb7-9d3b-59bc9c0c8a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:23:44.507093 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:23:44.525578 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-67af614b-2d04-4fb7-9d3b-59bc9c0c8a94 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:23:44.526808 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-67af614b-2d04-4fb7-9d3b-59bc9c0c8a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:23:44.625717 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 724/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 12:23:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:23:44.923602 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13a17eb-cd30-4be2-b463-417418bb5a8f None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:23:44.925719 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-a13a17eb-cd30-4be2-b463-417418bb5a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:23:45.031428 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13a17eb-cd30-4be2-b463-417418bb5a8f None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:23:45.072717 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:23:45.108467 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22ac9bd-b57e-49df-afb3-6d843be7d776 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:23:45.109075 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ac9bd-b57e-49df-afb3-6d843be7d776 service neutron] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:23:45.109354 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ac9bd-b57e-49df-afb3-6d843be7d776 service neutron] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:23:45.109628 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ac9bd-b57e-49df-afb3-6d843be7d776 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:23:45.111268 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-f22ac9bd-b57e-49df-afb3-6d843be7d776 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:23:45.224222 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22ac9bd-b57e-49df-afb3-6d843be7d776 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:23:45.225579 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22ac9bd-b57e-49df-afb3-6d843be7d776 service neutron] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:23:45.244435 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 725/1449] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:23:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:23:47.322598 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ee243-88d9-4f1f-ab30-472a7550bcfb None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:23:47.323198 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ee243-88d9-4f1f-ab30-472a7550bcfb None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:23:47.323198 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ee243-88d9-4f1f-ab30-472a7550bcfb None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:23:47.324440 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 725/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 12:23:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:23:47.329676 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba3c23-8fa2-49b2-8f5e-58491f3c2616 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:23:47.330116 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba3c23-8fa2-49b2-8f5e-58491f3c2616 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:23:47.330249 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba3c23-8fa2-49b2-8f5e-58491f3c2616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:23:47.404516 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-baba3c23-8fa2-49b2-8f5e-58491f3c2616 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:23:47.405860 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-baba3c23-8fa2-49b2-8f5e-58491f3c2616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:23:47.427667 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:23:47.508458 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 726/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 12:23:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:23:47.797832 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ee243-88d9-4f1f-ab30-472a7550bcfb None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:23:47.799608 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-bc0ee243-88d9-4f1f-ab30-472a7550bcfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:23:47.909998 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ee243-88d9-4f1f-ab30-472a7550bcfb None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:23:47.931397 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:23:47.995344 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af126aea-d452-4415-8400-474909345cfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:23:47.995878 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af126aea-d452-4415-8400-474909345cfa service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:23:47.996155 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af126aea-d452-4415-8400-474909345cfa service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:23:47.996425 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af126aea-d452-4415-8400-474909345cfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:23:47.998049 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-af126aea-d452-4415-8400-474909345cfa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:23:48.110708 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af126aea-d452-4415-8400-474909345cfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:23:48.112091 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af126aea-d452-4415-8400-474909345cfa service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:23:48.131159 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 726/1452] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:23:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:23:50.138059 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00f3fa-2701-495d-b470-d5c9adeadc93 None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:23:50.138626 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00f3fa-2701-495d-b470-d5c9adeadc93 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:23:50.138626 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00f3fa-2701-495d-b470-d5c9adeadc93 None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:23:50.139988 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 727/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 12:23:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:23:50.145779 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe57d1d-24f7-42d0-878f-58044e522afe None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:23:50.146223 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe57d1d-24f7-42d0-878f-58044e522afe None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:23:50.146339 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe57d1d-24f7-42d0-878f-58044e522afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:23:50.212789 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:23:50.215644 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-dbe57d1d-24f7-42d0-878f-58044e522afe None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:23:50.217403 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-dbe57d1d-24f7-42d0-878f-58044e522afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:23:50.316417 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 727/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 12:23:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:23:50.607475 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d00f3fa-2701-495d-b470-d5c9adeadc93 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:23:50.609009 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-7d00f3fa-2701-495d-b470-d5c9adeadc93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:23:50.715571 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d00f3fa-2701-495d-b470-d5c9adeadc93 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:23:50.767205 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:23:50.793961 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ff34f-1867-4b01-977f-6a7089cea96c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:23:50.794568 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ff34f-1867-4b01-977f-6a7089cea96c service neutron] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:23:50.794845 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ff34f-1867-4b01-977f-6a7089cea96c service neutron] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:23:50.795169 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ff34f-1867-4b01-977f-6a7089cea96c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:23:50.796758 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-505ff34f-1867-4b01-977f-6a7089cea96c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:23:50.909276 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ff34f-1867-4b01-977f-6a7089cea96c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:23:50.910720 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ff34f-1867-4b01-977f-6a7089cea96c service neutron] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:23:50.929579 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 728/1455] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:23:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:23:52.937171 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f19c3-02c8-4ad6-b5e5-b50963f8c401 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:23:52.937731 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f19c3-02c8-4ad6-b5e5-b50963f8c401 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:23:52.937731 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f19c3-02c8-4ad6-b5e5-b50963f8c401 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:23:52.939107 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 728/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 12:23:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:23:52.944824 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7212d5-1c34-4d5f-b67a-d9901727daea None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:23:52.945323 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7212d5-1c34-4d5f-b67a-d9901727daea None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:23:52.945428 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7212d5-1c34-4d5f-b67a-d9901727daea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:23:53.013348 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-5f7212d5-1c34-4d5f-b67a-d9901727daea None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:23:53.014582 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-5f7212d5-1c34-4d5f-b67a-d9901727daea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:23:53.046223 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:23:53.118634 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 729/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 12:23:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:23:53.405578 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f19c3-02c8-4ad6-b5e5-b50963f8c401 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:23:53.407178 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-7c6f19c3-02c8-4ad6-b5e5-b50963f8c401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:23:53.517971 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f19c3-02c8-4ad6-b5e5-b50963f8c401 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:23:53.551529 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:23:53.600800 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d08bfc-7c9c-47f3-9326-53a0f8a513c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:23:53.601443 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d08bfc-7c9c-47f3-9326-53a0f8a513c0 service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:23:53.601680 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d08bfc-7c9c-47f3-9326-53a0f8a513c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:23:53.601947 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d08bfc-7c9c-47f3-9326-53a0f8a513c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:23:53.603597 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-b4d08bfc-7c9c-47f3-9326-53a0f8a513c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:23:53.713982 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d08bfc-7c9c-47f3-9326-53a0f8a513c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:23:53.715371 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d08bfc-7c9c-47f3-9326-53a0f8a513c0 service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:23:53.733955 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 729/1458] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:23:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:23:55.751954 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad243c03-407f-4df9-8039-9f9a22701f1a None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:23:55.752526 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad243c03-407f-4df9-8039-9f9a22701f1a None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:23:55.752526 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad243c03-407f-4df9-8039-9f9a22701f1a None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:23:55.754136 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 730/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 12:23:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:23:55.760569 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9eef40-dabb-496d-b35c-dd62017ff32a None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:23:55.761036 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9eef40-dabb-496d-b35c-dd62017ff32a None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:23:55.761362 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9eef40-dabb-496d-b35c-dd62017ff32a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:23:55.847706 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-dc9eef40-dabb-496d-b35c-dd62017ff32a None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:23:55.848969 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-dc9eef40-dabb-496d-b35c-dd62017ff32a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:23:55.857571 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:23:55.960709 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 730/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 12:23:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:23:56.243254 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad243c03-407f-4df9-8039-9f9a22701f1a None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:23:56.246023 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-ad243c03-407f-4df9-8039-9f9a22701f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:23:56.355207 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad243c03-407f-4df9-8039-9f9a22701f1a None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:23:56.413620 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:23:56.433734 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35838f36-9370-4a97-ad5f-61f74bc8b253 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:23:56.434359 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35838f36-9370-4a97-ad5f-61f74bc8b253 service neutron] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:23:56.434646 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35838f36-9370-4a97-ad5f-61f74bc8b253 service neutron] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:23:56.434948 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35838f36-9370-4a97-ad5f-61f74bc8b253 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:23:56.436595 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-35838f36-9370-4a97-ad5f-61f74bc8b253 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:23:56.565900 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35838f36-9370-4a97-ad5f-61f74bc8b253 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:23:56.567381 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35838f36-9370-4a97-ad5f-61f74bc8b253 service neutron] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:23:56.588773 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 731/1461] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:23:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:23:58.620946 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b615d0ce-47c3-4b4b-9b41-c14c0ef5981f None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:23:58.621525 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b615d0ce-47c3-4b4b-9b41-c14c0ef5981f None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:23:58.621525 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b615d0ce-47c3-4b4b-9b41-c14c0ef5981f None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:23:58.622944 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 731/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 12:23:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:23:58.628321 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9e1c8f-5d52-4298-ba5e-1674436928e2 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:23:58.628789 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9e1c8f-5d52-4298-ba5e-1674436928e2 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:23:58.628904 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9e1c8f-5d52-4298-ba5e-1674436928e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:23:58.695987 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-fd9e1c8f-5d52-4298-ba5e-1674436928e2 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:23:58.697129 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-fd9e1c8f-5d52-4298-ba5e-1674436928e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:23:58.737148 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:23:58.802643 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 732/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 12:23:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:23:59.090551 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b615d0ce-47c3-4b4b-9b41-c14c0ef5981f None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:23:59.092161 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-b615d0ce-47c3-4b4b-9b41-c14c0ef5981f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:23:59.211864 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b615d0ce-47c3-4b4b-9b41-c14c0ef5981f None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:23:59.251448 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:23:59.290780 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3cd0c6-53ce-4299-870b-268bd827dc87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:23:59.291313 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3cd0c6-53ce-4299-870b-268bd827dc87 service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:23:59.291595 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3cd0c6-53ce-4299-870b-268bd827dc87 service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:23:59.291874 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3cd0c6-53ce-4299-870b-268bd827dc87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:23:59.293512 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-fc3cd0c6-53ce-4299-870b-268bd827dc87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:23:59.424345 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3cd0c6-53ce-4299-870b-268bd827dc87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:23:59.426652 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3cd0c6-53ce-4299-870b-268bd827dc87 service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:23:59.445910 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 732/1464] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:23:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:24:01.555142 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe68a2-75ff-4b2c-ba65-b987080a3a9a None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:24:01.555910 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe68a2-75ff-4b2c-ba65-b987080a3a9a None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:24:01.556070 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe68a2-75ff-4b2c-ba65-b987080a3a9a None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:24:01.557928 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 733/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 12:24:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:24:01.563992 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e5934-5950-4b22-a6ce-aebb079d32aa None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:24:01.564491 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e5934-5950-4b22-a6ce-aebb079d32aa None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:24:01.564594 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e5934-5950-4b22-a6ce-aebb079d32aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:24:01.669820 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-f62e5934-5950-4b22-a6ce-aebb079d32aa None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:24:01.671512 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-f62e5934-5950-4b22-a6ce-aebb079d32aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:24:01.698795 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:24:01.807284 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 733/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 12:24:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:24:02.112706 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafe68a2-75ff-4b2c-ba65-b987080a3a9a None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:24:02.114288 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-dafe68a2-75ff-4b2c-ba65-b987080a3a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:24:02.348100 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafe68a2-75ff-4b2c-ba65-b987080a3a9a None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:24:02.420869 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:24:02.429194 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cdda02-d456-4536-ba8f-9628226f9c9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:24:02.429831 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cdda02-d456-4536-ba8f-9628226f9c9b service neutron] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:24:02.430130 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cdda02-d456-4536-ba8f-9628226f9c9b service neutron] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:24:02.430396 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cdda02-d456-4536-ba8f-9628226f9c9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:24:02.432046 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-10cdda02-d456-4536-ba8f-9628226f9c9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:24:02.549375 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cdda02-d456-4536-ba8f-9628226f9c9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:24:02.551020 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cdda02-d456-4536-ba8f-9628226f9c9b service neutron] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:24:02.569637 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 734/1467] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:24:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:24:04.594069 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f99fb-e4db-427b-afe7-876038a9cf82 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:24:04.594623 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f99fb-e4db-427b-afe7-876038a9cf82 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:24:04.594623 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f99fb-e4db-427b-afe7-876038a9cf82 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:24:04.596304 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 734/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 12:24:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:24:04.602525 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98044dc4-0d90-4221-adee-4533a3f7725c None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:24:04.603030 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98044dc4-0d90-4221-adee-4533a3f7725c None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:24:04.603126 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98044dc4-0d90-4221-adee-4533a3f7725c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:24:04.671312 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-98044dc4-0d90-4221-adee-4533a3f7725c None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:24:04.672545 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-98044dc4-0d90-4221-adee-4533a3f7725c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:24:04.727228 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:24:04.778363 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 735/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 12:24:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:24:05.066834 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f99fb-e4db-427b-afe7-876038a9cf82 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:24:05.068380 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-e52f99fb-e4db-427b-afe7-876038a9cf82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:24:05.184752 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f99fb-e4db-427b-afe7-876038a9cf82 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:24:05.234893 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:24:05.263274 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c71d497-d302-4331-ad54-c65f11d7078e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:24:05.263883 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c71d497-d302-4331-ad54-c65f11d7078e service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:24:05.264163 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c71d497-d302-4331-ad54-c65f11d7078e service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:24:05.264455 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c71d497-d302-4331-ad54-c65f11d7078e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:24:05.266054 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-0c71d497-d302-4331-ad54-c65f11d7078e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:24:05.378557 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c71d497-d302-4331-ad54-c65f11d7078e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:24:05.379977 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c71d497-d302-4331-ad54-c65f11d7078e service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:24:05.398469 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 735/1470] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:24:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:24:14.776468 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=22 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:24:15.396166 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=66 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:24:25.711905 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd06cefa-bc52-4ca6-809c-5c1c6d455174 None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:24:25.712461 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd06cefa-bc52-4ca6-809c-5c1c6d455174 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:24:25.712461 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd06cefa-bc52-4ca6-809c-5c1c6d455174 None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:24:25.713725 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 736/1471] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:24:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:24:25.719141 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e953d931-28ef-41cd-bb33-8b1e965a14b5 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:24:25.719628 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e953d931-28ef-41cd-bb33-8b1e965a14b5 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:24:25.719740 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e953d931-28ef-41cd-bb33-8b1e965a14b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:24:25.790706 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-e953d931-28ef-41cd-bb33-8b1e965a14b5 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:24:25.791952 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-e953d931-28ef-41cd-bb33-8b1e965a14b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:24:26.016611 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 736/1472] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:24:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:24:26.319625 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c561c9c0-823d-42a6-b833-280a70f3561e None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:24:26.319910 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c561c9c0-823d-42a6-b833-280a70f3561e None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:24:26.320186 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c561c9c0-823d-42a6-b833-280a70f3561e None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:24:26.321581 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 737/1473] 10.222.0.79 () {54 vars in 967 bytes} [Wed Aug 31 12:24:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:24:26.326495 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f8a7a-fe4b-456c-99ef-03d5bdfc48af None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:24:26.326750 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f8a7a-fe4b-456c-99ef-03d5bdfc48af None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:24:26.327059 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f8a7a-fe4b-456c-99ef-03d5bdfc48af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:24:26.405365 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-1b5f8a7a-fe4b-456c-99ef-03d5bdfc48af None None] MFA Rules not processed for user `d8b3bb8f689b45b99ed43f672264a26d`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:24:26.406570 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-1b5f8a7a-fe4b-456c-99ef-03d5bdfc48af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:24:26.427018 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:24:26.487154 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 737/1474] 10.222.0.79 () {58 vars in 1064 bytes} [Wed Aug 31 12:24:26 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:24:26.494756 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c561c9c0-823d-42a6-b833-280a70f3561e None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:24:26.496317 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-c561c9c0-823d-42a6-b833-280a70f3561e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:24:26.601859 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c561c9c0-823d-42a6-b833-280a70f3561e None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:24:26.679208 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d175bd5a-e084-4fa2-b435-e26f9db037ee service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8b3bb8f689b45b99ed43f672264a26d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:24:26.679830 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d175bd5a-e084-4fa2-b435-e26f9db037ee service glance] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:24:26.680102 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d175bd5a-e084-4fa2-b435-e26f9db037ee service glance] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:24:26.680367 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d175bd5a-e084-4fa2-b435-e26f9db037ee service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:24:26.681985 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-d175bd5a-e084-4fa2-b435-e26f9db037ee service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:24:26.738562 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:24:26.798954 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d175bd5a-e084-4fa2-b435-e26f9db037ee service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:24:26.800467 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d175bd5a-e084-4fa2-b435-e26f9db037ee service glance] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:24:26.820296 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 738/1475] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:24:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:24:28.890163 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f00a790-085a-44f5-94a8-2820006f5e00 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:24:28.890814 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f00a790-085a-44f5-94a8-2820006f5e00 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:24:28.890814 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f00a790-085a-44f5-94a8-2820006f5e00 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:24:28.892086 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 738/1476] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:24:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:24:28.898130 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b0675-0ac3-4697-b2a4-156c961e7a63 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:24:28.898624 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b0675-0ac3-4697-b2a4-156c961e7a63 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:24:28.898722 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b0675-0ac3-4697-b2a4-156c961e7a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:24:28.968824 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-bc9b0675-0ac3-4697-b2a4-156c961e7a63 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:24:28.970061 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-bc9b0675-0ac3-4697-b2a4-156c961e7a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:24:29.069710 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 739/1477] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:24:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:24:29.344100 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f00a790-085a-44f5-94a8-2820006f5e00 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:24:29.345621 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-8f00a790-085a-44f5-94a8-2820006f5e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:24:29.473421 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f00a790-085a-44f5-94a8-2820006f5e00 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:24:29.523874 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:24:29.582551 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343d0a33-dce9-4e76-bca4-bb2c2de88479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:24:29.583231 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d0a33-dce9-4e76-bca4-bb2c2de88479 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:24:29.583514 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d0a33-dce9-4e76-bca4-bb2c2de88479 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:24:29.583798 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d0a33-dce9-4e76-bca4-bb2c2de88479 admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:24:29.584448 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343d0a33-dce9-4e76-bca4-bb2c2de88479 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:24:29.586181 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: WARNING py.warnings [None req-343d0a33-dce9-4e76-bca4-bb2c2de88479 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 12:24:29.586181 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: warnings.warn(msg) Aug 31 12:24:29.586181 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: Aug 31 12:24:29.587391 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343d0a33-dce9-4e76-bca4-bb2c2de88479 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:24:29.609045 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 739/1478] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 12:24:29 2022] GET /identity/v3/projects => generated 2553 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:24:31.576559 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbf2ebf-f761-435d-a540-b2b745730b89 None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:24:31.577157 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbf2ebf-f761-435d-a540-b2b745730b89 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:24:31.577157 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbf2ebf-f761-435d-a540-b2b745730b89 None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:24:31.578464 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 740/1479] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:24:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:24:31.583787 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc1d61-6f0d-4f90-9dac-b12ff5b693eb None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:24:31.584295 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc1d61-6f0d-4f90-9dac-b12ff5b693eb None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:24:31.584295 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc1d61-6f0d-4f90-9dac-b12ff5b693eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:24:31.652436 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-8efc1d61-6f0d-4f90-9dac-b12ff5b693eb None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:24:31.653668 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-8efc1d61-6f0d-4f90-9dac-b12ff5b693eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:24:31.749882 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 740/1480] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:24:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:24:32.043394 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbf2ebf-f761-435d-a540-b2b745730b89 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:24:32.044953 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-ccbf2ebf-f761-435d-a540-b2b745730b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:24:32.055132 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:24:32.193188 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbf2ebf-f761-435d-a540-b2b745730b89 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:24:32.275035 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:24:32.308272 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea57dfc2-e7f6-47a6-834c-170f3fc7c58b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62401c8e1457450590f4147e0665265a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:24:32.308798 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57dfc2-e7f6-47a6-834c-170f3fc7c58b service nova] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:24:32.309074 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57dfc2-e7f6-47a6-834c-170f3fc7c58b service nova] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:24:32.309349 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57dfc2-e7f6-47a6-834c-170f3fc7c58b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:24:32.310981 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-ea57dfc2-e7f6-47a6-834c-170f3fc7c58b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:24:32.402066 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea57dfc2-e7f6-47a6-834c-170f3fc7c58b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:24:32.403710 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea57dfc2-e7f6-47a6-834c-170f3fc7c58b service nova] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:24:32.423459 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 741/1481] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:24:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:24:34.604759 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f8dfc4-dcf1-4c41-9e01-e3aeac94e5ef None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:24:34.605332 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f8dfc4-dcf1-4c41-9e01-e3aeac94e5ef None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:24:34.605332 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f8dfc4-dcf1-4c41-9e01-e3aeac94e5ef None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:24:34.606656 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 741/1482] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:24:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:24:34.612561 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234445a-717f-42c9-8d91-edcb8f97c00a None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:24:34.612561 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234445a-717f-42c9-8d91-edcb8f97c00a None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:24:34.613196 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234445a-717f-42c9-8d91-edcb8f97c00a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:24:34.691612 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-1234445a-717f-42c9-8d91-edcb8f97c00a None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:24:34.692845 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-1234445a-717f-42c9-8d91-edcb8f97c00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:24:34.750124 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:24:34.811008 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 742/1483] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:24:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:24:35.104747 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f8dfc4-dcf1-4c41-9e01-e3aeac94e5ef None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:24:35.106241 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-37f8dfc4-dcf1-4c41-9e01-e3aeac94e5ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:24:35.132726 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:24:35.218792 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f8dfc4-dcf1-4c41-9e01-e3aeac94e5ef None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:24:35.301909 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99264aee-ff63-4e96-95b4-24d2dc06e83d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:24:35.302416 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99264aee-ff63-4e96-95b4-24d2dc06e83d service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:24:35.302694 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99264aee-ff63-4e96-95b4-24d2dc06e83d service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:24:35.302997 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99264aee-ff63-4e96-95b4-24d2dc06e83d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:24:35.304661 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-99264aee-ff63-4e96-95b4-24d2dc06e83d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:24:35.386250 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:24:35.426646 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99264aee-ff63-4e96-95b4-24d2dc06e83d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:24:35.428140 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99264aee-ff63-4e96-95b4-24d2dc06e83d service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:24:35.447083 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 742/1484] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:24:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:24:37.667422 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a39edf2-ac78-47dc-a6ea-c11b69a2b214 None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:24:37.668019 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a39edf2-ac78-47dc-a6ea-c11b69a2b214 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:24:37.668019 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a39edf2-ac78-47dc-a6ea-c11b69a2b214 None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:24:37.669308 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 743/1485] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:24:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:24:37.675664 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5466cd58-3656-4ff4-89db-21ed6b419ac3 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:24:37.676196 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5466cd58-3656-4ff4-89db-21ed6b419ac3 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:24:37.676196 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5466cd58-3656-4ff4-89db-21ed6b419ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:24:37.754883 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-5466cd58-3656-4ff4-89db-21ed6b419ac3 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:24:37.756483 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-5466cd58-3656-4ff4-89db-21ed6b419ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:24:37.878587 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 743/1486] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:24:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:24:38.173497 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a39edf2-ac78-47dc-a6ea-c11b69a2b214 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:24:38.175799 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-0a39edf2-ac78-47dc-a6ea-c11b69a2b214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:24:38.305703 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a39edf2-ac78-47dc-a6ea-c11b69a2b214 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:24:38.388918 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:24:38.391520 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b432ad15-a0e9-4d40-bc66-3ff28a57701e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:24:38.392400 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b432ad15-a0e9-4d40-bc66-3ff28a57701e service neutron] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:24:38.392741 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b432ad15-a0e9-4d40-bc66-3ff28a57701e service neutron] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:24:38.393708 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b432ad15-a0e9-4d40-bc66-3ff28a57701e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:24:38.395702 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-b432ad15-a0e9-4d40-bc66-3ff28a57701e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:24:38.532814 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b432ad15-a0e9-4d40-bc66-3ff28a57701e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:24:38.535620 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b432ad15-a0e9-4d40-bc66-3ff28a57701e service neutron] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:24:38.557767 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 744/1487] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:24:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:24:40.681366 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac48a3c3-0327-4f42-b356-07ffc7ce5c78 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:24:40.681913 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac48a3c3-0327-4f42-b356-07ffc7ce5c78 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:24:40.682006 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac48a3c3-0327-4f42-b356-07ffc7ce5c78 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:24:40.683354 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 744/1488] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:24:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:24:40.688685 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf58307f-baf5-4e25-b5cf-4e4b1380fffc None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:24:40.689143 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf58307f-baf5-4e25-b5cf-4e4b1380fffc None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:24:40.689252 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf58307f-baf5-4e25-b5cf-4e4b1380fffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:24:40.758566 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-cf58307f-baf5-4e25-b5cf-4e4b1380fffc None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:24:40.759735 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-cf58307f-baf5-4e25-b5cf-4e4b1380fffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:24:40.813665 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:24:40.859629 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 745/1489] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:24:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:24:41.152204 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac48a3c3-0327-4f42-b356-07ffc7ce5c78 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:24:41.153772 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-ac48a3c3-0327-4f42-b356-07ffc7ce5c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:24:41.189464 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:24:41.259750 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac48a3c3-0327-4f42-b356-07ffc7ce5c78 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:24:41.339080 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4a9f1d-2329-4c31-b82d-b30a5b67d57d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:24:41.339618 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a9f1d-2329-4c31-b82d-b30a5b67d57d service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:24:41.339890 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a9f1d-2329-4c31-b82d-b30a5b67d57d service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:24:41.340154 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a9f1d-2329-4c31-b82d-b30a5b67d57d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:24:41.341738 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-bf4a9f1d-2329-4c31-b82d-b30a5b67d57d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:24:41.432098 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:24:41.462544 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4a9f1d-2329-4c31-b82d-b30a5b67d57d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:24:41.464013 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4a9f1d-2329-4c31-b82d-b30a5b67d57d service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:24:41.482995 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 745/1490] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:24:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:24:43.732473 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c489baf7-9a7c-48fd-aff1-fcdeb24f8ed1 None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:24:43.733012 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c489baf7-9a7c-48fd-aff1-fcdeb24f8ed1 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:24:43.733012 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c489baf7-9a7c-48fd-aff1-fcdeb24f8ed1 None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:24:43.734306 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 746/1491] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 12:24:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:24:43.740447 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7caf8f0-7854-4bd5-a3a9-3e0741b00471 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:24:43.740946 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7caf8f0-7854-4bd5-a3a9-3e0741b00471 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:24:43.741065 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7caf8f0-7854-4bd5-a3a9-3e0741b00471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:24:43.809477 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-c7caf8f0-7854-4bd5-a3a9-3e0741b00471 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:24:43.810697 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-c7caf8f0-7854-4bd5-a3a9-3e0741b00471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:24:43.905585 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 746/1492] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 12:24:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:24:44.207278 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c489baf7-9a7c-48fd-aff1-fcdeb24f8ed1 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:24:44.208829 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-c489baf7-9a7c-48fd-aff1-fcdeb24f8ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:24:44.313893 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c489baf7-9a7c-48fd-aff1-fcdeb24f8ed1 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:24:44.387894 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02029c7-3c3c-478e-bd2f-6d775f541303 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:24:44.388507 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02029c7-3c3c-478e-bd2f-6d775f541303 service neutron] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:24:44.388787 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02029c7-3c3c-478e-bd2f-6d775f541303 service neutron] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:24:44.389059 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02029c7-3c3c-478e-bd2f-6d775f541303 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:24:44.390673 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-c02029c7-3c3c-478e-bd2f-6d775f541303 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:24:44.399996 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:24:44.503652 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02029c7-3c3c-478e-bd2f-6d775f541303 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:24:44.505022 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02029c7-3c3c-478e-bd2f-6d775f541303 service neutron] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:24:44.522819 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 747/1493] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:24:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:24:53.903817 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=82 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:24:54.520590 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=50 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:25:58.639928 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fae110-9ec0-4a47-a10f-c43b34ee3743 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:25:58.640651 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fae110-9ec0-4a47-a10f-c43b34ee3743 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:25:58.640651 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fae110-9ec0-4a47-a10f-c43b34ee3743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:25:58.719691 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-e8fae110-9ec0-4a47-a10f-c43b34ee3743 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:25:58.721520 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-e8fae110-9ec0-4a47-a10f-c43b34ee3743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:25:58.824112 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 747/1494] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:25:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:25:58.832496 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbad7dd-a116-4cf2-8c94-8cb2e01d6ec0 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:25:58.833068 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbad7dd-a116-4cf2-8c94-8cb2e01d6ec0 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:25:58.833068 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbad7dd-a116-4cf2-8c94-8cb2e01d6ec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:25:58.918485 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-6bbad7dd-a116-4cf2-8c94-8cb2e01d6ec0 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:25:58.919793 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-6bbad7dd-a116-4cf2-8c94-8cb2e01d6ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:25:59.027950 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 748/1495] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:25:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:25:59.032846 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fae110-9ec0-4a47-a10f-c43b34ee3743 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:25:59.034090 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-e8fae110-9ec0-4a47-a10f-c43b34ee3743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:25:59.045726 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fae110-9ec0-4a47-a10f-c43b34ee3743 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:25:59.114354 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:25:59.160775 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0bd048-e64e-4f98-9ac1-2ad20d8a3994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:25:59.161388 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0bd048-e64e-4f98-9ac1-2ad20d8a3994 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:25:59.161669 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0bd048-e64e-4f98-9ac1-2ad20d8a3994 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:25:59.161937 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0bd048-e64e-4f98-9ac1-2ad20d8a3994 admin admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:25:59.162590 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0bd048-e64e-4f98-9ac1-2ad20d8a3994 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:25:59.162914 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0bd048-e64e-4f98-9ac1-2ad20d8a3994 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:25:59.163939 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: WARNING py.warnings [None req-ff0bd048-e64e-4f98-9ac1-2ad20d8a3994 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 12:25:59.163939 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: warnings.warn(msg) Aug 31 12:25:59.163939 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: Aug 31 12:25:59.164827 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0bd048-e64e-4f98-9ac1-2ad20d8a3994 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:25:59.177035 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 748/1496] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 12:25:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:25:59.185543 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbad7dd-a116-4cf2-8c94-8cb2e01d6ec0 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:25:59.195589 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbad7dd-a116-4cf2-8c94-8cb2e01d6ec0 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:25:59.269161 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:25:59.310365 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4811504-4f7f-40b1-94f5-823ff5fc3b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:25:59.310936 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4811504-4f7f-40b1-94f5-823ff5fc3b93 admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:25:59.311220 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4811504-4f7f-40b1-94f5-823ff5fc3b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:25:59.311524 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4811504-4f7f-40b1-94f5-823ff5fc3b93 admin admin] PATH_INFO: `/v3/projects` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:25:59.312174 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4811504-4f7f-40b1-94f5-823ff5fc3b93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:25:59.313964 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: WARNING py.warnings [None req-a4811504-4f7f-40b1-94f5-823ff5fc3b93 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 12:25:59.313964 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: warnings.warn(msg) Aug 31 12:25:59.313964 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: Aug 31 12:25:59.316594 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4811504-4f7f-40b1-94f5-823ff5fc3b93 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:25:59.386207 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 749/1497] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:25:59 2022] POST /identity/v3/projects => generated 377 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:25:59.391651 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0bd048-e64e-4f98-9ac1-2ad20d8a3994 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:25:59.393949 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-ff0bd048-e64e-4f98-9ac1-2ad20d8a3994 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:25:59.431579 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0bd048-e64e-4f98-9ac1-2ad20d8a3994 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:25:59.534378 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0a831a-35b6-446e-a154-07226bbf202e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:25:59.535035 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a831a-35b6-446e-a154-07226bbf202e admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:25:59.535316 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a831a-35b6-446e-a154-07226bbf202e admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:25:59.535583 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a831a-35b6-446e-a154-07226bbf202e admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:25:59.536247 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0a831a-35b6-446e-a154-07226bbf202e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:25:59.537250 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: WARNING py.warnings [None req-3d0a831a-35b6-446e-a154-07226bbf202e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 12:25:59.537250 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: warnings.warn(msg) Aug 31 12:25:59.537250 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: Aug 31 12:25:59.538460 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0a831a-35b6-446e-a154-07226bbf202e admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:25:59.583929 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 749/1498] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:25:59 2022] POST /identity/v3/users => generated 289 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:25:59.588194 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4811504-4f7f-40b1-94f5-823ff5fc3b93 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:25:59.590516 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-a4811504-4f7f-40b1-94f5-823ff5fc3b93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:25:59.655709 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4811504-4f7f-40b1-94f5-823ff5fc3b93 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:25:59.753434 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:25:59.764932 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06a6bcf-d9c9-4272-9e5e-49c8a9b840d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:25:59.765779 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a6bcf-d9c9-4272-9e5e-49c8a9b840d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:25:59.766061 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a6bcf-d9c9-4272-9e5e-49c8a9b840d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:25:59.766333 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a6bcf-d9c9-4272-9e5e-49c8a9b840d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:25:59.767030 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06a6bcf-d9c9-4272-9e5e-49c8a9b840d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:25:59.768261 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: WARNING py.warnings [None req-e06a6bcf-d9c9-4272-9e5e-49c8a9b840d5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 12:25:59.768261 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: warnings.warn(msg) Aug 31 12:25:59.768261 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: Aug 31 12:25:59.769149 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06a6bcf-d9c9-4272-9e5e-49c8a9b840d5 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:25:59.782191 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 750/1499] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:25:59 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:25:59.786431 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0a831a-35b6-446e-a154-07226bbf202e admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:25:59.788029 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-3d0a831a-35b6-446e-a154-07226bbf202e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:25:59.800704 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0a831a-35b6-446e-a154-07226bbf202e admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:25:59.825971 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:25:59.902242 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851688cd-2f57-4205-b699-4485a4ba1271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:25:59.902749 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851688cd-2f57-4205-b699-4485a4ba1271 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:25:59.903053 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851688cd-2f57-4205-b699-4485a4ba1271 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:25:59.903324 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851688cd-2f57-4205-b699-4485a4ba1271 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:25:59.903970 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851688cd-2f57-4205-b699-4485a4ba1271 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:25:59.904997 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: WARNING py.warnings [None req-851688cd-2f57-4205-b699-4485a4ba1271 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 12:25:59.904997 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: warnings.warn(msg) Aug 31 12:25:59.904997 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: Aug 31 12:25:59.905884 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851688cd-2f57-4205-b699-4485a4ba1271 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:25:59.918569 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 750/1500] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:25:59 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:25:59.926001 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06a6bcf-d9c9-4272-9e5e-49c8a9b840d5 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:25:59.928854 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-e06a6bcf-d9c9-4272-9e5e-49c8a9b840d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:25:59.965561 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06a6bcf-d9c9-4272-9e5e-49c8a9b840d5 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:00.070354 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef03974-d31a-4da6-9941-f9f0c9db9d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:00.071056 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef03974-d31a-4da6-9941-f9f0c9db9d48 admin admin] REQUEST_METHOD: `PUT` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:00.071343 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef03974-d31a-4da6-9941-f9f0c9db9d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:00.071600 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef03974-d31a-4da6-9941-f9f0c9db9d48 admin admin] PATH_INFO: `/v3/projects/47a78702ea2443488481ef90070ae959/users/60f096aaaa9d4878a49059fc211dfc3d/roles/b5cfd7a855a448359e9017f51d32b6fc` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:00.095807 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef03974-d31a-4da6-9941-f9f0c9db9d48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47a78702ea2443488481ef90070ae959, user_id=60f096aaaa9d4878a49059fc211dfc3d, role_id=b5cfd7a855a448359e9017f51d32b6fc)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:00.097258 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: WARNING py.warnings [None req-cef03974-d31a-4da6-9941-f9f0c9db9d48 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 12:26:00.097258 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: warnings.warn(msg) Aug 31 12:26:00.097258 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: Aug 31 12:26:00.099676 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef03974-d31a-4da6-9941-f9f0c9db9d48 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:00.124614 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 751/1501] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:25:59 2022] PUT /identity/v3/projects/47a78702ea2443488481ef90070ae959/users/60f096aaaa9d4878a49059fc211dfc3d/roles/b5cfd7a855a448359e9017f51d32b6fc => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:26:00.138377 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07a7fd4-8d95-4616-9947-3dfb4e57aafc None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:00.138656 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07a7fd4-8d95-4616-9947-3dfb4e57aafc None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:00.139075 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07a7fd4-8d95-4616-9947-3dfb4e57aafc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:00.201722 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-b07a7fd4-8d95-4616-9947-3dfb4e57aafc None None] MFA Rules not processed for user `60f096aaaa9d4878a49059fc211dfc3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:26:00.202889 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-b07a7fd4-8d95-4616-9947-3dfb4e57aafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:00.286822 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 751/1502] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:26:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:26:00.300301 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b32c3-fe2f-455f-8de2-dc962bf01d2a None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:00.300588 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b32c3-fe2f-455f-8de2-dc962bf01d2a None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:00.300867 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b32c3-fe2f-455f-8de2-dc962bf01d2a None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:00.302229 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 752/1503] 10.222.0.79 () {54 vars in 964 bytes} [Wed Aug 31 12:26:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:26:00.307412 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a93524b-0475-444b-a22e-1b4685cef3a5 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:00.307696 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a93524b-0475-444b-a22e-1b4685cef3a5 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:00.307963 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a93524b-0475-444b-a22e-1b4685cef3a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:00.340565 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:26:00.386532 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-1a93524b-0475-444b-a22e-1b4685cef3a5 None None] MFA Rules not processed for user `e79503178ac54e62ba385467d5617ea1`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:26:00.387872 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-1a93524b-0475-444b-a22e-1b4685cef3a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:00.467816 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 752/1504] 10.222.0.79 () {58 vars in 1061 bytes} [Wed Aug 31 12:26:00 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:26:00.476049 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7b32c3-fe2f-455f-8de2-dc962bf01d2a None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:00.477550 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-db7b32c3-fe2f-455f-8de2-dc962bf01d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:00.529510 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:26:00.586794 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7b32c3-fe2f-455f-8de2-dc962bf01d2a None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:00.661107 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aceaa7f-1cbc-429a-b285-8df6d12062d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e79503178ac54e62ba385467d5617ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:00.661726 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aceaa7f-1cbc-429a-b285-8df6d12062d5 service cinder] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:00.662011 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aceaa7f-1cbc-429a-b285-8df6d12062d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:00.662287 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aceaa7f-1cbc-429a-b285-8df6d12062d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:00.663951 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-2aceaa7f-1cbc-429a-b285-8df6d12062d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:00.812533 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aceaa7f-1cbc-429a-b285-8df6d12062d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:00.813986 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aceaa7f-1cbc-429a-b285-8df6d12062d5 service cinder] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:00.818286 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:26:00.834211 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 753/1505] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:26:00 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:26:00.882627 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290b197-be1f-408b-b022-c4cae7f32714 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:00.883116 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290b197-be1f-408b-b022-c4cae7f32714 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:00.883390 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290b197-be1f-408b-b022-c4cae7f32714 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:00.884703 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 753/1506] 10.222.0.79 () {52 vars in 830 bytes} [Wed Aug 31 12:26:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:26:00.888790 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aceaa7f-1cbc-429a-b285-8df6d12062d5 service cinder] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:00.889992 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-2aceaa7f-1cbc-429a-b285-8df6d12062d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:00.993454 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aceaa7f-1cbc-429a-b285-8df6d12062d5 service cinder] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:01.100070 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53204360-9c72-4c2c-a1d3-8ac8706a5111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:01.100709 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53204360-9c72-4c2c-a1d3-8ac8706a5111 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:01.100985 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53204360-9c72-4c2c-a1d3-8ac8706a5111 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:01.101251 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53204360-9c72-4c2c-a1d3-8ac8706a5111 admin admin] PATH_INFO: `/v3/users/60f096aaaa9d4878a49059fc211dfc3d` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:01.114804 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53204360-9c72-4c2c-a1d3-8ac8706a5111 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60f096aaaa9d4878a49059fc211dfc3d)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:01.115874 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: WARNING py.warnings [None req-53204360-9c72-4c2c-a1d3-8ac8706a5111 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 12:26:01.115874 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: warnings.warn(msg) Aug 31 12:26:01.115874 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: Aug 31 12:26:01.117128 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53204360-9c72-4c2c-a1d3-8ac8706a5111 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:01.128587 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:26:01.186590 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-53204360-9c72-4c2c-a1d3-8ac8706a5111 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60f096aaaa9d4878a49059fc211dfc3d'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:01.210820 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-53204360-9c72-4c2c-a1d3-8ac8706a5111 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60f096aaaa9d4878a49059fc211dfc3d'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:01.224829 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-53204360-9c72-4c2c-a1d3-8ac8706a5111 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60f096aaaa9d4878a49059fc211dfc3d'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:01.225420 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-53204360-9c72-4c2c-a1d3-8ac8706a5111 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60f096aaaa9d4878a49059fc211dfc3d'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:01.235469 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-53204360-9c72-4c2c-a1d3-8ac8706a5111 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60f096aaaa9d4878a49059fc211dfc3d'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:01.242501 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 754/1507] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:26:00 2022] DELETE /identity/v3/users/60f096aaaa9d4878a49059fc211dfc3d => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:26:01.247126 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fed2c6-9651-4312-9ed8-f8ac8979f768 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:01.247408 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fed2c6-9651-4312-9ed8-f8ac8979f768 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:01.247706 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fed2c6-9651-4312-9ed8-f8ac8979f768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:01.314622 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-59fed2c6-9651-4312-9ed8-f8ac8979f768 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:26:01.316630 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-59fed2c6-9651-4312-9ed8-f8ac8979f768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:01.398448 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:26:01.411619 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 754/1508] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:26:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:26:01.421494 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53204360-9c72-4c2c-a1d3-8ac8706a5111 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:01.422733 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-53204360-9c72-4c2c-a1d3-8ac8706a5111 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:01.526844 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53204360-9c72-4c2c-a1d3-8ac8706a5111 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:01.587997 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:26:01.610921 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a148294-c798-4f62-8579-2a475e5a8cef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:01.612675 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a148294-c798-4f62-8579-2a475e5a8cef service neutron] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:01.612955 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a148294-c798-4f62-8579-2a475e5a8cef service neutron] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:01.613227 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a148294-c798-4f62-8579-2a475e5a8cef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:01.614893 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-4a148294-c798-4f62-8579-2a475e5a8cef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:01.729948 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a148294-c798-4f62-8579-2a475e5a8cef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:01.731349 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a148294-c798-4f62-8579-2a475e5a8cef service neutron] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:01.753436 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 755/1509] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:26:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:26:02.173151 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fed2c6-9651-4312-9ed8-f8ac8979f768 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:02.175673 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-59fed2c6-9651-4312-9ed8-f8ac8979f768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:02.192936 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fed2c6-9651-4312-9ed8-f8ac8979f768 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:02.310329 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de59b48-a6cb-4e5f-b7c5-170970a3f404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:02.311006 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de59b48-a6cb-4e5f-b7c5-170970a3f404 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:02.311287 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de59b48-a6cb-4e5f-b7c5-170970a3f404 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:02.311564 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de59b48-a6cb-4e5f-b7c5-170970a3f404 admin admin] PATH_INFO: `/v3/projects/47a78702ea2443488481ef90070ae959` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:02.325627 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de59b48-a6cb-4e5f-b7c5-170970a3f404 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47a78702ea2443488481ef90070ae959)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:02.326686 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: WARNING py.warnings [None req-9de59b48-a6cb-4e5f-b7c5-170970a3f404 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 12:26:02.326686 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: warnings.warn(msg) Aug 31 12:26:02.326686 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: Aug 31 12:26:02.329006 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de59b48-a6cb-4e5f-b7c5-170970a3f404 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:02.403397 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-9de59b48-a6cb-4e5f-b7c5-170970a3f404 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47a78702ea2443488481ef90070ae959', 'request_id': 'req-9de59b48-a6cb-4e5f-b7c5-170970a3f404'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:02.413077 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-9de59b48-a6cb-4e5f-b7c5-170970a3f404 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47a78702ea2443488481ef90070ae959', 'request_id': 'req-9de59b48-a6cb-4e5f-b7c5-170970a3f404'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:02.427857 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-9de59b48-a6cb-4e5f-b7c5-170970a3f404 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47a78702ea2443488481ef90070ae959', 'request_id': 'req-9de59b48-a6cb-4e5f-b7c5-170970a3f404'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:02.452690 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-9de59b48-a6cb-4e5f-b7c5-170970a3f404 admin admin] The token cache is being invalidate because project 47a78702ea2443488481ef90070ae959 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:26:02.452965 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-9de59b48-a6cb-4e5f-b7c5-170970a3f404 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:02.453501 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-9de59b48-a6cb-4e5f-b7c5-170970a3f404 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:02.454904 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 755/1510] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:26:02 2022] DELETE /identity/v3/projects/47a78702ea2443488481ef90070ae959 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:26:11.749609 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=62 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:26:12.450378 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:27:30.741581 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faca424-8710-47e6-a9db-dd8544f9b0d0 None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:27:30.742149 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faca424-8710-47e6-a9db-dd8544f9b0d0 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:27:30.742149 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faca424-8710-47e6-a9db-dd8544f9b0d0 None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:27:30.743483 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 756/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 12:27:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:27:30.748459 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee12098-9eac-48a9-b22c-9e851bd913e9 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:27:30.748911 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee12098-9eac-48a9-b22c-9e851bd913e9 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:27:30.749019 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee12098-9eac-48a9-b22c-9e851bd913e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:27:30.835347 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-dee12098-9eac-48a9-b22c-9e851bd913e9 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:27:30.836547 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-dee12098-9eac-48a9-b22c-9e851bd913e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:27:30.943736 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 756/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 12:27:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:27:31.096586 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faca424-8710-47e6-a9db-dd8544f9b0d0 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:27:31.098719 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-1faca424-8710-47e6-a9db-dd8544f9b0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:27:31.217407 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faca424-8710-47e6-a9db-dd8544f9b0d0 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:27:31.223390 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8af303-8193-4311-ba93-ca6e99d06d13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62401c8e1457450590f4147e0665265a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:27:31.224001 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8af303-8193-4311-ba93-ca6e99d06d13 service nova] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:27:31.224278 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8af303-8193-4311-ba93-ca6e99d06d13 service nova] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:27:31.224549 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8af303-8193-4311-ba93-ca6e99d06d13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:27:31.233563 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8af303-8193-4311-ba93-ca6e99d06d13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:27:31.235264 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8af303-8193-4311-ba93-ca6e99d06d13 service nova] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:27:31.246525 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 757/1513] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:27:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:27:32.120069 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc067571-a764-47db-9e68-4b03f3ebe30e None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:27:32.120604 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc067571-a764-47db-9e68-4b03f3ebe30e None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:27:32.120604 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc067571-a764-47db-9e68-4b03f3ebe30e None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:27:32.121948 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 757/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 12:27:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:27:32.126727 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0cb325-a70c-486c-a382-05283688f362 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:27:32.127222 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0cb325-a70c-486c-a382-05283688f362 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:27:32.127350 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0cb325-a70c-486c-a382-05283688f362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:27:32.147324 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-ef0cb325-a70c-486c-a382-05283688f362 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:27:32.148450 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-ef0cb325-a70c-486c-a382-05283688f362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:27:32.157178 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 758/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 12:27:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:27:32.310499 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc067571-a764-47db-9e68-4b03f3ebe30e None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:27:32.325183 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc067571-a764-47db-9e68-4b03f3ebe30e None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:27:32.330529 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa9b58a-eacf-4df1-a476-a26c106e549f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62401c8e1457450590f4147e0665265a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:27:32.331154 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9b58a-eacf-4df1-a476-a26c106e549f service nova] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:27:32.331432 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9b58a-eacf-4df1-a476-a26c106e549f service nova] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:27:32.331699 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9b58a-eacf-4df1-a476-a26c106e549f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:27:32.341173 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa9b58a-eacf-4df1-a476-a26c106e549f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:27:32.342997 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa9b58a-eacf-4df1-a476-a26c106e549f service nova] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:27:32.352623 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 758/1516] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:27:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:27:33.262251 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da804830-6cad-40b1-b87e-6430c31eb644 None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:27:33.262867 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da804830-6cad-40b1-b87e-6430c31eb644 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:27:33.262867 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da804830-6cad-40b1-b87e-6430c31eb644 None None] PATH_INFO: `/v3` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:27:33.264161 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 759/1517] 10.222.0.85 () {54 vars in 925 bytes} [Wed Aug 31 12:27:33 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:27:33.270600 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae003b-46b3-48a3-a909-ff9c4c4ae75a None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:27:33.271236 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae003b-46b3-48a3-a909-ff9c4c4ae75a None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:27:33.271236 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae003b-46b3-48a3-a909-ff9c4c4ae75a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:27:33.330322 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-43ae003b-46b3-48a3-a909-ff9c4c4ae75a None None] MFA Rules not processed for user `b6deab40ae6244d4b9affa47b274aea3`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:27:33.331571 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-43ae003b-46b3-48a3-a909-ff9c4c4ae75a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:27:33.348665 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:27:33.406546 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 759/1518] 10.222.0.85 () {58 vars in 1015 bytes} [Wed Aug 31 12:27:33 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:27:37.233114 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebd1679-bc42-4505-8cbb-7a262affd063 None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:27:37.233715 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebd1679-bc42-4505-8cbb-7a262affd063 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:27:37.233715 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebd1679-bc42-4505-8cbb-7a262affd063 None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:27:37.234928 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 760/1519] 10.222.0.79 () {54 vars in 961 bytes} [Wed Aug 31 12:27:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:27:37.240691 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb496c-3914-4873-9d23-0fb573ad772c None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:27:37.241223 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb496c-3914-4873-9d23-0fb573ad772c None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:27:37.241223 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb496c-3914-4873-9d23-0fb573ad772c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:27:37.262512 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-a1bb496c-3914-4873-9d23-0fb573ad772c None None] MFA Rules not processed for user `b6deab40ae6244d4b9affa47b274aea3`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:27:37.263774 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-a1bb496c-3914-4873-9d23-0fb573ad772c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:27:37.272422 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 760/1520] 10.222.0.79 () {58 vars in 1058 bytes} [Wed Aug 31 12:27:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:27:37.286083 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebd1679-bc42-4505-8cbb-7a262affd063 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:27:37.299830 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebd1679-bc42-4505-8cbb-7a262affd063 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:27:37.304961 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a936f2-b846-4d89-9f91-170526f75693 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6deab40ae6244d4b9affa47b274aea3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:27:37.305574 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a936f2-b846-4d89-9f91-170526f75693 service placement] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:27:37.305854 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a936f2-b846-4d89-9f91-170526f75693 service placement] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:27:37.306126 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a936f2-b846-4d89-9f91-170526f75693 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:27:37.315149 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a936f2-b846-4d89-9f91-170526f75693 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:27:37.316743 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a936f2-b846-4d89-9f91-170526f75693 service placement] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:27:37.327134 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 761/1521] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:27:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:27:43.591371 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1dd50-b4ea-481d-b0ca-6a60f90dee2b None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:27:43.591964 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1dd50-b4ea-481d-b0ca-6a60f90dee2b None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:27:43.591964 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1dd50-b4ea-481d-b0ca-6a60f90dee2b None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:27:43.593302 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 761/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 12:27:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:27:43.598635 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1bf558-4a35-42af-b93b-cde3a0ef8836 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:27:43.599296 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1bf558-4a35-42af-b93b-cde3a0ef8836 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:27:43.599413 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1bf558-4a35-42af-b93b-cde3a0ef8836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:27:43.619367 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-bb1bf558-4a35-42af-b93b-cde3a0ef8836 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:27:43.620606 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-bb1bf558-4a35-42af-b93b-cde3a0ef8836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:27:43.629269 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 762/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 12:27:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:27:43.787234 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d1dd50-b4ea-481d-b0ca-6a60f90dee2b None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:27:43.802398 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d1dd50-b4ea-481d-b0ca-6a60f90dee2b None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:27:43.807824 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9653fb6a-89e6-4063-ae77-54b3af5311bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62401c8e1457450590f4147e0665265a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:27:43.808430 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9653fb6a-89e6-4063-ae77-54b3af5311bf service nova] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:27:43.808707 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9653fb6a-89e6-4063-ae77-54b3af5311bf service nova] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:27:43.808975 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9653fb6a-89e6-4063-ae77-54b3af5311bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:27:43.818102 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9653fb6a-89e6-4063-ae77-54b3af5311bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:27:43.819721 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9653fb6a-89e6-4063-ae77-54b3af5311bf service nova] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:27:43.829248 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 762/1524] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:27:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:27:44.658355 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadbff2b-33c1-46d8-8cc9-0d18841acb96 None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:27:44.658916 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadbff2b-33c1-46d8-8cc9-0d18841acb96 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:27:44.658916 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadbff2b-33c1-46d8-8cc9-0d18841acb96 None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:27:44.660329 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 763/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 12:27:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:27:44.665246 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7a384d-10ad-4a85-8c1a-b6308e2c539b None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:27:44.665684 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7a384d-10ad-4a85-8c1a-b6308e2c539b None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:27:44.665811 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7a384d-10ad-4a85-8c1a-b6308e2c539b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:27:44.685449 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-cb7a384d-10ad-4a85-8c1a-b6308e2c539b None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:27:44.686661 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-cb7a384d-10ad-4a85-8c1a-b6308e2c539b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:27:44.694527 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 763/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 12:27:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:27:44.848944 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadbff2b-33c1-46d8-8cc9-0d18841acb96 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:27:44.863599 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadbff2b-33c1-46d8-8cc9-0d18841acb96 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:27:44.869053 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035bb494-2fbd-48e5-b327-b4c799e3da86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62401c8e1457450590f4147e0665265a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:27:44.869647 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035bb494-2fbd-48e5-b327-b4c799e3da86 service nova] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:27:44.869923 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035bb494-2fbd-48e5-b327-b4c799e3da86 service nova] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:27:44.870191 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035bb494-2fbd-48e5-b327-b4c799e3da86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:27:44.879002 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035bb494-2fbd-48e5-b327-b4c799e3da86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:27:44.880585 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035bb494-2fbd-48e5-b327-b4c799e3da86 service nova] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:27:44.890783 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 764/1527] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:27:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:27:48.852091 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1680d012-b672-4da4-ba3f-120f1824ee7f None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:27:48.852677 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1680d012-b672-4da4-ba3f-120f1824ee7f None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:27:48.852677 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1680d012-b672-4da4-ba3f-120f1824ee7f None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:27:48.854006 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 764/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 12:27:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:27:48.860714 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a86d6-a6c6-42c5-bfd9-69f52f1b6437 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:27:48.861285 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a86d6-a6c6-42c5-bfd9-69f52f1b6437 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:27:48.861285 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a86d6-a6c6-42c5-bfd9-69f52f1b6437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:27:48.883147 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-1a7a86d6-a6c6-42c5-bfd9-69f52f1b6437 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:27:48.884398 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-1a7a86d6-a6c6-42c5-bfd9-69f52f1b6437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:27:48.894840 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 765/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 12:27:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:27:49.202556 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1680d012-b672-4da4-ba3f-120f1824ee7f None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:27:49.204304 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-1680d012-b672-4da4-ba3f-120f1824ee7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:27:49.288413 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1680d012-b672-4da4-ba3f-120f1824ee7f None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:27:49.292066 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f7bad6-b459-4f67-9558-4f2727edaa33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:27:49.292679 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f7bad6-b459-4f67-9558-4f2727edaa33 service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:27:49.292947 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f7bad6-b459-4f67-9558-4f2727edaa33 service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:27:49.293214 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f7bad6-b459-4f67-9558-4f2727edaa33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:27:49.302724 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f7bad6-b459-4f67-9558-4f2727edaa33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:27:49.304159 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f7bad6-b459-4f67-9558-4f2727edaa33 service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:27:49.314653 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 765/1530] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:27:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:27:51.273046 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e405b-1d9e-42b2-949d-75bdb75a8438 None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:27:51.273622 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e405b-1d9e-42b2-949d-75bdb75a8438 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:27:51.273622 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e405b-1d9e-42b2-949d-75bdb75a8438 None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:27:51.274980 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 766/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 12:27:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:27:51.281785 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93781fcd-d0f1-49f5-a54f-f77a16b45de0 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:27:51.282545 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93781fcd-d0f1-49f5-a54f-f77a16b45de0 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:27:51.282545 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93781fcd-d0f1-49f5-a54f-f77a16b45de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:27:51.305767 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-93781fcd-d0f1-49f5-a54f-f77a16b45de0 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:27:51.307163 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-93781fcd-d0f1-49f5-a54f-f77a16b45de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:27:51.316185 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 766/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 12:27:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:27:51.611335 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303e405b-1d9e-42b2-949d-75bdb75a8438 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:27:51.622821 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303e405b-1d9e-42b2-949d-75bdb75a8438 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:27:51.626324 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a986fc69-4696-45ba-92e7-7ddd0720c344 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:27:51.627004 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986fc69-4696-45ba-92e7-7ddd0720c344 service neutron] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:27:51.627285 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986fc69-4696-45ba-92e7-7ddd0720c344 service neutron] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:27:51.627555 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986fc69-4696-45ba-92e7-7ddd0720c344 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:27:51.637075 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a986fc69-4696-45ba-92e7-7ddd0720c344 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:27:51.639083 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a986fc69-4696-45ba-92e7-7ddd0720c344 service neutron] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:27:51.648929 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 767/1533] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:27:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:27:55.558649 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1560b6-ffb0-41cb-a4e8-2cddaa320861 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:27:55.559377 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1560b6-ffb0-41cb-a4e8-2cddaa320861 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:27:55.559377 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1560b6-ffb0-41cb-a4e8-2cddaa320861 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:27:55.561487 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 767/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 12:27:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:27:55.567105 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9fef2b-f1cf-4d02-8f4e-f23a40773690 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:27:55.567542 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9fef2b-f1cf-4d02-8f4e-f23a40773690 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:27:55.567692 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9fef2b-f1cf-4d02-8f4e-f23a40773690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:27:55.575285 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=81 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:27:55.588586 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-ac9fef2b-f1cf-4d02-8f4e-f23a40773690 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:27:55.589809 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-ac9fef2b-f1cf-4d02-8f4e-f23a40773690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:27:55.598149 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 768/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 12:27:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:27:56.161070 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1560b6-ffb0-41cb-a4e8-2cddaa320861 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:27:56.162976 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-0a1560b6-ffb0-41cb-a4e8-2cddaa320861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:27:56.231776 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:27:56.245392 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1560b6-ffb0-41cb-a4e8-2cddaa320861 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:27:56.249670 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19477ed-60d5-4b50-b6b7-942bf9aa306b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e79503178ac54e62ba385467d5617ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:27:56.250284 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19477ed-60d5-4b50-b6b7-942bf9aa306b service cinder] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:27:56.250563 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19477ed-60d5-4b50-b6b7-942bf9aa306b service cinder] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:27:56.250837 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19477ed-60d5-4b50-b6b7-942bf9aa306b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:27:56.267967 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19477ed-60d5-4b50-b6b7-942bf9aa306b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:27:56.269481 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19477ed-60d5-4b50-b6b7-942bf9aa306b service cinder] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:27:56.280045 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 768/1536] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:27:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:27:58.240899 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6743123-a626-4696-8993-a59512648e06 None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:27:58.241447 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6743123-a626-4696-8993-a59512648e06 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:27:58.241447 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6743123-a626-4696-8993-a59512648e06 None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:27:58.242816 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 769/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 12:27:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:27:58.248876 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc205b4-aaf9-4d32-a3ce-db6ecb3f6655 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:27:58.249374 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc205b4-aaf9-4d32-a3ce-db6ecb3f6655 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:27:58.249478 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc205b4-aaf9-4d32-a3ce-db6ecb3f6655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:27:58.269661 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-6fc205b4-aaf9-4d32-a3ce-db6ecb3f6655 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:27:58.270919 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-6fc205b4-aaf9-4d32-a3ce-db6ecb3f6655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:27:58.278892 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 769/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 12:27:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:27:58.837323 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6743123-a626-4696-8993-a59512648e06 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:27:58.839036 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-b6743123-a626-4696-8993-a59512648e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:27:58.852859 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6743123-a626-4696-8993-a59512648e06 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:27:58.856413 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882cbac7-7950-4126-948a-1e741f070b30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e79503178ac54e62ba385467d5617ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:27:58.857569 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882cbac7-7950-4126-948a-1e741f070b30 service cinder] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:27:58.857849 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882cbac7-7950-4126-948a-1e741f070b30 service cinder] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:27:58.858119 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882cbac7-7950-4126-948a-1e741f070b30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:27:58.867754 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882cbac7-7950-4126-948a-1e741f070b30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:27:58.869188 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882cbac7-7950-4126-948a-1e741f070b30 service cinder] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:27:58.879275 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 770/1539] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:27:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:28:08.264561 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=11 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:28:08.874752 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=8 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:29:27.772231 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f773a84a-bf55-436c-acd5-89343fa27a5a None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:27.773553 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f773a84a-bf55-436c-acd5-89343fa27a5a None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:27.774054 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f773a84a-bf55-436c-acd5-89343fa27a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:27.789877 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d88377-3588-417c-92de-a6202db0c007 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:27.791011 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d88377-3588-417c-92de-a6202db0c007 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:27.791534 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d88377-3588-417c-92de-a6202db0c007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:27.807217 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-f773a84a-bf55-436c-acd5-89343fa27a5a None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:29:27.809044 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-f773a84a-bf55-436c-acd5-89343fa27a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:29:27.818186 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 770/1540] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:29:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:29:27.821402 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-d5d88377-3588-417c-92de-a6202db0c007 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:29:27.821402 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-d5d88377-3588-417c-92de-a6202db0c007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:29:27.829509 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab1192-9da4-48c1-8878-3287c07ac1e9 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:27.830213 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab1192-9da4-48c1-8878-3287c07ac1e9 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:27.830702 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab1192-9da4-48c1-8878-3287c07ac1e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:27.835178 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 771/1541] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:29:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:29:27.857991 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-e2ab1192-9da4-48c1-8878-3287c07ac1e9 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:29:27.859644 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-e2ab1192-9da4-48c1-8878-3287c07ac1e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:29:27.868622 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 771/1542] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:29:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:29:27.874065 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d88377-3588-417c-92de-a6202db0c007 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:27.876952 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94e121-ba89-4b3e-958b-7fc778b9431b None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:27.877480 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94e121-ba89-4b3e-958b-7fc778b9431b None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:27.877966 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94e121-ba89-4b3e-958b-7fc778b9431b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:27.890665 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d88377-3588-417c-92de-a6202db0c007 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:27.904227 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef77226e-fd04-4ece-b779-c7b5d3bf4440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:27.905310 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef77226e-fd04-4ece-b779-c7b5d3bf4440 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:27.905763 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef77226e-fd04-4ece-b779-c7b5d3bf4440 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:27.906198 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef77226e-fd04-4ece-b779-c7b5d3bf4440 admin admin] PATH_INFO: `/v3/domains` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:27.910352 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef77226e-fd04-4ece-b779-c7b5d3bf4440 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:29:27.910877 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef77226e-fd04-4ece-b779-c7b5d3bf4440 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:27.912096 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: WARNING py.warnings [None req-ef77226e-fd04-4ece-b779-c7b5d3bf4440 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 12:29:27.912096 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: warnings.warn(msg) Aug 31 12:29:27.912096 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: Aug 31 12:29:27.913349 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef77226e-fd04-4ece-b779-c7b5d3bf4440 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:27.915619 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-aa94e121-ba89-4b3e-958b-7fc778b9431b None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:29:27.918925 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-aa94e121-ba89-4b3e-958b-7fc778b9431b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:29:27.940535 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 772/1543] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:29:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:29:27.941257 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 772/1544] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 12:29:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:29:27.946879 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9136b70e-50f8-4937-a0c4-d01b92dfad94 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:27.947671 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9136b70e-50f8-4937-a0c4-d01b92dfad94 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:27.947969 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a5a32-43b7-43ba-996a-dc941ded1d95 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:27.948256 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a5a32-43b7-43ba-996a-dc941ded1d95 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:27.948528 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a5a32-43b7-43ba-996a-dc941ded1d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:27.948832 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9136b70e-50f8-4937-a0c4-d01b92dfad94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:27.991261 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-f34a5a32-43b7-43ba-996a-dc941ded1d95 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:29:27.993700 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-f34a5a32-43b7-43ba-996a-dc941ded1d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:29:27.997996 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-9136b70e-50f8-4937-a0c4-d01b92dfad94 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:29:27.999875 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-9136b70e-50f8-4937-a0c4-d01b92dfad94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:29:28.021845 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 773/1545] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:29:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:29:28.022755 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 773/1546] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:29:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:29:28.024025 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34a5a32-43b7-43ba-996a-dc941ded1d95 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:28.025271 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9136b70e-50f8-4937-a0c4-d01b92dfad94 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:28.045451 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34a5a32-43b7-43ba-996a-dc941ded1d95 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:28.048731 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9136b70e-50f8-4937-a0c4-d01b92dfad94 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:28.056277 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3faec3c-ce3d-4f62-ae94-491287a492af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:28.057493 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3faec3c-ce3d-4f62-ae94-491287a492af admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:28.058997 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821689d7-c781-4f3f-be64-7a4fc14e822e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:28.059640 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3faec3c-ce3d-4f62-ae94-491287a492af admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:28.060606 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821689d7-c781-4f3f-be64-7a4fc14e822e admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:28.061045 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3faec3c-ce3d-4f62-ae94-491287a492af admin admin] PATH_INFO: `/v3/domains` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:28.062381 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3faec3c-ce3d-4f62-ae94-491287a492af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:29:28.062696 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821689d7-c781-4f3f-be64-7a4fc14e822e admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:28.063141 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821689d7-c781-4f3f-be64-7a4fc14e822e admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:28.063615 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3faec3c-ce3d-4f62-ae94-491287a492af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:28.064427 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821689d7-c781-4f3f-be64-7a4fc14e822e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:28.065602 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: WARNING py.warnings [None req-821689d7-c781-4f3f-be64-7a4fc14e822e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 12:29:28.065602 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: warnings.warn(msg) Aug 31 12:29:28.065602 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: Aug 31 12:29:28.066260 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3faec3c-ce3d-4f62-ae94-491287a492af admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:28.067341 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821689d7-c781-4f3f-be64-7a4fc14e822e admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:28.080779 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 774/1547] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 12:29:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:29:28.082380 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d1463-e804-4ac0-8003-6376a73f43b0 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:28.082669 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d1463-e804-4ac0-8003-6376a73f43b0 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:28.083003 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d1463-e804-4ac0-8003-6376a73f43b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:28.105025 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-766d1463-e804-4ac0-8003-6376a73f43b0 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:29:28.106804 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-766d1463-e804-4ac0-8003-6376a73f43b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:29:28.113950 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 774/1548] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:29:28 2022] POST /identity/v3/projects => generated 373 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:29:28.115242 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 775/1549] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:29:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:29:28.115560 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f0bd13-c848-4b7b-8c5d-ed2abe217166 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:28.115878 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f0bd13-c848-4b7b-8c5d-ed2abe217166 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:28.116109 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f0bd13-c848-4b7b-8c5d-ed2abe217166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:28.116356 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f9667-7b3b-4875-a597-51ffd745bee0 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:28.116642 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f9667-7b3b-4875-a597-51ffd745bee0 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:28.116914 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f9667-7b3b-4875-a597-51ffd745bee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:28.138551 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-51f0bd13-c848-4b7b-8c5d-ed2abe217166 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:29:28.138939 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-bb8f9667-7b3b-4875-a597-51ffd745bee0 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:29:28.140063 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-51f0bd13-c848-4b7b-8c5d-ed2abe217166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:29:28.140230 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-bb8f9667-7b3b-4875-a597-51ffd745bee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:29:28.208038 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 775/1550] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:29:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:29:28.208280 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 776/1551] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:29:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:29:28.208280 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b7fb7-256b-44bc-a0b3-3bdccbd60257 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:28.208280 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b7fb7-256b-44bc-a0b3-3bdccbd60257 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:28.208280 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b7fb7-256b-44bc-a0b3-3bdccbd60257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:28.208885 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99967027-603f-4d42-90f0-e3bd5b38feb1 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:28.209411 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99967027-603f-4d42-90f0-e3bd5b38feb1 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:28.209689 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99967027-603f-4d42-90f0-e3bd5b38feb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:28.226518 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-0d8b7fb7-256b-44bc-a0b3-3bdccbd60257 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:29:28.227755 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-0d8b7fb7-256b-44bc-a0b3-3bdccbd60257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:29:28.229713 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-99967027-603f-4d42-90f0-e3bd5b38feb1 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:29:28.231190 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-99967027-603f-4d42-90f0-e3bd5b38feb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:29:28.236141 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 777/1552] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:29:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:29:28.237362 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fd989a-d823-48ae-989c-050c4c48c769 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:28.237645 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fd989a-d823-48ae-989c-050c4c48c769 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:28.237953 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fd989a-d823-48ae-989c-050c4c48c769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:28.241982 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 776/1553] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:29:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:29:28.242923 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99967027-603f-4d42-90f0-e3bd5b38feb1 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:28.255395 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99967027-603f-4d42-90f0-e3bd5b38feb1 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:28.260296 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a4b663-94ca-4aa7-bfcc-6d524976b147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:28.260935 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a4b663-94ca-4aa7-bfcc-6d524976b147 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:28.261237 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a4b663-94ca-4aa7-bfcc-6d524976b147 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:28.261533 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a4b663-94ca-4aa7-bfcc-6d524976b147 admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:28.262592 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-85fd989a-d823-48ae-989c-050c4c48c769 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:29:28.262909 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a4b663-94ca-4aa7-bfcc-6d524976b147 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:28.263858 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-85fd989a-d823-48ae-989c-050c4c48c769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:29:28.264860 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a4b663-94ca-4aa7-bfcc-6d524976b147 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:28.271971 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 778/1554] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:29:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:29:28.273244 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d66e84-cd1b-4742-be90-0eaa7712b2a4 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:28.273473 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d66e84-cd1b-4742-be90-0eaa7712b2a4 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:28.273747 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d66e84-cd1b-4742-be90-0eaa7712b2a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:28.293822 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-45d66e84-cd1b-4742-be90-0eaa7712b2a4 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:29:28.295078 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-45d66e84-cd1b-4742-be90-0eaa7712b2a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:29:28.302190 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 777/1555] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:29:28 2022] POST /identity/v3/projects => generated 375 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:29:28.302190 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a4b663-94ca-4aa7-bfcc-6d524976b147 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:28.303763 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 779/1556] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:29:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:29:28.304697 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d66e84-cd1b-4742-be90-0eaa7712b2a4 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:28.317404 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d66e84-cd1b-4742-be90-0eaa7712b2a4 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:28.363140 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a4b663-94ca-4aa7-bfcc-6d524976b147 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:28.368049 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5138b9-f9da-479b-a975-b1ac31967260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:28.368815 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5138b9-f9da-479b-a975-b1ac31967260 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:28.369096 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5138b9-f9da-479b-a975-b1ac31967260 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:28.369474 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5138b9-f9da-479b-a975-b1ac31967260 admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:28.369996 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5138b9-f9da-479b-a975-b1ac31967260 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:28.372544 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5138b9-f9da-479b-a975-b1ac31967260 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:28.376815 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e1a1a8-a82f-46c5-b5e1-9464f21f640d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:28.377431 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e1a1a8-a82f-46c5-b5e1-9464f21f640d admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:28.377706 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e1a1a8-a82f-46c5-b5e1-9464f21f640d admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:28.377980 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e1a1a8-a82f-46c5-b5e1-9464f21f640d admin admin] PATH_INFO: `/v3/domains` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:28.378625 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e1a1a8-a82f-46c5-b5e1-9464f21f640d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:29:28.378951 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e1a1a8-a82f-46c5-b5e1-9464f21f640d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:28.380542 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e1a1a8-a82f-46c5-b5e1-9464f21f640d admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:28.393616 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 780/1557] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 12:29:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:29:28.397963 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 778/1558] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:29:28 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:29:28.398140 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e1a1a8-a82f-46c5-b5e1-9464f21f640d admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:28.398253 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ccbcfd-1917-4c4e-b474-f1171c827819 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:28.398253 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ccbcfd-1917-4c4e-b474-f1171c827819 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:28.398253 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ccbcfd-1917-4c4e-b474-f1171c827819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:28.406319 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:29:28.409744 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e1a1a8-a82f-46c5-b5e1-9464f21f640d admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:28.414669 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da9da41-e52e-41df-9024-cc4cf6d7a915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:28.415360 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da9da41-e52e-41df-9024-cc4cf6d7a915 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:28.415949 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da9da41-e52e-41df-9024-cc4cf6d7a915 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:28.416365 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da9da41-e52e-41df-9024-cc4cf6d7a915 admin admin] PATH_INFO: `/v3/domains` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:28.417002 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da9da41-e52e-41df-9024-cc4cf6d7a915 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:29:28.417287 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da9da41-e52e-41df-9024-cc4cf6d7a915 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:28.419849 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-76ccbcfd-1917-4c4e-b474-f1171c827819 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:29:28.420037 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da9da41-e52e-41df-9024-cc4cf6d7a915 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:28.421082 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-76ccbcfd-1917-4c4e-b474-f1171c827819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:29:28.429461 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 779/1559] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:29:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:29:28.430677 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f4d3c9-7264-436d-9203-6cb0c82edab7 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:28.430985 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f4d3c9-7264-436d-9203-6cb0c82edab7 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:28.431256 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f4d3c9-7264-436d-9203-6cb0c82edab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:28.437343 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 781/1560] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 12:29:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:29:28.438757 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666469f9-6c74-497b-80b6-315371b5e24c None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:28.439086 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666469f9-6c74-497b-80b6-315371b5e24c None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:28.439362 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666469f9-6c74-497b-80b6-315371b5e24c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:28.454051 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-43f4d3c9-7264-436d-9203-6cb0c82edab7 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:29:28.455373 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-43f4d3c9-7264-436d-9203-6cb0c82edab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:29:28.463320 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 780/1561] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:29:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:29:28.464101 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f4d3c9-7264-436d-9203-6cb0c82edab7 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:28.468873 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-666469f9-6c74-497b-80b6-315371b5e24c None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:29:28.470187 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-666469f9-6c74-497b-80b6-315371b5e24c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:29:28.473601 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f4d3c9-7264-436d-9203-6cb0c82edab7 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:28.478211 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0417ffeb-c64a-4f53-a72b-5e6f7b94a5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:28.478639 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 782/1562] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:29:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:29:28.479114 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417ffeb-c64a-4f53-a72b-5e6f7b94a5cb admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:28.479396 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417ffeb-c64a-4f53-a72b-5e6f7b94a5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:28.479496 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666469f9-6c74-497b-80b6-315371b5e24c None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:28.479666 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417ffeb-c64a-4f53-a72b-5e6f7b94a5cb admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:28.480297 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0417ffeb-c64a-4f53-a72b-5e6f7b94a5cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:28.483001 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0417ffeb-c64a-4f53-a72b-5e6f7b94a5cb admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:28.492877 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666469f9-6c74-497b-80b6-315371b5e24c None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:28.499712 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0516a2a-9085-45c3-916e-e3e0bfc4f38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:28.500506 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0516a2a-9085-45c3-916e-e3e0bfc4f38f admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:28.500793 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0516a2a-9085-45c3-916e-e3e0bfc4f38f admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:28.501198 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0516a2a-9085-45c3-916e-e3e0bfc4f38f admin admin] PATH_INFO: `/v3/domains` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:28.501892 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0516a2a-9085-45c3-916e-e3e0bfc4f38f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:29:28.502291 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0516a2a-9085-45c3-916e-e3e0bfc4f38f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:28.503860 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0516a2a-9085-45c3-916e-e3e0bfc4f38f admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:28.506719 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:29:28.510196 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 781/1563] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:29:28 2022] POST /identity/v3/users => generated 288 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:29:28.510196 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0417ffeb-c64a-4f53-a72b-5e6f7b94a5cb admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:28.517626 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 783/1564] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 12:29:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:29:28.518313 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0516a2a-9085-45c3-916e-e3e0bfc4f38f admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:28.527308 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0417ffeb-c64a-4f53-a72b-5e6f7b94a5cb admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:28.528194 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0516a2a-9085-45c3-916e-e3e0bfc4f38f admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:28.531912 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471bb238-c07d-43ff-89cc-e6fac1f0c20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:28.532561 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471bb238-c07d-43ff-89cc-e6fac1f0c20f admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:28.532733 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6d8572-6443-41bb-8eb9-ae848d9070ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:28.532855 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471bb238-c07d-43ff-89cc-e6fac1f0c20f admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:28.533092 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471bb238-c07d-43ff-89cc-e6fac1f0c20f admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:28.533337 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6d8572-6443-41bb-8eb9-ae848d9070ab admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:28.533616 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6d8572-6443-41bb-8eb9-ae848d9070ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:28.533769 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471bb238-c07d-43ff-89cc-e6fac1f0c20f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:28.533886 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6d8572-6443-41bb-8eb9-ae848d9070ab admin admin] PATH_INFO: `/v3/projects` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:28.534494 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6d8572-6443-41bb-8eb9-ae848d9070ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:28.535403 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471bb238-c07d-43ff-89cc-e6fac1f0c20f admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:28.536431 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6d8572-6443-41bb-8eb9-ae848d9070ab admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:28.546686 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 782/1565] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:29:28 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:29:28.547749 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471bb238-c07d-43ff-89cc-e6fac1f0c20f admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:28.558136 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471bb238-c07d-43ff-89cc-e6fac1f0c20f admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:28.565802 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1554bc12-888b-40f0-9a92-59a67c8530c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:28.566711 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1554bc12-888b-40f0-9a92-59a67c8530c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:28.567029 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1554bc12-888b-40f0-9a92-59a67c8530c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:28.567356 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1554bc12-888b-40f0-9a92-59a67c8530c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:28.567942 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1554bc12-888b-40f0-9a92-59a67c8530c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:29:28.568237 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1554bc12-888b-40f0-9a92-59a67c8530c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:28.569836 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1554bc12-888b-40f0-9a92-59a67c8530c4 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:28.575177 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 784/1566] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:29:28 2022] POST /identity/v3/projects => generated 389 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:29:28.575177 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6d8572-6443-41bb-8eb9-ae848d9070ab admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:28.583736 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 783/1567] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 12:29:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:29:28.584640 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1554bc12-888b-40f0-9a92-59a67c8530c4 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:28.594394 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1554bc12-888b-40f0-9a92-59a67c8530c4 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:28.643092 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6d8572-6443-41bb-8eb9-ae848d9070ab admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:28.647978 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27322383-b606-4444-90e6-a131290431be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:28.648694 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27322383-b606-4444-90e6-a131290431be admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:28.648869 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27322383-b606-4444-90e6-a131290431be admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:28.649135 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27322383-b606-4444-90e6-a131290431be admin admin] PATH_INFO: `/v3/projects` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:28.649766 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27322383-b606-4444-90e6-a131290431be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:28.651717 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27322383-b606-4444-90e6-a131290431be admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:28.652668 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2165ec38-3265-46cd-a327-6e606726108c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:28.653278 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2165ec38-3265-46cd-a327-6e606726108c admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:28.653558 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2165ec38-3265-46cd-a327-6e606726108c admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:28.653829 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2165ec38-3265-46cd-a327-6e606726108c admin admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:28.654478 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2165ec38-3265-46cd-a327-6e606726108c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:29:28.654773 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2165ec38-3265-46cd-a327-6e606726108c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:28.656402 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2165ec38-3265-46cd-a327-6e606726108c admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:28.668770 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 784/1568] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 12:29:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:29:28.670030 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2165ec38-3265-46cd-a327-6e606726108c admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:28.682997 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2165ec38-3265-46cd-a327-6e606726108c admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:28.688498 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6c520e-6073-4c49-a442-bff4363871a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:28.689135 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6c520e-6073-4c49-a442-bff4363871a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:28.689416 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6c520e-6073-4c49-a442-bff4363871a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:28.689687 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6c520e-6073-4c49-a442-bff4363871a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:28.690335 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6c520e-6073-4c49-a442-bff4363871a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:29:28.690637 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6c520e-6073-4c49-a442-bff4363871a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:28.691538 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 785/1569] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:29:28 2022] POST /identity/v3/projects => generated 375 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:29:28.692359 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6c520e-6073-4c49-a442-bff4363871a6 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:28.692522 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27322383-b606-4444-90e6-a131290431be admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:28.706226 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 785/1570] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 12:29:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:29:28.707179 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6c520e-6073-4c49-a442-bff4363871a6 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:28.718082 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6c520e-6073-4c49-a442-bff4363871a6 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:28.768422 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27322383-b606-4444-90e6-a131290431be admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:28.773526 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2182de9e-de2e-45ba-a4b6-ac4c4eae9753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:28.774143 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2182de9e-de2e-45ba-a4b6-ac4c4eae9753 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:28.774424 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2182de9e-de2e-45ba-a4b6-ac4c4eae9753 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:28.774698 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2182de9e-de2e-45ba-a4b6-ac4c4eae9753 admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:28.775378 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2182de9e-de2e-45ba-a4b6-ac4c4eae9753 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:28.775883 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a60381b-40d6-4486-84aa-2c187bcc6eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:28.776496 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60381b-40d6-4486-84aa-2c187bcc6eb7 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:28.776772 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60381b-40d6-4486-84aa-2c187bcc6eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:28.776987 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2182de9e-de2e-45ba-a4b6-ac4c4eae9753 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:28.777085 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60381b-40d6-4486-84aa-2c187bcc6eb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:28.777911 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a60381b-40d6-4486-84aa-2c187bcc6eb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:28.779884 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a60381b-40d6-4486-84aa-2c187bcc6eb7 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:28.788058 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 786/1571] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:29:28 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:29:28.789041 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2182de9e-de2e-45ba-a4b6-ac4c4eae9753 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:28.800257 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2182de9e-de2e-45ba-a4b6-ac4c4eae9753 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:28.805477 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746f471b-3210-4b59-9d12-79090b1561b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:28.806093 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746f471b-3210-4b59-9d12-79090b1561b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:28.806373 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746f471b-3210-4b59-9d12-79090b1561b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:28.806646 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746f471b-3210-4b59-9d12-79090b1561b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:28.807324 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746f471b-3210-4b59-9d12-79090b1561b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:28.807447 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 786/1572] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:29:28 2022] POST /identity/v3/projects => generated 373 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:29:28.808184 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a60381b-40d6-4486-84aa-2c187bcc6eb7 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:28.809560 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746f471b-3210-4b59-9d12-79090b1561b3 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:28.823806 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 787/1573] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:29:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:29:28.825426 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746f471b-3210-4b59-9d12-79090b1561b3 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:28.829615 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:29:28.836282 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746f471b-3210-4b59-9d12-79090b1561b3 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:28.879645 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a60381b-40d6-4486-84aa-2c187bcc6eb7 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:28.880571 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:29:28.885098 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6013f5d-16df-4a13-ac29-6c09595af151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:28.885703 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6013f5d-16df-4a13-ac29-6c09595af151 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:28.886014 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6013f5d-16df-4a13-ac29-6c09595af151 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:28.886305 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6013f5d-16df-4a13-ac29-6c09595af151 admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:28.887835 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6013f5d-16df-4a13-ac29-6c09595af151 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:28.889778 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6013f5d-16df-4a13-ac29-6c09595af151 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:28.898396 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb97a11-77f7-45cd-8f76-acb5d51d81be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:28.899059 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb97a11-77f7-45cd-8f76-acb5d51d81be admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:28.899341 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb97a11-77f7-45cd-8f76-acb5d51d81be admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:28.899614 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb97a11-77f7-45cd-8f76-acb5d51d81be admin admin] PATH_INFO: `/v3/projects` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:28.900254 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb97a11-77f7-45cd-8f76-acb5d51d81be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:28.902245 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb97a11-77f7-45cd-8f76-acb5d51d81be admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:28.911488 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 787/1574] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:29:28 2022] POST /identity/v3/users => generated 295 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:29:28.912495 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6013f5d-16df-4a13-ac29-6c09595af151 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:28.925431 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6013f5d-16df-4a13-ac29-6c09595af151 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:28.930264 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fa2394-ffd5-4c93-aca6-bd69f69ff70e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:28.930893 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa2394-ffd5-4c93-aca6-bd69f69ff70e admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:28.931172 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa2394-ffd5-4c93-aca6-bd69f69ff70e admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:28.931442 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa2394-ffd5-4c93-aca6-bd69f69ff70e admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:28.932075 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fa2394-ffd5-4c93-aca6-bd69f69ff70e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:28.934523 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fa2394-ffd5-4c93-aca6-bd69f69ff70e admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:28.936135 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 788/1575] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:29:28 2022] POST /identity/v3/projects => generated 403 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:29:28.940232 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb97a11-77f7-45cd-8f76-acb5d51d81be admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:28.963840 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 788/1576] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:29:28 2022] POST /identity/v3/projects => generated 379 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:29:28.964666 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fa2394-ffd5-4c93-aca6-bd69f69ff70e admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:29.007160 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb97a11-77f7-45cd-8f76-acb5d51d81be admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:29.032991 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fa2394-ffd5-4c93-aca6-bd69f69ff70e admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:29.040188 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b150cd4-5176-4093-97e5-8d8025eccad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:29.041057 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b150cd4-5176-4093-97e5-8d8025eccad5 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:29.041516 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b150cd4-5176-4093-97e5-8d8025eccad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:29.041965 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b150cd4-5176-4093-97e5-8d8025eccad5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:29.043022 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b150cd4-5176-4093-97e5-8d8025eccad5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:29.046895 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b150cd4-5176-4093-97e5-8d8025eccad5 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:29.086390 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66df0f6e-4ffa-4fb0-ab47-c63059054796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:29.090481 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 789/1577] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:29:28 2022] POST /identity/v3/projects => generated 391 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:29:29.090655 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df0f6e-4ffa-4fb0-ab47-c63059054796 admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:29.090655 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df0f6e-4ffa-4fb0-ab47-c63059054796 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:29.090655 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df0f6e-4ffa-4fb0-ab47-c63059054796 admin admin] PATH_INFO: `/v3/users` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:29.090989 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b150cd4-5176-4093-97e5-8d8025eccad5 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:29.091097 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66df0f6e-4ffa-4fb0-ab47-c63059054796 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:29.091097 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: WARNING py.warnings [None req-66df0f6e-4ffa-4fb0-ab47-c63059054796 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 12:29:29.091097 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: warnings.warn(msg) Aug 31 12:29:29.091097 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: Aug 31 12:29:29.092016 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66df0f6e-4ffa-4fb0-ab47-c63059054796 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:29.117479 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 789/1578] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:29:28 2022] POST /identity/v3/users => generated 288 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:29:29.118298 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66df0f6e-4ffa-4fb0-ab47-c63059054796 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:29.128905 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66df0f6e-4ffa-4fb0-ab47-c63059054796 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:29.157332 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b150cd4-5176-4093-97e5-8d8025eccad5 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:29.162215 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e25e616-ec51-4b4b-b6ea-a38ca91b58a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:29.162829 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e25e616-ec51-4b4b-b6ea-a38ca91b58a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:29.163139 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e25e616-ec51-4b4b-b6ea-a38ca91b58a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:29.163414 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e25e616-ec51-4b4b-b6ea-a38ca91b58a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:29.164064 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e25e616-ec51-4b4b-b6ea-a38ca91b58a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:29.165678 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e25e616-ec51-4b4b-b6ea-a38ca91b58a2 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:29.179730 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 790/1579] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:29:29 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:29:29.179730 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e25e616-ec51-4b4b-b6ea-a38ca91b58a2 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:29.187126 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:29:29.189296 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee04891b-9a65-4de6-8308-d558ee9c9933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:29.190050 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04891b-9a65-4de6-8308-d558ee9c9933 admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:29.190504 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04891b-9a65-4de6-8308-d558ee9c9933 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:29.190659 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04891b-9a65-4de6-8308-d558ee9c9933 admin admin] PATH_INFO: `/v3/users` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:29.191108 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e25e616-ec51-4b4b-b6ea-a38ca91b58a2 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:29.191261 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee04891b-9a65-4de6-8308-d558ee9c9933 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:29.193335 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee04891b-9a65-4de6-8308-d558ee9c9933 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:29.198060 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b855f3e8-528c-4692-a8d7-b2990c7185a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:29.198735 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b855f3e8-528c-4692-a8d7-b2990c7185a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:29.199258 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b855f3e8-528c-4692-a8d7-b2990c7185a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:29.199917 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b855f3e8-528c-4692-a8d7-b2990c7185a1 admin admin] PATH_INFO: `/v3/projects/9fad051760724160ac85a4ea032387cc/users/246a71f2d8954164a90a63a3471e2179/roles/b5cfd7a855a448359e9017f51d32b6fc` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:29.204850 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:29:29.217331 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b855f3e8-528c-4692-a8d7-b2990c7185a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fad051760724160ac85a4ea032387cc, user_id=246a71f2d8954164a90a63a3471e2179, role_id=b5cfd7a855a448359e9017f51d32b6fc)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:29.220668 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 790/1580] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:29:29 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:29:29.220810 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: WARNING py.warnings [None req-b855f3e8-528c-4692-a8d7-b2990c7185a1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 12:29:29.220810 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: warnings.warn(msg) Aug 31 12:29:29.220810 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: Aug 31 12:29:29.221078 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee04891b-9a65-4de6-8308-d558ee9c9933 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:29.221190 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b855f3e8-528c-4692-a8d7-b2990c7185a1 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:29.229502 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee04891b-9a65-4de6-8308-d558ee9c9933 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:29.236052 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 791/1581] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:29:29 2022] PUT /identity/v3/projects/9fad051760724160ac85a4ea032387cc/users/246a71f2d8954164a90a63a3471e2179/roles/b5cfd7a855a448359e9017f51d32b6fc => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:29:29.236874 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b855f3e8-528c-4692-a8d7-b2990c7185a1 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:29.294208 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7239cb9b-dc3c-4885-aea6-29fbc7130243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:29.294742 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7239cb9b-dc3c-4885-aea6-29fbc7130243 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:29.295055 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7239cb9b-dc3c-4885-aea6-29fbc7130243 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:29.295329 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7239cb9b-dc3c-4885-aea6-29fbc7130243 admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:29.295977 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7239cb9b-dc3c-4885-aea6-29fbc7130243 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:29.297625 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7239cb9b-dc3c-4885-aea6-29fbc7130243 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:29.307784 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 791/1582] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:29:29 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:29:29.308707 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7239cb9b-dc3c-4885-aea6-29fbc7130243 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:29.309961 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b855f3e8-528c-4692-a8d7-b2990c7185a1 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:29.315535 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564a37f2-eb7c-448e-b8a3-55ef0b2f273d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:29.316158 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a37f2-eb7c-448e-b8a3-55ef0b2f273d admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:29.316437 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a37f2-eb7c-448e-b8a3-55ef0b2f273d admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:29.316737 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a37f2-eb7c-448e-b8a3-55ef0b2f273d admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:29.317377 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564a37f2-eb7c-448e-b8a3-55ef0b2f273d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:29.319139 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7239cb9b-dc3c-4885-aea6-29fbc7130243 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:29.319387 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564a37f2-eb7c-448e-b8a3-55ef0b2f273d admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:29.323808 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060896f9-1534-4a1a-b040-c372551aeeea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:29.324947 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060896f9-1534-4a1a-b040-c372551aeeea admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:29.325221 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060896f9-1534-4a1a-b040-c372551aeeea admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:29.325480 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060896f9-1534-4a1a-b040-c372551aeeea admin admin] PATH_INFO: `/v3/users` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:29.326103 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060896f9-1534-4a1a-b040-c372551aeeea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:29.328043 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060896f9-1534-4a1a-b040-c372551aeeea admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:29.343453 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 792/1583] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:29:29 2022] POST /identity/v3/users => generated 302 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:29:29.347221 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564a37f2-eb7c-448e-b8a3-55ef0b2f273d admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:29.354241 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 792/1584] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:29:29 2022] POST /identity/v3/users => generated 290 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:29:29.354415 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060896f9-1534-4a1a-b040-c372551aeeea admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:29.357678 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564a37f2-eb7c-448e-b8a3-55ef0b2f273d admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:29.362541 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4feecb5-50b1-40e9-9d65-459a31510213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:29.363216 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4feecb5-50b1-40e9-9d65-459a31510213 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:29.363492 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4feecb5-50b1-40e9-9d65-459a31510213 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:29.363789 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4feecb5-50b1-40e9-9d65-459a31510213 admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:29.364414 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4feecb5-50b1-40e9-9d65-459a31510213 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:29.365570 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060896f9-1534-4a1a-b040-c372551aeeea admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:29.366326 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4feecb5-50b1-40e9-9d65-459a31510213 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:29.370276 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813d85b2-bba9-4f38-8eed-1eb75e64d5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:29.370922 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d85b2-bba9-4f38-8eed-1eb75e64d5ce admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:29.371253 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d85b2-bba9-4f38-8eed-1eb75e64d5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:29.371549 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d85b2-bba9-4f38-8eed-1eb75e64d5ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:29.372194 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813d85b2-bba9-4f38-8eed-1eb75e64d5ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:29.373790 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813d85b2-bba9-4f38-8eed-1eb75e64d5ce admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:29.385870 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 793/1585] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:29:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:29:29.387218 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813d85b2-bba9-4f38-8eed-1eb75e64d5ce admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:29.394500 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 793/1586] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:29:29 2022] POST /identity/v3/users => generated 296 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:29:29.395499 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4feecb5-50b1-40e9-9d65-459a31510213 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:29.397477 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813d85b2-bba9-4f38-8eed-1eb75e64d5ce admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:29.402104 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ab659d-e8f3-4c00-ab72-fd1844455ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:29.403595 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab659d-e8f3-4c00-ab72-fd1844455ee5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:29.403877 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab659d-e8f3-4c00-ab72-fd1844455ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:29.404147 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab659d-e8f3-4c00-ab72-fd1844455ee5 admin admin] PATH_INFO: `/v3/projects/ca25ca2519ae4697b952d9451321980d/users/5a3b11bf184943698c459d79f158400b/roles/b5cfd7a855a448359e9017f51d32b6fc` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:29.407213 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4feecb5-50b1-40e9-9d65-459a31510213 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:29.413531 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c0f41e-8965-4d63-a54d-2282d1c81a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:29.414282 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c0f41e-8965-4d63-a54d-2282d1c81a86 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:29.414588 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c0f41e-8965-4d63-a54d-2282d1c81a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:29.414927 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c0f41e-8965-4d63-a54d-2282d1c81a86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:29.415579 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c0f41e-8965-4d63-a54d-2282d1c81a86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:29.417281 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c0f41e-8965-4d63-a54d-2282d1c81a86 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:29.421151 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ab659d-e8f3-4c00-ab72-fd1844455ee5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca25ca2519ae4697b952d9451321980d, user_id=5a3b11bf184943698c459d79f158400b, role_id=b5cfd7a855a448359e9017f51d32b6fc)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:29.423866 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ab659d-e8f3-4c00-ab72-fd1844455ee5 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:29.430217 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 794/1587] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:29:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:29:29.433338 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ace7f-237e-4626-8596-4c5a4012b8b5 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:29.433338 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ace7f-237e-4626-8596-4c5a4012b8b5 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:29.433338 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ace7f-237e-4626-8596-4c5a4012b8b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:29.439070 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 794/1588] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:29:29 2022] PUT /identity/v3/projects/ca25ca2519ae4697b952d9451321980d/users/5a3b11bf184943698c459d79f158400b/roles/b5cfd7a855a448359e9017f51d32b6fc => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:29:29.444754 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ab659d-e8f3-4c00-ab72-fd1844455ee5 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:29.462040 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-018ace7f-237e-4626-8596-4c5a4012b8b5 None None] MFA Rules not processed for user `246a71f2d8954164a90a63a3471e2179`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:29:29.463319 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-018ace7f-237e-4626-8596-4c5a4012b8b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:29:29.510795 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ab659d-e8f3-4c00-ab72-fd1844455ee5 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:29.516506 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf34044-703a-41ae-810e-43f5ef8ba420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:29.516872 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf34044-703a-41ae-810e-43f5ef8ba420 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:29.517156 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf34044-703a-41ae-810e-43f5ef8ba420 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:29.517430 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf34044-703a-41ae-810e-43f5ef8ba420 admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:29.518078 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf34044-703a-41ae-810e-43f5ef8ba420 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:29.519773 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf34044-703a-41ae-810e-43f5ef8ba420 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:29.530439 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 795/1589] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:29:29 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:29:29.531303 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf34044-703a-41ae-810e-43f5ef8ba420 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:29.537264 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 795/1590] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:29:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:29:29.538110 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018ace7f-237e-4626-8596-4c5a4012b8b5 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:29.545413 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf34044-703a-41ae-810e-43f5ef8ba420 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:29.549610 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018ace7f-237e-4626-8596-4c5a4012b8b5 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:29.550166 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352303c4-51ba-4aa0-bfe0-32b2f69bd8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:29.550874 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352303c4-51ba-4aa0-bfe0-32b2f69bd8fc admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:29.551156 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352303c4-51ba-4aa0-bfe0-32b2f69bd8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:29.551471 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352303c4-51ba-4aa0-bfe0-32b2f69bd8fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:29.552061 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352303c4-51ba-4aa0-bfe0-32b2f69bd8fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:29.553667 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352303c4-51ba-4aa0-bfe0-32b2f69bd8fc admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:29.554288 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2decbf5-436a-4592-aec9-2c60e039bdba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:29.554946 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2decbf5-436a-4592-aec9-2c60e039bdba admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:29.555223 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2decbf5-436a-4592-aec9-2c60e039bdba admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:29.555519 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2decbf5-436a-4592-aec9-2c60e039bdba admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:29.556176 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2decbf5-436a-4592-aec9-2c60e039bdba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:29.557894 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2decbf5-436a-4592-aec9-2c60e039bdba admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:29.563968 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 796/1591] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:29:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:29:29.564867 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352303c4-51ba-4aa0-bfe0-32b2f69bd8fc admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:29.571265 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 796/1592] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:29:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:29:29.571265 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2decbf5-436a-4592-aec9-2c60e039bdba admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:29.575148 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352303c4-51ba-4aa0-bfe0-32b2f69bd8fc admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:29.579949 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f16954f-2678-4c2c-a03d-09ff4853a936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:29.580561 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f16954f-2678-4c2c-a03d-09ff4853a936 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:29.580843 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f16954f-2678-4c2c-a03d-09ff4853a936 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:29.580983 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2decbf5-436a-4592-aec9-2c60e039bdba admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:29.581114 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f16954f-2678-4c2c-a03d-09ff4853a936 admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:29.581756 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f16954f-2678-4c2c-a03d-09ff4853a936 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:29.583398 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f16954f-2678-4c2c-a03d-09ff4853a936 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:29.585707 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be67eb93-541d-4fbd-8aea-64e26e69d6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:29.586352 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be67eb93-541d-4fbd-8aea-64e26e69d6ce admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:29.586632 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be67eb93-541d-4fbd-8aea-64e26e69d6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:29.586935 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be67eb93-541d-4fbd-8aea-64e26e69d6ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:29.587592 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be67eb93-541d-4fbd-8aea-64e26e69d6ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:29.589160 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be67eb93-541d-4fbd-8aea-64e26e69d6ce admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:29.594573 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 797/1593] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:29:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:29:29.597899 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f16954f-2678-4c2c-a03d-09ff4853a936 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:29.609470 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 797/1594] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:29:29 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:29:29.610772 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f16954f-2678-4c2c-a03d-09ff4853a936 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:29.611060 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d5809-9246-4e2b-8494-f884668c8d41 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:29.611176 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d5809-9246-4e2b-8494-f884668c8d41 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:29.611408 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d5809-9246-4e2b-8494-f884668c8d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:29.617324 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc53fcee-d983-42a5-ab42-ce3238b007a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:29.617949 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc53fcee-d983-42a5-ab42-ce3238b007a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:29.618225 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc53fcee-d983-42a5-ab42-ce3238b007a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:29.618494 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc53fcee-d983-42a5-ab42-ce3238b007a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:29.619170 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc53fcee-d983-42a5-ab42-ce3238b007a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:29.620801 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc53fcee-d983-42a5-ab42-ce3238b007a7 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:29.632130 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:29:29.632761 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 798/1595] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:29:29 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:29:29.633858 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc53fcee-d983-42a5-ab42-ce3238b007a7 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:29.639629 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:29:29.643388 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-875d5809-9246-4e2b-8494-f884668c8d41 None None] MFA Rules not processed for user `5a3b11bf184943698c459d79f158400b`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:29:29.645544 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-875d5809-9246-4e2b-8494-f884668c8d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:29:29.646587 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc53fcee-d983-42a5-ab42-ce3238b007a7 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:29.651768 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1e145c-df9b-41ba-940f-21364f2882af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:29.652983 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1e145c-df9b-41ba-940f-21364f2882af admin admin] REQUEST_METHOD: `PUT` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:29.653330 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1e145c-df9b-41ba-940f-21364f2882af admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:29.653615 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1e145c-df9b-41ba-940f-21364f2882af admin admin] PATH_INFO: `/v3/projects/93d78bffa2c740b1aa7e09882a90eb9a/users/ee19faf2a2c54b19a9dc01d28f045b3a/roles/b5cfd7a855a448359e9017f51d32b6fc` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:29.669463 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1e145c-df9b-41ba-940f-21364f2882af admin admin] RBAC: Authorizing `identity:create_grant(project_id=93d78bffa2c740b1aa7e09882a90eb9a, user_id=ee19faf2a2c54b19a9dc01d28f045b3a, role_id=b5cfd7a855a448359e9017f51d32b6fc)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:29.672292 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1e145c-df9b-41ba-940f-21364f2882af admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:29.689235 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 799/1596] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:29:29 2022] PUT /identity/v3/projects/93d78bffa2c740b1aa7e09882a90eb9a/users/ee19faf2a2c54b19a9dc01d28f045b3a/roles/b5cfd7a855a448359e9017f51d32b6fc => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:29:29.690213 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1e145c-df9b-41ba-940f-21364f2882af admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:29.717499 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 798/1597] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:29:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:29:29.718681 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875d5809-9246-4e2b-8494-f884668c8d41 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:29.730385 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875d5809-9246-4e2b-8494-f884668c8d41 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:29.769724 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1e145c-df9b-41ba-940f-21364f2882af admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:29.775185 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641b1e39-df61-4c5c-9ae0-1449839ce124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:29.775812 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b1e39-df61-4c5c-9ae0-1449839ce124 admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:29.776090 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b1e39-df61-4c5c-9ae0-1449839ce124 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:29.776361 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b1e39-df61-4c5c-9ae0-1449839ce124 admin admin] PATH_INFO: `/v3/projects` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:29.777161 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641b1e39-df61-4c5c-9ae0-1449839ce124 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:29.779452 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641b1e39-df61-4c5c-9ae0-1449839ce124 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:29.795757 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9f2982-3ae7-4fc6-8654-753e3aeaac6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:29.796403 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f2982-3ae7-4fc6-8654-753e3aeaac6d admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:29.796693 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f2982-3ae7-4fc6-8654-753e3aeaac6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:29.797033 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f2982-3ae7-4fc6-8654-753e3aeaac6d admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:29.797757 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9f2982-3ae7-4fc6-8654-753e3aeaac6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:29.799631 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9f2982-3ae7-4fc6-8654-753e3aeaac6d admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:29.807900 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 800/1598] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:29:29 2022] POST /identity/v3/projects => generated 371 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:29:29.809269 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641b1e39-df61-4c5c-9ae0-1449839ce124 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:29.811547 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 799/1599] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:29:29 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:29:29.812420 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9f2982-3ae7-4fc6-8654-753e3aeaac6d admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:29.823949 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9f2982-3ae7-4fc6-8654-753e3aeaac6d admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:29.876880 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641b1e39-df61-4c5c-9ae0-1449839ce124 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:29.881766 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f54630-682c-4209-807d-311204ab318f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:29.882415 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f54630-682c-4209-807d-311204ab318f admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:29.882690 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f54630-682c-4209-807d-311204ab318f admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:29.882991 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f54630-682c-4209-807d-311204ab318f admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:29.883655 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f54630-682c-4209-807d-311204ab318f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:29.884641 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeed2a45-06e7-4207-b9ab-b322948f7140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:29.885297 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f54630-682c-4209-807d-311204ab318f admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:29.885457 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed2a45-06e7-4207-b9ab-b322948f7140 admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:29.885594 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed2a45-06e7-4207-b9ab-b322948f7140 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:29.885866 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed2a45-06e7-4207-b9ab-b322948f7140 admin admin] PATH_INFO: `/v3/projects/0b1d7ad43ff24c31af3b53349b2063cd/users/937aa5c23271467f83b05f570fde7468/roles/b5cfd7a855a448359e9017f51d32b6fc` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:29.896337 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 801/1600] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:29:29 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:29:29.897223 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f54630-682c-4209-807d-311204ab318f admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:29.903937 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeed2a45-06e7-4207-b9ab-b322948f7140 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b1d7ad43ff24c31af3b53349b2063cd, user_id=937aa5c23271467f83b05f570fde7468, role_id=b5cfd7a855a448359e9017f51d32b6fc)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:29.906887 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeed2a45-06e7-4207-b9ab-b322948f7140 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:29.908062 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f54630-682c-4209-807d-311204ab318f admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:29.913327 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96568ce-742e-4531-9a09-74bf9ac6e93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:29.914214 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96568ce-742e-4531-9a09-74bf9ac6e93b admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:29.914515 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96568ce-742e-4531-9a09-74bf9ac6e93b admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:29.914844 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96568ce-742e-4531-9a09-74bf9ac6e93b admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:29.915519 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96568ce-742e-4531-9a09-74bf9ac6e93b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:29.917638 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96568ce-742e-4531-9a09-74bf9ac6e93b admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:29.921834 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 800/1601] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:29:29 2022] PUT /identity/v3/projects/0b1d7ad43ff24c31af3b53349b2063cd/users/937aa5c23271467f83b05f570fde7468/roles/b5cfd7a855a448359e9017f51d32b6fc => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:29:29.922970 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeed2a45-06e7-4207-b9ab-b322948f7140 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:29.938350 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 802/1602] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:29:29 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:29:29.939413 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a7b8c-c90d-4f83-a2dd-dfc5184d4d65 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:29.939704 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a7b8c-c90d-4f83-a2dd-dfc5184d4d65 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:29.939972 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a7b8c-c90d-4f83-a2dd-dfc5184d4d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:29.948016 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:29:29.960015 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-d82a7b8c-c90d-4f83-a2dd-dfc5184d4d65 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:29:29.961631 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-d82a7b8c-c90d-4f83-a2dd-dfc5184d4d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:29:29.993940 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeed2a45-06e7-4207-b9ab-b322948f7140 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:29.999517 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773585d2-583e-4b83-accc-c85fd4106f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:30.000185 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773585d2-583e-4b83-accc-c85fd4106f97 admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:30.000461 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773585d2-583e-4b83-accc-c85fd4106f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:30.000731 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773585d2-583e-4b83-accc-c85fd4106f97 admin admin] PATH_INFO: `/v3/projects/595bc4e7605048c1bf0d807a1bff9ccd/users/63856a53aed44ef0b5388b1d050899fa/roles/b5cfd7a855a448359e9017f51d32b6fc` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:30.006518 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:29:30.016889 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773585d2-583e-4b83-accc-c85fd4106f97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=595bc4e7605048c1bf0d807a1bff9ccd, user_id=63856a53aed44ef0b5388b1d050899fa, role_id=b5cfd7a855a448359e9017f51d32b6fc)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:30.019595 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773585d2-583e-4b83-accc-c85fd4106f97 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:30.023119 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 803/1603] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:29:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:29:30.024615 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1971d1d4-11ed-4e2a-8712-6834045c7f98 None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:30.024924 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1971d1d4-11ed-4e2a-8712-6834045c7f98 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:30.025203 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1971d1d4-11ed-4e2a-8712-6834045c7f98 None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:30.026618 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 804/1604] 10.222.0.79 () {54 vars in 962 bytes} [Wed Aug 31 12:29:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:29:30.027783 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1971d1d4-11ed-4e2a-8712-6834045c7f98 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:30.039711 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 801/1605] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:29:29 2022] PUT /identity/v3/projects/595bc4e7605048c1bf0d807a1bff9ccd/users/63856a53aed44ef0b5388b1d050899fa/roles/b5cfd7a855a448359e9017f51d32b6fc => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:29:30.040780 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773585d2-583e-4b83-accc-c85fd4106f97 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:30.045559 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1971d1d4-11ed-4e2a-8712-6834045c7f98 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:30.106202 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31c1bbb-59f3-4987-a772-629ee64a34cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:30.106732 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c1bbb-59f3-4987-a772-629ee64a34cd admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:30.107031 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c1bbb-59f3-4987-a772-629ee64a34cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:30.107298 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c1bbb-59f3-4987-a772-629ee64a34cd admin admin] PATH_INFO: `/v3/users` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:30.107930 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31c1bbb-59f3-4987-a772-629ee64a34cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:30.109848 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31c1bbb-59f3-4987-a772-629ee64a34cd admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:30.113236 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773585d2-583e-4b83-accc-c85fd4106f97 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:30.117918 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904cdbe0-574c-4890-a3e4-0e1ca0d7e975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:30.118583 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904cdbe0-574c-4890-a3e4-0e1ca0d7e975 admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:30.118884 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904cdbe0-574c-4890-a3e4-0e1ca0d7e975 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:30.119164 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904cdbe0-574c-4890-a3e4-0e1ca0d7e975 admin admin] PATH_INFO: `/v3/projects/7f0366a1574d4dbd83bbb279d320ee6a/users/e443326cf5f14edea961cecfd005c355/roles/b5cfd7a855a448359e9017f51d32b6fc` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:30.133093 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 805/1606] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:29:30 2022] POST /identity/v3/users => generated 292 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:29:30.134028 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31c1bbb-59f3-4987-a772-629ee64a34cd admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:30.135541 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904cdbe0-574c-4890-a3e4-0e1ca0d7e975 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f0366a1574d4dbd83bbb279d320ee6a, user_id=e443326cf5f14edea961cecfd005c355, role_id=b5cfd7a855a448359e9017f51d32b6fc)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:30.138623 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904cdbe0-574c-4890-a3e4-0e1ca0d7e975 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:30.145455 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31c1bbb-59f3-4987-a772-629ee64a34cd admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:30.152181 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 802/1607] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:29:30 2022] PUT /identity/v3/projects/7f0366a1574d4dbd83bbb279d320ee6a/users/e443326cf5f14edea961cecfd005c355/roles/b5cfd7a855a448359e9017f51d32b6fc => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:29:30.153796 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2409f62a-1164-4859-bf8b-e5afaacf86c4 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:30.154098 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2409f62a-1164-4859-bf8b-e5afaacf86c4 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:30.154342 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2409f62a-1164-4859-bf8b-e5afaacf86c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:30.174409 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-2409f62a-1164-4859-bf8b-e5afaacf86c4 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:29:30.175646 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-2409f62a-1164-4859-bf8b-e5afaacf86c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:29:30.216444 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d2892e-0f53-422d-9577-4bc86c65a436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:30.217125 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d2892e-0f53-422d-9577-4bc86c65a436 admin admin] REQUEST_METHOD: `PUT` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:30.217403 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d2892e-0f53-422d-9577-4bc86c65a436 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:30.218051 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d2892e-0f53-422d-9577-4bc86c65a436 admin admin] PATH_INFO: `/v3/projects/67cc2121d964451892be22fdcdd78b63/users/f8a3ebaaec7442039ecda2d63c54cc59/roles/b5cfd7a855a448359e9017f51d32b6fc` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:30.234580 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d2892e-0f53-422d-9577-4bc86c65a436 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67cc2121d964451892be22fdcdd78b63, user_id=f8a3ebaaec7442039ecda2d63c54cc59, role_id=b5cfd7a855a448359e9017f51d32b6fc)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:30.237345 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d2892e-0f53-422d-9577-4bc86c65a436 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:30.238485 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 803/1608] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:29:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:29:30.239341 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2409f62a-1164-4859-bf8b-e5afaacf86c4 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:30.250287 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2409f62a-1164-4859-bf8b-e5afaacf86c4 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:30.254833 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 806/1609] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:29:30 2022] PUT /identity/v3/projects/67cc2121d964451892be22fdcdd78b63/users/f8a3ebaaec7442039ecda2d63c54cc59/roles/b5cfd7a855a448359e9017f51d32b6fc => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:29:30.256325 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d5e4e-8f48-4dfb-a238-ed6ec27ac3e7 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:30.256644 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d5e4e-8f48-4dfb-a238-ed6ec27ac3e7 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:30.256990 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d5e4e-8f48-4dfb-a238-ed6ec27ac3e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:30.271842 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:29:30.298612 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-632d5e4e-8f48-4dfb-a238-ed6ec27ac3e7 None None] MFA Rules not processed for user `62401c8e1457450590f4147e0665265a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:29:30.299908 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-632d5e4e-8f48-4dfb-a238-ed6ec27ac3e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:29:30.311628 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecd95db-3810-48e9-8487-b0c0eb7b4550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:30.312298 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecd95db-3810-48e9-8487-b0c0eb7b4550 admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:30.312574 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecd95db-3810-48e9-8487-b0c0eb7b4550 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:30.312845 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecd95db-3810-48e9-8487-b0c0eb7b4550 admin admin] PATH_INFO: `/v3/projects/7327d2f6422e4bdb9e250e44987dace3/users/64886d73c79649d1a824170a33f53fcb/roles/b5cfd7a855a448359e9017f51d32b6fc` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:30.328020 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecd95db-3810-48e9-8487-b0c0eb7b4550 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7327d2f6422e4bdb9e250e44987dace3, user_id=64886d73c79649d1a824170a33f53fcb, role_id=b5cfd7a855a448359e9017f51d32b6fc)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:30.330815 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecd95db-3810-48e9-8487-b0c0eb7b4550 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:30.347763 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 804/1610] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:29:30 2022] PUT /identity/v3/projects/7327d2f6422e4bdb9e250e44987dace3/users/64886d73c79649d1a824170a33f53fcb/roles/b5cfd7a855a448359e9017f51d32b6fc => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:29:30.348597 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecd95db-3810-48e9-8487-b0c0eb7b4550 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:30.349783 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:29:30.378344 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 807/1611] 10.222.0.79 () {58 vars in 1059 bytes} [Wed Aug 31 12:29:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:29:30.380506 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f29db-2bb1-484c-9454-c51dac750952 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:30.381063 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f29db-2bb1-484c-9454-c51dac750952 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:30.381608 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f29db-2bb1-484c-9454-c51dac750952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:30.423916 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-400f29db-2bb1-484c-9454-c51dac750952 None None] MFA Rules not processed for user `63856a53aed44ef0b5388b1d050899fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:29:30.425829 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-400f29db-2bb1-484c-9454-c51dac750952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:29:30.428565 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecd95db-3810-48e9-8487-b0c0eb7b4550 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:30.434811 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fdea50-2288-4040-8425-ae825e5dc2b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:30.435560 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fdea50-2288-4040-8425-ae825e5dc2b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:30.435939 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fdea50-2288-4040-8425-ae825e5dc2b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:30.436331 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fdea50-2288-4040-8425-ae825e5dc2b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:30.500012 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 808/1612] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:29:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:29:30.501011 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400f29db-2bb1-484c-9454-c51dac750952 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:30.505183 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fdea50-2288-4040-8425-ae825e5dc2b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:30.506477 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fdea50-2288-4040-8425-ae825e5dc2b4 service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:30.513439 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400f29db-2bb1-484c-9454-c51dac750952 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:30.517649 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 805/1613] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:29:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:29:30.519211 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7a169-f647-4264-aeca-4712aee0986f None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:30.519504 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7a169-f647-4264-aeca-4712aee0986f None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:30.519871 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7a169-f647-4264-aeca-4712aee0986f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:30.520175 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed99bd46-f1a6-4606-a14a-ce117675c3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:30.520869 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99bd46-f1a6-4606-a14a-ce117675c3f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:30.521251 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99bd46-f1a6-4606-a14a-ce117675c3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:30.521620 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99bd46-f1a6-4606-a14a-ce117675c3f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:30.522603 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed99bd46-f1a6-4606-a14a-ce117675c3f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:30.524638 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed99bd46-f1a6-4606-a14a-ce117675c3f7 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:30.538261 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 809/1614] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:29:30 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:29:30.539408 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed99bd46-f1a6-4606-a14a-ce117675c3f7 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:30.543027 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-ed99bd46-f1a6-4606-a14a-ce117675c3f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:29:30.554642 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-ccd7a169-f647-4264-aeca-4712aee0986f None None] MFA Rules not processed for user `e443326cf5f14edea961cecfd005c355`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:29:30.556004 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-ccd7a169-f647-4264-aeca-4712aee0986f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:29:30.556870 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed99bd46-f1a6-4606-a14a-ce117675c3f7 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:30.560712 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00114a2-c51e-47ba-9c18-ba2fb053ed55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:30.561405 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00114a2-c51e-47ba-9c18-ba2fb053ed55 service neutron] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:30.562080 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00114a2-c51e-47ba-9c18-ba2fb053ed55 service neutron] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:30.562080 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00114a2-c51e-47ba-9c18-ba2fb053ed55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:30.572228 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00114a2-c51e-47ba-9c18-ba2fb053ed55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:30.573871 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00114a2-c51e-47ba-9c18-ba2fb053ed55 service neutron] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:30.588800 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 810/1615] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:29:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:29:30.590881 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3138c7-00d8-44eb-a084-90e4942335a3 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:30.591062 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3138c7-00d8-44eb-a084-90e4942335a3 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:30.591433 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3138c7-00d8-44eb-a084-90e4942335a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:30.610568 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:29:30.619826 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-6a3138c7-00d8-44eb-a084-90e4942335a3 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:29:30.621375 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-6a3138c7-00d8-44eb-a084-90e4942335a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:29:30.631431 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 811/1616] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:29:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:29:30.632911 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ba8d45-7ddc-4b03-a0b6-d0dfe6c18c73 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:30.633201 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ba8d45-7ddc-4b03-a0b6-d0dfe6c18c73 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:30.633926 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ba8d45-7ddc-4b03-a0b6-d0dfe6c18c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:30.639293 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 806/1617] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:29:30 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:29:30.644102 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd7a169-f647-4264-aeca-4712aee0986f None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:30.665015 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-e6ba8d45-7ddc-4b03-a0b6-d0dfe6c18c73 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:29:30.666322 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-e6ba8d45-7ddc-4b03-a0b6-d0dfe6c18c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:29:30.678668 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 812/1618] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:29:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:29:30.680161 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59558c2f-7318-463e-96f3-64d7311810a1 None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:30.680447 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59558c2f-7318-463e-96f3-64d7311810a1 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:30.680749 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59558c2f-7318-463e-96f3-64d7311810a1 None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:30.682096 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 813/1619] 10.222.0.79 () {54 vars in 962 bytes} [Wed Aug 31 12:29:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:29:30.682811 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59558c2f-7318-463e-96f3-64d7311810a1 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:30.700220 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59558c2f-7318-463e-96f3-64d7311810a1 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:30.707263 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ccb27d-77c1-4dcb-8360-c5ff33d5de08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:30.708007 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ccb27d-77c1-4dcb-8360-c5ff33d5de08 admin admin] REQUEST_METHOD: `PUT` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:30.708421 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ccb27d-77c1-4dcb-8360-c5ff33d5de08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:30.708710 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ccb27d-77c1-4dcb-8360-c5ff33d5de08 admin admin] PATH_INFO: `/v3/projects/99a73559b52542798716692aed3c3af2/users/73b09e94a50a40f3b4fac20f7283a77a/roles/a332ef951db949b0bad7019fbd28a1b9` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:30.732065 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ccb27d-77c1-4dcb-8360-c5ff33d5de08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99a73559b52542798716692aed3c3af2, user_id=73b09e94a50a40f3b4fac20f7283a77a, role_id=a332ef951db949b0bad7019fbd28a1b9)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:30.735631 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ccb27d-77c1-4dcb-8360-c5ff33d5de08 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:30.756372 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 814/1620] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:29:30 2022] PUT /identity/v3/projects/99a73559b52542798716692aed3c3af2/users/73b09e94a50a40f3b4fac20f7283a77a/roles/a332ef951db949b0bad7019fbd28a1b9 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:29:30.757261 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ccb27d-77c1-4dcb-8360-c5ff33d5de08 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:30.798568 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd7a169-f647-4264-aeca-4712aee0986f None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:30.892374 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ccb27d-77c1-4dcb-8360-c5ff33d5de08 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:30.899484 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e433376d-c76c-40d6-b341-b397251d511f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:30.900362 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e433376d-c76c-40d6-b341-b397251d511f admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:30.900693 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e433376d-c76c-40d6-b341-b397251d511f admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:30.901307 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e433376d-c76c-40d6-b341-b397251d511f admin admin] PATH_INFO: `/v3/projects` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:30.902341 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e433376d-c76c-40d6-b341-b397251d511f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:30.905206 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e433376d-c76c-40d6-b341-b397251d511f admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:30.917880 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65554736-286a-46b7-a0b2-560dc52790d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62401c8e1457450590f4147e0665265a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:30.919274 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65554736-286a-46b7-a0b2-560dc52790d9 service nova] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:30.921068 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65554736-286a-46b7-a0b2-560dc52790d9 service nova] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:30.921401 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65554736-286a-46b7-a0b2-560dc52790d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:30.924731 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:29:30.951195 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 815/1621] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:29:30 2022] POST /identity/v3/projects => generated 405 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:29:30.952266 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e433376d-c76c-40d6-b341-b397251d511f admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:31.016401 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65554736-286a-46b7-a0b2-560dc52790d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:31.019729 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65554736-286a-46b7-a0b2-560dc52790d9 service nova] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:31.036515 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 807/1622] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:29:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:29:31.037611 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65554736-286a-46b7-a0b2-560dc52790d9 service nova] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:31.050545 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e433376d-c76c-40d6-b341-b397251d511f admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:31.059171 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15beaacb-d8ca-4cd1-8b30-9cd83a547506 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:31.060875 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15beaacb-d8ca-4cd1-8b30-9cd83a547506 service neutron] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:31.061492 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15beaacb-d8ca-4cd1-8b30-9cd83a547506 service neutron] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:31.061492 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15beaacb-d8ca-4cd1-8b30-9cd83a547506 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:31.066780 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:29:31.105147 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65554736-286a-46b7-a0b2-560dc52790d9 service nova] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:31.111193 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c1ff1c-6bd2-4f6d-bd7a-23ca0bd3957a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:31.111846 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c1ff1c-6bd2-4f6d-bd7a-23ca0bd3957a service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:31.112128 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c1ff1c-6bd2-4f6d-bd7a-23ca0bd3957a service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:31.112407 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c1ff1c-6bd2-4f6d-bd7a-23ca0bd3957a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:31.214052 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15beaacb-d8ca-4cd1-8b30-9cd83a547506 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:31.218162 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15beaacb-d8ca-4cd1-8b30-9cd83a547506 service neutron] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:31.242769 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 816/1623] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:29:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:29:31.245168 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88481fc5-f5b4-407d-a61b-adefd7dac355 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:31.247379 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88481fc5-f5b4-407d-a61b-adefd7dac355 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:31.247668 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88481fc5-f5b4-407d-a61b-adefd7dac355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:31.251050 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c1ff1c-6bd2-4f6d-bd7a-23ca0bd3957a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:31.254833 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c1ff1c-6bd2-4f6d-bd7a-23ca0bd3957a service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:31.278545 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 808/1624] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:29:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:29:31.279461 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c1ff1c-6bd2-4f6d-bd7a-23ca0bd3957a service neutron] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:31.288710 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-88481fc5-f5b4-407d-a61b-adefd7dac355 None None] MFA Rules not processed for user `62401c8e1457450590f4147e0665265a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:29:31.289934 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-88481fc5-f5b4-407d-a61b-adefd7dac355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:29:31.306954 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c1ff1c-6bd2-4f6d-bd7a-23ca0bd3957a service neutron] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:31.322661 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef8dca1-1a73-40d5-a5e9-5b1704b8ef8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:31.325702 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef8dca1-1a73-40d5-a5e9-5b1704b8ef8e admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:31.325987 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef8dca1-1a73-40d5-a5e9-5b1704b8ef8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:31.326627 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef8dca1-1a73-40d5-a5e9-5b1704b8ef8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:31.328944 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef8dca1-1a73-40d5-a5e9-5b1704b8ef8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:31.337746 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef8dca1-1a73-40d5-a5e9-5b1704b8ef8e admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:31.377057 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 809/1625] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:29:31 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:29:31.378697 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef8dca1-1a73-40d5-a5e9-5b1704b8ef8e admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:31.401999 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef8dca1-1a73-40d5-a5e9-5b1704b8ef8e admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:31.407826 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 817/1626] 10.222.0.79 () {58 vars in 1059 bytes} [Wed Aug 31 12:29:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:29:31.408693 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88481fc5-f5b4-407d-a61b-adefd7dac355 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:31.415041 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d324db-db31-48e6-bd63-45c17cc5470c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:31.415817 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d324db-db31-48e6-bd63-45c17cc5470c admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:31.416186 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d324db-db31-48e6-bd63-45c17cc5470c admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:31.416598 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d324db-db31-48e6-bd63-45c17cc5470c admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:31.420871 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d324db-db31-48e6-bd63-45c17cc5470c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:31.421394 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88481fc5-f5b4-407d-a61b-adefd7dac355 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:31.423098 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d324db-db31-48e6-bd63-45c17cc5470c admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:31.429073 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8eb1fb-5a62-47a6-a5c1-a55031595212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:31.456959 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8eb1fb-5a62-47a6-a5c1-a55031595212 admin admin] REQUEST_METHOD: `PUT` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:31.458413 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8eb1fb-5a62-47a6-a5c1-a55031595212 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:31.460026 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8eb1fb-5a62-47a6-a5c1-a55031595212 admin admin] PATH_INFO: `/v3/projects/99a73559b52542798716692aed3c3af2/users/73b09e94a50a40f3b4fac20f7283a77a/roles/a332ef951db949b0bad7019fbd28a1b9` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:31.469534 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8eb1fb-5a62-47a6-a5c1-a55031595212 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99a73559b52542798716692aed3c3af2, user_id=73b09e94a50a40f3b4fac20f7283a77a, role_id=a332ef951db949b0bad7019fbd28a1b9)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:31.470391 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 810/1627] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:29:31 2022] POST /identity/v3/users => generated 309 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:29:31.474215 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d324db-db31-48e6-bd63-45c17cc5470c admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:31.475543 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8eb1fb-5a62-47a6-a5c1-a55031595212 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:31.504042 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d324db-db31-48e6-bd63-45c17cc5470c admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:31.507298 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 818/1628] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:29:31 2022] PUT /identity/v3/projects/99a73559b52542798716692aed3c3af2/users/73b09e94a50a40f3b4fac20f7283a77a/roles/a332ef951db949b0bad7019fbd28a1b9 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:29:31.509982 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a6ab6d-00dd-43fa-9790-0c736b213299 None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:31.512886 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a6ab6d-00dd-43fa-9790-0c736b213299 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:31.513313 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a6ab6d-00dd-43fa-9790-0c736b213299 None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:31.516633 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 819/1629] 10.222.0.79 () {54 vars in 912 bytes} [Wed Aug 31 12:29:31 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:29:31.518965 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a6ab6d-00dd-43fa-9790-0c736b213299 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:31.568326 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:29:31.623547 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a6ab6d-00dd-43fa-9790-0c736b213299 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:31.629671 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d89509a-2786-49bf-bb9c-a76ed0df6f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:31.630967 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d89509a-2786-49bf-bb9c-a76ed0df6f95 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:31.631096 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d89509a-2786-49bf-bb9c-a76ed0df6f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:31.631466 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d89509a-2786-49bf-bb9c-a76ed0df6f95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:31.632760 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d89509a-2786-49bf-bb9c-a76ed0df6f95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:31.634256 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d89509a-2786-49bf-bb9c-a76ed0df6f95 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:31.647640 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 820/1630] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:29:31 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:29:31.652426 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc028d7e-14ea-4f86-ae9c-875e269b41cf None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:31.652720 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc028d7e-14ea-4f86-ae9c-875e269b41cf None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:31.653096 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc028d7e-14ea-4f86-ae9c-875e269b41cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:31.653511 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e55fbf4-7f27-4315-a34d-7c73b49de7ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62401c8e1457450590f4147e0665265a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:31.654193 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e55fbf4-7f27-4315-a34d-7c73b49de7ef service nova] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:31.654484 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e55fbf4-7f27-4315-a34d-7c73b49de7ef service nova] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:31.654744 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e55fbf4-7f27-4315-a34d-7c73b49de7ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:31.696328 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-cc028d7e-14ea-4f86-ae9c-875e269b41cf None None] MFA Rules not processed for user `73b09e94a50a40f3b4fac20f7283a77a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:29:31.697592 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-cc028d7e-14ea-4f86-ae9c-875e269b41cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:29:31.745592 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:29:31.798616 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e55fbf4-7f27-4315-a34d-7c73b49de7ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:31.806268 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e55fbf4-7f27-4315-a34d-7c73b49de7ef service nova] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:31.839007 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 811/1631] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:29:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:29:31.841565 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 821/1632] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:29:31 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:29:31.843610 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ca6e6-fe32-43a7-8fed-514dee7e9325 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:31.844090 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ca6e6-fe32-43a7-8fed-514dee7e9325 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:31.844374 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ca6e6-fe32-43a7-8fed-514dee7e9325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:31.844596 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc028d7e-14ea-4f86-ae9c-875e269b41cf None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:31.865195 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc028d7e-14ea-4f86-ae9c-875e269b41cf None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:31.880937 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5814dd78-b6e8-4e52-aff3-d23afa710ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:31.881702 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5814dd78-b6e8-4e52-aff3-d23afa710ba0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:31.881986 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5814dd78-b6e8-4e52-aff3-d23afa710ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:31.882259 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5814dd78-b6e8-4e52-aff3-d23afa710ba0 admin admin] PATH_INFO: `/v3/projects/112f55a5b99a478d868f3b95d3f7b953/users/2c651d8af9c64260b03d44dab6d22cd9/roles/a332ef951db949b0bad7019fbd28a1b9` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:31.898084 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-870ca6e6-fe32-43a7-8fed-514dee7e9325 None None] MFA Rules not processed for user `62401c8e1457450590f4147e0665265a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:29:31.899815 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-870ca6e6-fe32-43a7-8fed-514dee7e9325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:29:31.913876 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5814dd78-b6e8-4e52-aff3-d23afa710ba0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=112f55a5b99a478d868f3b95d3f7b953, user_id=2c651d8af9c64260b03d44dab6d22cd9, role_id=a332ef951db949b0bad7019fbd28a1b9)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:31.919395 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 812/1633] 10.222.0.79 () {58 vars in 1009 bytes} [Wed Aug 31 12:29:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:29:31.925542 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5814dd78-b6e8-4e52-aff3-d23afa710ba0 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:31.928522 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870ca6e6-fe32-43a7-8fed-514dee7e9325 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:31.955930 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 822/1634] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:29:31 2022] PUT /identity/v3/projects/112f55a5b99a478d868f3b95d3f7b953/users/2c651d8af9c64260b03d44dab6d22cd9/roles/a332ef951db949b0bad7019fbd28a1b9 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:29:31.955930 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5814dd78-b6e8-4e52-aff3-d23afa710ba0 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:32.074010 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5814dd78-b6e8-4e52-aff3-d23afa710ba0 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:32.079984 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870ca6e6-fe32-43a7-8fed-514dee7e9325 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:32.083707 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db07c25-11fd-40f9-a73e-d721cc048e48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e79503178ac54e62ba385467d5617ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:32.084809 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db07c25-11fd-40f9-a73e-d721cc048e48 service cinder] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:32.085360 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db07c25-11fd-40f9-a73e-d721cc048e48 service cinder] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:32.086303 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db07c25-11fd-40f9-a73e-d721cc048e48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:32.088836 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e86648e-79d1-43d3-9fab-af1464d6d00f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e79503178ac54e62ba385467d5617ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:32.089418 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86648e-79d1-43d3-9fab-af1464d6d00f service cinder] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:32.089705 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86648e-79d1-43d3-9fab-af1464d6d00f service cinder] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:32.090596 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86648e-79d1-43d3-9fab-af1464d6d00f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:32.146706 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:29:32.207149 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db07c25-11fd-40f9-a73e-d721cc048e48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:32.208530 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db07c25-11fd-40f9-a73e-d721cc048e48 service cinder] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:32.220966 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e86648e-79d1-43d3-9fab-af1464d6d00f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:32.223826 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e86648e-79d1-43d3-9fab-af1464d6d00f service cinder] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:32.224604 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 823/1635] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:29:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:29:32.225531 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db07c25-11fd-40f9-a73e-d721cc048e48 service cinder] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:32.239155 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 813/1636] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:29:31 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:29:32.352612 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db07c25-11fd-40f9-a73e-d721cc048e48 service cinder] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:32.375264 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b2a189-3f44-4699-94b8-1144846a84af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:32.375264 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b2a189-3f44-4699-94b8-1144846a84af admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:32.375264 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b2a189-3f44-4699-94b8-1144846a84af admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:32.375264 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b2a189-3f44-4699-94b8-1144846a84af admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:32.379060 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b2a189-3f44-4699-94b8-1144846a84af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:32.383017 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b2a189-3f44-4699-94b8-1144846a84af admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:32.388254 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3746db-0939-472c-8f68-f770936bfac9 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:32.388870 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3746db-0939-472c-8f68-f770936bfac9 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:32.389344 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3746db-0939-472c-8f68-f770936bfac9 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:32.393123 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 814/1637] 10.222.0.79 () {54 vars in 912 bytes} [Wed Aug 31 12:29:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:29:32.405112 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d45372-9896-4cfd-aecf-78be943eadf3 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:32.405805 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d45372-9896-4cfd-aecf-78be943eadf3 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:32.406308 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d45372-9896-4cfd-aecf-78be943eadf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:32.413129 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 824/1638] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:29:32 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:29:32.414320 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b2a189-3f44-4699-94b8-1144846a84af admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:32.430493 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b2a189-3f44-4699-94b8-1144846a84af admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:32.437842 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-54d45372-9896-4cfd-aecf-78be943eadf3 None None] MFA Rules not processed for user `62401c8e1457450590f4147e0665265a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:29:32.439425 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-54d45372-9896-4cfd-aecf-78be943eadf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:29:32.439899 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738ac33a-e03f-4bfd-beb3-2dd435052cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:32.440736 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738ac33a-e03f-4bfd-beb3-2dd435052cd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:32.441124 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738ac33a-e03f-4bfd-beb3-2dd435052cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:32.441936 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738ac33a-e03f-4bfd-beb3-2dd435052cd9 admin admin] PATH_INFO: `/v3/projects/112f55a5b99a478d868f3b95d3f7b953/users/2c651d8af9c64260b03d44dab6d22cd9/roles/a332ef951db949b0bad7019fbd28a1b9` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:32.444483 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738ac33a-e03f-4bfd-beb3-2dd435052cd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=112f55a5b99a478d868f3b95d3f7b953, user_id=2c651d8af9c64260b03d44dab6d22cd9, role_id=a332ef951db949b0bad7019fbd28a1b9)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:32.447821 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738ac33a-e03f-4bfd-beb3-2dd435052cd9 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:32.455923 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 815/1639] 10.222.0.79 () {58 vars in 1009 bytes} [Wed Aug 31 12:29:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:29:32.470754 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d45372-9896-4cfd-aecf-78be943eadf3 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:32.476997 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 825/1640] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:29:32 2022] PUT /identity/v3/projects/112f55a5b99a478d868f3b95d3f7b953/users/2c651d8af9c64260b03d44dab6d22cd9/roles/a332ef951db949b0bad7019fbd28a1b9 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:29:32.478997 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7552f18-7481-487c-9dc4-2824b5569e78 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:32.479287 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7552f18-7481-487c-9dc4-2824b5569e78 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:32.479617 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7552f18-7481-487c-9dc4-2824b5569e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:32.488980 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d45372-9896-4cfd-aecf-78be943eadf3 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:32.535480 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-b7552f18-7481-487c-9dc4-2824b5569e78 None None] MFA Rules not processed for user `2c651d8af9c64260b03d44dab6d22cd9`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:29:32.537282 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-b7552f18-7481-487c-9dc4-2824b5569e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:29:32.560223 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19833698-9473-4002-a5c5-f9ae1e4737fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e79503178ac54e62ba385467d5617ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:32.560738 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19833698-9473-4002-a5c5-f9ae1e4737fc service cinder] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:32.561113 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19833698-9473-4002-a5c5-f9ae1e4737fc service cinder] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:32.561551 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19833698-9473-4002-a5c5-f9ae1e4737fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:32.607158 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:29:32.657536 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 826/1641] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:29:32 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:29:32.662578 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7552f18-7481-487c-9dc4-2824b5569e78 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:32.670699 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19833698-9473-4002-a5c5-f9ae1e4737fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:32.675053 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7552f18-7481-487c-9dc4-2824b5569e78 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:32.676243 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19833698-9473-4002-a5c5-f9ae1e4737fc service cinder] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:32.679040 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e55377-85db-4f82-bcf8-4342729ad335 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e79503178ac54e62ba385467d5617ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:32.679683 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e55377-85db-4f82-bcf8-4342729ad335 service cinder] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:32.679963 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e55377-85db-4f82-bcf8-4342729ad335 service cinder] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:32.680234 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e55377-85db-4f82-bcf8-4342729ad335 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:32.704061 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 816/1642] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:29:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:29:32.753926 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:29:32.812497 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e55377-85db-4f82-bcf8-4342729ad335 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:32.814199 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e55377-85db-4f82-bcf8-4342729ad335 service cinder] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:32.843308 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 827/1643] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:29:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:29:33.365136 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19833698-9473-4002-a5c5-f9ae1e4737fc service cinder] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:33.377983 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19833698-9473-4002-a5c5-f9ae1e4737fc service cinder] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:33.385017 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d5c901-a1ae-4dae-bb1a-815b2bb417c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e79503178ac54e62ba385467d5617ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:33.387220 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d5c901-a1ae-4dae-bb1a-815b2bb417c7 service cinder] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:33.388576 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d5c901-a1ae-4dae-bb1a-815b2bb417c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:33.389321 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d5c901-a1ae-4dae-bb1a-815b2bb417c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:33.403917 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d5c901-a1ae-4dae-bb1a-815b2bb417c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:33.405791 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d5c901-a1ae-4dae-bb1a-815b2bb417c7 service cinder] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:33.431054 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 817/1644] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:29:33 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:29:33.556966 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e55377-85db-4f82-bcf8-4342729ad335 service cinder] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:33.748308 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e55377-85db-4f82-bcf8-4342729ad335 service cinder] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:33.755374 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ff45af-c44a-4705-ad45-3d54843624f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:33.761397 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff45af-c44a-4705-ad45-3d54843624f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:33.765050 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff45af-c44a-4705-ad45-3d54843624f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:33.765548 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff45af-c44a-4705-ad45-3d54843624f0 admin admin] PATH_INFO: `/v3/users/5a3b11bf184943698c459d79f158400b` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:33.769481 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ff45af-c44a-4705-ad45-3d54843624f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a3b11bf184943698c459d79f158400b)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:33.774253 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ff45af-c44a-4705-ad45-3d54843624f0 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:33.919438 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-b3ff45af-c44a-4705-ad45-3d54843624f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a3b11bf184943698c459d79f158400b'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:29:33.963713 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-b3ff45af-c44a-4705-ad45-3d54843624f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a3b11bf184943698c459d79f158400b'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:29:34.075522 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-b3ff45af-c44a-4705-ad45-3d54843624f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a3b11bf184943698c459d79f158400b'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:29:34.075522 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-b3ff45af-c44a-4705-ad45-3d54843624f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a3b11bf184943698c459d79f158400b'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:29:34.075522 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-b3ff45af-c44a-4705-ad45-3d54843624f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a3b11bf184943698c459d79f158400b'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:29:34.075522 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 828/1645] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:29:33 2022] DELETE /identity/v3/users/5a3b11bf184943698c459d79f158400b => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:29:34.081220 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea84e89-7a46-4e35-b288-d8a50819f60b None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:34.081220 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea84e89-7a46-4e35-b288-d8a50819f60b None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:34.081220 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea84e89-7a46-4e35-b288-d8a50819f60b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:34.102950 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-aea84e89-7a46-4e35-b288-d8a50819f60b None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:29:34.104541 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-aea84e89-7a46-4e35-b288-d8a50819f60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:29:34.209482 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ff45af-c44a-4705-ad45-3d54843624f0 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:34.211319 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-b3ff45af-c44a-4705-ad45-3d54843624f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:29:34.277999 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 818/1646] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:29:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:29:34.330680 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:29:34.335077 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea84e89-7a46-4e35-b288-d8a50819f60b None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:34.337028 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-aea84e89-7a46-4e35-b288-d8a50819f60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:29:34.444473 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ff45af-c44a-4705-ad45-3d54843624f0 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:34.458974 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cf4814-5e2d-4011-8782-3574b25ac9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:34.463763 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf4814-5e2d-4011-8782-3574b25ac9e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:34.464104 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf4814-5e2d-4011-8782-3574b25ac9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:34.510897 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf4814-5e2d-4011-8782-3574b25ac9e2 admin admin] PATH_INFO: `/v3/users/e443326cf5f14edea961cecfd005c355` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:34.510897 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cf4814-5e2d-4011-8782-3574b25ac9e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e443326cf5f14edea961cecfd005c355)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:34.510897 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cf4814-5e2d-4011-8782-3574b25ac9e2 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:34.579733 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea84e89-7a46-4e35-b288-d8a50819f60b None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:34.599970 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84cfdac-9e46-4942-8354-f15b5f794923 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:34.601406 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84cfdac-9e46-4942-8354-f15b5f794923 service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:34.601690 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84cfdac-9e46-4942-8354-f15b5f794923 service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:34.601962 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84cfdac-9e46-4942-8354-f15b5f794923 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:34.625194 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-70cf4814-5e2d-4011-8782-3574b25ac9e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e443326cf5f14edea961cecfd005c355'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:29:34.635382 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84cfdac-9e46-4942-8354-f15b5f794923 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:34.637451 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84cfdac-9e46-4942-8354-f15b5f794923 service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:34.655063 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-70cf4814-5e2d-4011-8782-3574b25ac9e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e443326cf5f14edea961cecfd005c355'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:29:34.665743 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 819/1647] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:29:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:29:34.669950 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-70cf4814-5e2d-4011-8782-3574b25ac9e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e443326cf5f14edea961cecfd005c355'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:29:34.670766 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-70cf4814-5e2d-4011-8782-3574b25ac9e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e443326cf5f14edea961cecfd005c355'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:29:34.688500 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-70cf4814-5e2d-4011-8782-3574b25ac9e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e443326cf5f14edea961cecfd005c355'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:29:34.720542 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 829/1648] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:29:34 2022] DELETE /identity/v3/users/e443326cf5f14edea961cecfd005c355 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:29:34.725020 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf6c0e2-f9c4-4392-9c2d-5f75355aaf23 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:34.725298 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf6c0e2-f9c4-4392-9c2d-5f75355aaf23 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:34.725560 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf6c0e2-f9c4-4392-9c2d-5f75355aaf23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:34.789823 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-2bf6c0e2-f9c4-4392-9c2d-5f75355aaf23 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:29:34.793396 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-2bf6c0e2-f9c4-4392-9c2d-5f75355aaf23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:29:34.966206 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:29:35.029979 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 820/1649] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:29:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:29:35.214200 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cf4814-5e2d-4011-8782-3574b25ac9e2 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:35.216697 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-70cf4814-5e2d-4011-8782-3574b25ac9e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:29:35.408047 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cf4814-5e2d-4011-8782-3574b25ac9e2 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:35.419256 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b1ecf1-6c4f-4764-9155-566ea15e7aa8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:35.421409 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b1ecf1-6c4f-4764-9155-566ea15e7aa8 service neutron] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:35.422888 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b1ecf1-6c4f-4764-9155-566ea15e7aa8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:35.422888 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b1ecf1-6c4f-4764-9155-566ea15e7aa8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:35.448733 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b1ecf1-6c4f-4764-9155-566ea15e7aa8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:35.452292 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b1ecf1-6c4f-4764-9155-566ea15e7aa8 service neutron] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:35.483194 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 830/1650] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:29:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:29:36.225240 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf6c0e2-f9c4-4392-9c2d-5f75355aaf23 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:36.227311 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-2bf6c0e2-f9c4-4392-9c2d-5f75355aaf23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:29:36.246994 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf6c0e2-f9c4-4392-9c2d-5f75355aaf23 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:36.261740 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aba6f3b-9e0c-478e-b227-11cebe9bed15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:36.264146 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba6f3b-9e0c-478e-b227-11cebe9bed15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:36.272094 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba6f3b-9e0c-478e-b227-11cebe9bed15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:36.273021 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba6f3b-9e0c-478e-b227-11cebe9bed15 admin admin] PATH_INFO: `/v3/projects/ca25ca2519ae4697b952d9451321980d` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:36.278055 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aba6f3b-9e0c-478e-b227-11cebe9bed15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca25ca2519ae4697b952d9451321980d)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:36.284847 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aba6f3b-9e0c-478e-b227-11cebe9bed15 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:36.460004 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-5aba6f3b-9e0c-478e-b227-11cebe9bed15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca25ca2519ae4697b952d9451321980d', 'request_id': 'req-5aba6f3b-9e0c-478e-b227-11cebe9bed15'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:29:36.484643 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-5aba6f3b-9e0c-478e-b227-11cebe9bed15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca25ca2519ae4697b952d9451321980d', 'request_id': 'req-5aba6f3b-9e0c-478e-b227-11cebe9bed15'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:29:36.507560 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-5aba6f3b-9e0c-478e-b227-11cebe9bed15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca25ca2519ae4697b952d9451321980d', 'request_id': 'req-5aba6f3b-9e0c-478e-b227-11cebe9bed15'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:29:36.551687 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-5aba6f3b-9e0c-478e-b227-11cebe9bed15 admin admin] The token cache is being invalidate because project ca25ca2519ae4697b952d9451321980d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:29:36.551996 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-5aba6f3b-9e0c-478e-b227-11cebe9bed15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:29:36.552618 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-5aba6f3b-9e0c-478e-b227-11cebe9bed15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:29:36.554486 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 821/1651] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:29:36 2022] DELETE /identity/v3/projects/ca25ca2519ae4697b952d9451321980d => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:29:36.559767 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c038e2f7-20f4-4592-8e46-197642ff4f47 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:36.560382 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c038e2f7-20f4-4592-8e46-197642ff4f47 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:36.560382 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c038e2f7-20f4-4592-8e46-197642ff4f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:36.608492 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-c038e2f7-20f4-4592-8e46-197642ff4f47 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:29:36.609759 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-c038e2f7-20f4-4592-8e46-197642ff4f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:29:36.776659 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aba6f3b-9e0c-478e-b227-11cebe9bed15 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:36.778787 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-5aba6f3b-9e0c-478e-b227-11cebe9bed15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:29:36.800065 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 831/1652] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:29:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:29:36.809441 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372fd560-51fa-4cfd-b823-e7c21559fb16 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:36.810029 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372fd560-51fa-4cfd-b823-e7c21559fb16 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:36.810468 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372fd560-51fa-4cfd-b823-e7c21559fb16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:36.811904 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aba6f3b-9e0c-478e-b227-11cebe9bed15 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:36.825592 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1459e863-45b0-4047-87b1-256bdbdea443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:36.826312 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1459e863-45b0-4047-87b1-256bdbdea443 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:36.826594 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1459e863-45b0-4047-87b1-256bdbdea443 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:36.826886 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1459e863-45b0-4047-87b1-256bdbdea443 admin admin] PATH_INFO: `/v3/users/63856a53aed44ef0b5388b1d050899fa` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:36.828108 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1459e863-45b0-4047-87b1-256bdbdea443 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63856a53aed44ef0b5388b1d050899fa)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:36.829147 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: WARNING py.warnings [None req-1459e863-45b0-4047-87b1-256bdbdea443 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 12:29:36.829147 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: warnings.warn(msg) Aug 31 12:29:36.829147 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: Aug 31 12:29:36.830870 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1459e863-45b0-4047-87b1-256bdbdea443 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:36.867409 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-372fd560-51fa-4cfd-b823-e7c21559fb16 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:29:36.869389 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-372fd560-51fa-4cfd-b823-e7c21559fb16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:29:36.892611 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 832/1653] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:29:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:29:36.896906 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372fd560-51fa-4cfd-b823-e7c21559fb16 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:36.901703 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:29:36.912531 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372fd560-51fa-4cfd-b823-e7c21559fb16 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:36.919469 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4425b29-8253-43da-ba28-53fb0774cf6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:36.920377 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4425b29-8253-43da-ba28-53fb0774cf6e admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:36.920769 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4425b29-8253-43da-ba28-53fb0774cf6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:36.921246 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4425b29-8253-43da-ba28-53fb0774cf6e admin admin] PATH_INFO: `/v3/domains` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:36.922352 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4425b29-8253-43da-ba28-53fb0774cf6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:29:36.922917 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4425b29-8253-43da-ba28-53fb0774cf6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:36.925331 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4425b29-8253-43da-ba28-53fb0774cf6e admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:36.947872 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 833/1654] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 12:29:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:29:36.948891 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4425b29-8253-43da-ba28-53fb0774cf6e admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:36.964216 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4425b29-8253-43da-ba28-53fb0774cf6e admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:36.983044 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcc8f40-e277-445c-8134-313b9b0194c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:36.985521 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcc8f40-e277-445c-8134-313b9b0194c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:36.993999 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcc8f40-e277-445c-8134-313b9b0194c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:36.993999 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcc8f40-e277-445c-8134-313b9b0194c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:36.993999 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcc8f40-e277-445c-8134-313b9b0194c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:36.997982 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcc8f40-e277-445c-8134-313b9b0194c9 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:37.036830 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-1459e863-45b0-4047-87b1-256bdbdea443 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63856a53aed44ef0b5388b1d050899fa'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:29:37.063331 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 834/1655] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:29:36 2022] POST /identity/v3/projects => generated 357 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:29:37.064608 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcc8f40-e277-445c-8134-313b9b0194c9 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:37.073392 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-1459e863-45b0-4047-87b1-256bdbdea443 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63856a53aed44ef0b5388b1d050899fa'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:29:37.083376 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-1459e863-45b0-4047-87b1-256bdbdea443 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63856a53aed44ef0b5388b1d050899fa'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:29:37.104107 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-1459e863-45b0-4047-87b1-256bdbdea443 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63856a53aed44ef0b5388b1d050899fa'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:29:37.104885 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-1459e863-45b0-4047-87b1-256bdbdea443 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63856a53aed44ef0b5388b1d050899fa'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:29:37.129474 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 822/1656] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:29:36 2022] DELETE /identity/v3/users/63856a53aed44ef0b5388b1d050899fa => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:29:37.133885 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef6031d-6546-4cf8-b74d-5d029c8f05f0 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:37.134172 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef6031d-6546-4cf8-b74d-5d029c8f05f0 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:37.134451 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef6031d-6546-4cf8-b74d-5d029c8f05f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:37.175597 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-bef6031d-6546-4cf8-b74d-5d029c8f05f0 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:29:37.176870 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-bef6031d-6546-4cf8-b74d-5d029c8f05f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:29:37.185527 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcc8f40-e277-445c-8134-313b9b0194c9 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:37.258618 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:29:37.284376 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aa3ca0-b02d-4c7f-a050-5c37c4dc6eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:37.285244 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa3ca0-b02d-4c7f-a050-5c37c4dc6eb4 admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:37.285666 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa3ca0-b02d-4c7f-a050-5c37c4dc6eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:37.286080 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa3ca0-b02d-4c7f-a050-5c37c4dc6eb4 admin admin] PATH_INFO: `/v3/users` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:37.287103 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aa3ca0-b02d-4c7f-a050-5c37c4dc6eb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:37.289409 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aa3ca0-b02d-4c7f-a050-5c37c4dc6eb4 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:37.310553 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 823/1657] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:29:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:29:37.333217 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 835/1658] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:29:37 2022] POST /identity/v3/users => generated 279 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:29:37.334226 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef6031d-6546-4cf8-b74d-5d029c8f05f0 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:37.335715 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-bef6031d-6546-4cf8-b74d-5d029c8f05f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:29:37.347429 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aa3ca0-b02d-4c7f-a050-5c37c4dc6eb4 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:37.355299 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef6031d-6546-4cf8-b74d-5d029c8f05f0 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:37.360580 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-31aa3ca0-b02d-4c7f-a050-5c37c4dc6eb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:29:37.372688 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be431fc4-ec24-443c-97bc-b4c0f4e701e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:37.373345 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be431fc4-ec24-443c-97bc-b4c0f4e701e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:37.373627 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be431fc4-ec24-443c-97bc-b4c0f4e701e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:37.373888 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be431fc4-ec24-443c-97bc-b4c0f4e701e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:37.374554 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be431fc4-ec24-443c-97bc-b4c0f4e701e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:37.377416 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be431fc4-ec24-443c-97bc-b4c0f4e701e6 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:37.407604 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 824/1659] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:29:37 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 12:29:37.408824 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be431fc4-ec24-443c-97bc-b4c0f4e701e6 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:37.420676 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be431fc4-ec24-443c-97bc-b4c0f4e701e6 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:37.438578 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ebdeed-e6e7-4d72-a93a-db9403ffa4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:37.453388 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ebdeed-e6e7-4d72-a93a-db9403ffa4b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:37.453785 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ebdeed-e6e7-4d72-a93a-db9403ffa4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:37.454203 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ebdeed-e6e7-4d72-a93a-db9403ffa4b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:37.455057 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ebdeed-e6e7-4d72-a93a-db9403ffa4b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:37.458308 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ebdeed-e6e7-4d72-a93a-db9403ffa4b1 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:37.481830 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 825/1660] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:29:37 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 12:29:37.483142 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ebdeed-e6e7-4d72-a93a-db9403ffa4b1 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:37.499323 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ebdeed-e6e7-4d72-a93a-db9403ffa4b1 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:37.506764 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f03e10-f53a-4a49-ba35-5ef0a4f8812c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:37.507788 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f03e10-f53a-4a49-ba35-5ef0a4f8812c admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:37.508078 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f03e10-f53a-4a49-ba35-5ef0a4f8812c admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:37.508361 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f03e10-f53a-4a49-ba35-5ef0a4f8812c admin admin] PATH_INFO: `/v3/projects/68fa0055c1184e18bdfde9cf95cae39d/users/d39f66fe1acb4877b79e2ea77ec28f89/roles/b5cfd7a855a448359e9017f51d32b6fc` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:37.511491 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aa3ca0-b02d-4c7f-a050-5c37c4dc6eb4 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:37.528644 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a76f8f-d44d-4b26-a99e-a7ea2a2993de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:37.529291 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a76f8f-d44d-4b26-a99e-a7ea2a2993de service neutron] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:37.529599 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a76f8f-d44d-4b26-a99e-a7ea2a2993de service neutron] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:37.529837 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a76f8f-d44d-4b26-a99e-a7ea2a2993de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:37.550314 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a76f8f-d44d-4b26-a99e-a7ea2a2993de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:37.552008 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a76f8f-d44d-4b26-a99e-a7ea2a2993de service neutron] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:37.553559 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f03e10-f53a-4a49-ba35-5ef0a4f8812c admin admin] RBAC: Authorizing `identity:create_grant(project_id=68fa0055c1184e18bdfde9cf95cae39d, user_id=d39f66fe1acb4877b79e2ea77ec28f89, role_id=b5cfd7a855a448359e9017f51d32b6fc)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:37.557291 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f03e10-f53a-4a49-ba35-5ef0a4f8812c admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:37.574475 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 836/1661] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:29:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:29:37.588173 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 826/1662] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:29:37 2022] PUT /identity/v3/projects/68fa0055c1184e18bdfde9cf95cae39d/users/d39f66fe1acb4877b79e2ea77ec28f89/roles/b5cfd7a855a448359e9017f51d32b6fc => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:29:37.588710 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f8872-aa99-44a8-a753-3330b2109329 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:37.588998 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f8872-aa99-44a8-a753-3330b2109329 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:37.589274 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f8872-aa99-44a8-a753-3330b2109329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:37.606118 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:29:37.639697 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-fc9f8872-aa99-44a8-a753-3330b2109329 None None] MFA Rules not processed for user `d39f66fe1acb4877b79e2ea77ec28f89`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:29:37.641521 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-fc9f8872-aa99-44a8-a753-3330b2109329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:29:37.760394 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 837/1663] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:29:37 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:29:37.766520 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f03e10-f53a-4a49-ba35-5ef0a4f8812c admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:37.810416 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9f8872-aa99-44a8-a753-3330b2109329 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:37.812453 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-fc9f8872-aa99-44a8-a753-3330b2109329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:29:37.926575 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f03e10-f53a-4a49-ba35-5ef0a4f8812c admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:37.958568 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77a05b2-fe54-4732-bb71-1cf23b201630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:37.961712 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a05b2-fe54-4732-bb71-1cf23b201630 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:37.962247 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a05b2-fe54-4732-bb71-1cf23b201630 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:37.964221 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a05b2-fe54-4732-bb71-1cf23b201630 admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:37.966305 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77a05b2-fe54-4732-bb71-1cf23b201630 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:37.969209 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77a05b2-fe54-4732-bb71-1cf23b201630 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:38.050184 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9f8872-aa99-44a8-a753-3330b2109329 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:38.073479 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ccb3b5-d93a-4b88-b0f4-0075f41a35ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:38.077686 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ccb3b5-d93a-4b88-b0f4-0075f41a35ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:38.087569 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ccb3b5-d93a-4b88-b0f4-0075f41a35ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:38.087569 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ccb3b5-d93a-4b88-b0f4-0075f41a35ca admin admin] PATH_INFO: `/v3/projects/7f0366a1574d4dbd83bbb279d320ee6a` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:38.087954 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 827/1664] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:29:37 2022] POST /identity/v3/projects => generated 357 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:29:38.087954 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77a05b2-fe54-4732-bb71-1cf23b201630 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:38.088137 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ccb3b5-d93a-4b88-b0f4-0075f41a35ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f0366a1574d4dbd83bbb279d320ee6a)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:38.090549 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: WARNING py.warnings [None req-a2ccb3b5-d93a-4b88-b0f4-0075f41a35ca admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 12:29:38.090549 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: warnings.warn(msg) Aug 31 12:29:38.090549 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: Aug 31 12:29:38.101088 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ccb3b5-d93a-4b88-b0f4-0075f41a35ca admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:38.362180 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-a2ccb3b5-d93a-4b88-b0f4-0075f41a35ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f0366a1574d4dbd83bbb279d320ee6a', 'request_id': 'req-a2ccb3b5-d93a-4b88-b0f4-0075f41a35ca'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:29:38.378590 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-a2ccb3b5-d93a-4b88-b0f4-0075f41a35ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f0366a1574d4dbd83bbb279d320ee6a', 'request_id': 'req-a2ccb3b5-d93a-4b88-b0f4-0075f41a35ca'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:29:38.385298 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77a05b2-fe54-4732-bb71-1cf23b201630 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:38.424292 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-a2ccb3b5-d93a-4b88-b0f4-0075f41a35ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f0366a1574d4dbd83bbb279d320ee6a', 'request_id': 'req-a2ccb3b5-d93a-4b88-b0f4-0075f41a35ca'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:29:38.493380 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-a2ccb3b5-d93a-4b88-b0f4-0075f41a35ca admin admin] The token cache is being invalidate because project 7f0366a1574d4dbd83bbb279d320ee6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:29:38.495678 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-a2ccb3b5-d93a-4b88-b0f4-0075f41a35ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:29:38.499359 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-a2ccb3b5-d93a-4b88-b0f4-0075f41a35ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:29:38.503416 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 838/1665] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:29:37 2022] DELETE /identity/v3/projects/7f0366a1574d4dbd83bbb279d320ee6a => generated 0 bytes in 694 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:29:38.507161 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ccb3b5-d93a-4b88-b0f4-0075f41a35ca admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:38.509800 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-a2ccb3b5-d93a-4b88-b0f4-0075f41a35ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:29:38.514738 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:29:38.606557 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:29:38.610085 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a9e8e3-4f9a-4cc2-93a6-4811f9ddb28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:38.612905 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9e8e3-4f9a-4cc2-93a6-4811f9ddb28d admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:38.613447 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9e8e3-4f9a-4cc2-93a6-4811f9ddb28d admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:38.613893 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9e8e3-4f9a-4cc2-93a6-4811f9ddb28d admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:38.615635 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a9e8e3-4f9a-4cc2-93a6-4811f9ddb28d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:38.619030 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a9e8e3-4f9a-4cc2-93a6-4811f9ddb28d admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:38.670390 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 828/1666] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:29:38 2022] POST /identity/v3/users => generated 285 bytes in 586 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:29:38.677799 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a9e8e3-4f9a-4cc2-93a6-4811f9ddb28d admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:38.677799 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-08a9e8e3-4f9a-4cc2-93a6-4811f9ddb28d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:29:38.695334 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a9e8e3-4f9a-4cc2-93a6-4811f9ddb28d admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:38.701818 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4dcea8-45f1-46b6-8d40-0e3330828fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:38.702788 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4dcea8-45f1-46b6-8d40-0e3330828fae admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:38.703329 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4dcea8-45f1-46b6-8d40-0e3330828fae admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:38.703820 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4dcea8-45f1-46b6-8d40-0e3330828fae admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:38.704872 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4dcea8-45f1-46b6-8d40-0e3330828fae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:38.706774 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4dcea8-45f1-46b6-8d40-0e3330828fae admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:38.723640 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 829/1667] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:29:38 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:29:38.725412 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4dcea8-45f1-46b6-8d40-0e3330828fae admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:38.737134 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ccb3b5-d93a-4b88-b0f4-0075f41a35ca admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:38.742616 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4dcea8-45f1-46b6-8d40-0e3330828fae admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:38.752646 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcb74d9-19f6-46f4-877b-cfb56276c3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:38.754143 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118391d6-8aec-4caf-be0e-4a0c124a5c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:38.756094 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb74d9-19f6-46f4-877b-cfb56276c3d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:38.757081 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118391d6-8aec-4caf-be0e-4a0c124a5c9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:38.757373 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118391d6-8aec-4caf-be0e-4a0c124a5c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:38.759012 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118391d6-8aec-4caf-be0e-4a0c124a5c9d admin admin] PATH_INFO: `/v3/users/2c651d8af9c64260b03d44dab6d22cd9` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:38.761576 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118391d6-8aec-4caf-be0e-4a0c124a5c9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c651d8af9c64260b03d44dab6d22cd9)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:38.763692 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb74d9-19f6-46f4-877b-cfb56276c3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:38.764196 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb74d9-19f6-46f4-877b-cfb56276c3d0 admin admin] PATH_INFO: `/v3/projects/fb6b8f37acca4f6b829b309337a3f0e3/users/55e2339341634da0be694de3c4f28957/roles/a332ef951db949b0bad7019fbd28a1b9` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:38.787130 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118391d6-8aec-4caf-be0e-4a0c124a5c9d admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:38.830472 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcb74d9-19f6-46f4-877b-cfb56276c3d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb6b8f37acca4f6b829b309337a3f0e3, user_id=55e2339341634da0be694de3c4f28957, role_id=a332ef951db949b0bad7019fbd28a1b9)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:38.834750 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcb74d9-19f6-46f4-877b-cfb56276c3d0 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:38.885279 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 830/1668] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:29:38 2022] PUT /identity/v3/projects/fb6b8f37acca4f6b829b309337a3f0e3/users/55e2339341634da0be694de3c4f28957/roles/a332ef951db949b0bad7019fbd28a1b9 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:29:38.889243 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcb74d9-19f6-46f4-877b-cfb56276c3d0 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:38.926076 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-118391d6-8aec-4caf-be0e-4a0c124a5c9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c651d8af9c64260b03d44dab6d22cd9'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:29:38.971109 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-118391d6-8aec-4caf-be0e-4a0c124a5c9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c651d8af9c64260b03d44dab6d22cd9'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:29:38.992950 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-118391d6-8aec-4caf-be0e-4a0c124a5c9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c651d8af9c64260b03d44dab6d22cd9'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:29:38.999095 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-118391d6-8aec-4caf-be0e-4a0c124a5c9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c651d8af9c64260b03d44dab6d22cd9'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:29:39.016309 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-118391d6-8aec-4caf-be0e-4a0c124a5c9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c651d8af9c64260b03d44dab6d22cd9'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:29:39.035788 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 839/1669] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:29:38 2022] DELETE /identity/v3/users/2c651d8af9c64260b03d44dab6d22cd9 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:29:39.058150 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcb74d9-19f6-46f4-877b-cfb56276c3d0 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:39.174147 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e238e438-e21e-4c55-a2f0-42aa90511ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:39.174790 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e238e438-e21e-4c55-a2f0-42aa90511ac9 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:39.175852 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e238e438-e21e-4c55-a2f0-42aa90511ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:39.176141 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e238e438-e21e-4c55-a2f0-42aa90511ac9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:39.176857 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e238e438-e21e-4c55-a2f0-42aa90511ac9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:39.178603 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e238e438-e21e-4c55-a2f0-42aa90511ac9 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:39.193926 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 831/1670] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:29:38 2022] GET /identity/v3/roles => generated 1420 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 12:29:39.198270 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118391d6-8aec-4caf-be0e-4a0c124a5c9d admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:39.200225 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-118391d6-8aec-4caf-be0e-4a0c124a5c9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:29:39.216922 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118391d6-8aec-4caf-be0e-4a0c124a5c9d admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:39.231526 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faa6a62-188a-4531-b362-72c1b26f908e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:39.232582 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faa6a62-188a-4531-b362-72c1b26f908e admin admin] REQUEST_METHOD: `PUT` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:39.237773 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faa6a62-188a-4531-b362-72c1b26f908e admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:39.238322 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faa6a62-188a-4531-b362-72c1b26f908e admin admin] PATH_INFO: `/v3/projects/fb6b8f37acca4f6b829b309337a3f0e3/users/55e2339341634da0be694de3c4f28957/roles/a332ef951db949b0bad7019fbd28a1b9` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:39.243087 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faa6a62-188a-4531-b362-72c1b26f908e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb6b8f37acca4f6b829b309337a3f0e3, user_id=55e2339341634da0be694de3c4f28957, role_id=a332ef951db949b0bad7019fbd28a1b9)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:39.247167 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faa6a62-188a-4531-b362-72c1b26f908e admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:39.264571 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 840/1671] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:29:39 2022] PUT /identity/v3/projects/fb6b8f37acca4f6b829b309337a3f0e3/users/55e2339341634da0be694de3c4f28957/roles/a332ef951db949b0bad7019fbd28a1b9 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:29:39.275739 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78d8d2-adbf-4ab8-88bd-cf15eead24a2 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:39.276050 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78d8d2-adbf-4ab8-88bd-cf15eead24a2 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:39.276405 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78d8d2-adbf-4ab8-88bd-cf15eead24a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:39.329283 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-ba78d8d2-adbf-4ab8-88bd-cf15eead24a2 None None] MFA Rules not processed for user `55e2339341634da0be694de3c4f28957`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:29:39.330962 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-ba78d8d2-adbf-4ab8-88bd-cf15eead24a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:29:39.382582 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:29:39.530758 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 832/1672] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:29:39 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:29:39.541163 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faa6a62-188a-4531-b362-72c1b26f908e admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:39.550305 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-4faa6a62-188a-4531-b362-72c1b26f908e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:29:39.782640 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faa6a62-188a-4531-b362-72c1b26f908e admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:39.792773 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc456831-0de9-4205-914b-837213399c10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e79503178ac54e62ba385467d5617ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:39.793495 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc456831-0de9-4205-914b-837213399c10 service cinder] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:39.793771 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc456831-0de9-4205-914b-837213399c10 service cinder] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:39.794037 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc456831-0de9-4205-914b-837213399c10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:39.822505 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc456831-0de9-4205-914b-837213399c10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:39.832794 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc456831-0de9-4205-914b-837213399c10 service cinder] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:39.864074 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 841/1673] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:29:39 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:29:40.009171 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba78d8d2-adbf-4ab8-88bd-cf15eead24a2 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:40.033786 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba78d8d2-adbf-4ab8-88bd-cf15eead24a2 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:40.037977 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13af1a9-1852-476c-ad86-cea36020f01d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e79503178ac54e62ba385467d5617ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:40.038612 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13af1a9-1852-476c-ad86-cea36020f01d service cinder] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:40.039055 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13af1a9-1852-476c-ad86-cea36020f01d service cinder] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:40.039333 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13af1a9-1852-476c-ad86-cea36020f01d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:40.044280 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-f13af1a9-1852-476c-ad86-cea36020f01d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:29:40.179562 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13af1a9-1852-476c-ad86-cea36020f01d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:40.181043 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13af1a9-1852-476c-ad86-cea36020f01d service cinder] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:40.208943 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 833/1674] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:29:40 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:29:41.203860 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc456831-0de9-4205-914b-837213399c10 service cinder] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:41.205936 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-bc456831-0de9-4205-914b-837213399c10 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:29:41.299722 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:29:41.406536 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc456831-0de9-4205-914b-837213399c10 service cinder] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:41.417394 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a8b8aa-1eba-4e47-b96b-7db17c2f0d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:41.418785 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a8b8aa-1eba-4e47-b96b-7db17c2f0d49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:41.419040 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a8b8aa-1eba-4e47-b96b-7db17c2f0d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:41.419318 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a8b8aa-1eba-4e47-b96b-7db17c2f0d49 admin admin] PATH_INFO: `/v3/projects/595bc4e7605048c1bf0d807a1bff9ccd` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:41.423982 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a8b8aa-1eba-4e47-b96b-7db17c2f0d49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=595bc4e7605048c1bf0d807a1bff9ccd)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:41.429749 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a8b8aa-1eba-4e47-b96b-7db17c2f0d49 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:41.561810 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-f7a8b8aa-1eba-4e47-b96b-7db17c2f0d49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '595bc4e7605048c1bf0d807a1bff9ccd', 'request_id': 'req-f7a8b8aa-1eba-4e47-b96b-7db17c2f0d49'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:29:41.585653 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-f7a8b8aa-1eba-4e47-b96b-7db17c2f0d49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '595bc4e7605048c1bf0d807a1bff9ccd', 'request_id': 'req-f7a8b8aa-1eba-4e47-b96b-7db17c2f0d49'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:29:41.608969 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-f7a8b8aa-1eba-4e47-b96b-7db17c2f0d49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '595bc4e7605048c1bf0d807a1bff9ccd', 'request_id': 'req-f7a8b8aa-1eba-4e47-b96b-7db17c2f0d49'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:29:41.655798 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-f7a8b8aa-1eba-4e47-b96b-7db17c2f0d49 admin admin] The token cache is being invalidate because project 595bc4e7605048c1bf0d807a1bff9ccd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:29:41.656094 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-f7a8b8aa-1eba-4e47-b96b-7db17c2f0d49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:29:41.661127 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-f7a8b8aa-1eba-4e47-b96b-7db17c2f0d49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:29:41.670130 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 842/1675] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:29:41 2022] DELETE /identity/v3/projects/595bc4e7605048c1bf0d807a1bff9ccd => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:29:41.674300 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55094ac-e668-424e-957a-9c1aecff73fd None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:41.675301 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55094ac-e668-424e-957a-9c1aecff73fd None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:41.675723 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55094ac-e668-424e-957a-9c1aecff73fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:41.727854 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-d55094ac-e668-424e-957a-9c1aecff73fd None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:29:41.733472 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-d55094ac-e668-424e-957a-9c1aecff73fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:29:42.015972 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 834/1676] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:29:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:29:42.016826 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4bfd68-1689-40b5-8af2-026054ba22de None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:42.017296 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4bfd68-1689-40b5-8af2-026054ba22de None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:42.017733 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4bfd68-1689-40b5-8af2-026054ba22de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:42.115183 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-1e4bfd68-1689-40b5-8af2-026054ba22de None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:29:42.133628 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-1e4bfd68-1689-40b5-8af2-026054ba22de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:29:42.159336 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 843/1677] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:29:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:29:42.164246 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55094ac-e668-424e-957a-9c1aecff73fd None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:42.179153 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55094ac-e668-424e-957a-9c1aecff73fd None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:42.193786 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44cb7d1-4f31-48d7-92fc-8b22444a9832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:42.194488 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44cb7d1-4f31-48d7-92fc-8b22444a9832 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:42.194876 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44cb7d1-4f31-48d7-92fc-8b22444a9832 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:42.195531 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44cb7d1-4f31-48d7-92fc-8b22444a9832 admin admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:42.197279 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44cb7d1-4f31-48d7-92fc-8b22444a9832 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:29:42.197588 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44cb7d1-4f31-48d7-92fc-8b22444a9832 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:42.202440 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44cb7d1-4f31-48d7-92fc-8b22444a9832 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:42.239703 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 835/1678] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 12:29:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:29:42.240251 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4bfd68-1689-40b5-8af2-026054ba22de None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:42.253810 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4bfd68-1689-40b5-8af2-026054ba22de None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:42.299679 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f049e725-1cbb-4cd0-9af4-67c0ece20040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:42.300845 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f049e725-1cbb-4cd0-9af4-67c0ece20040 admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:42.306790 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f049e725-1cbb-4cd0-9af4-67c0ece20040 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:42.307312 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f049e725-1cbb-4cd0-9af4-67c0ece20040 admin admin] PATH_INFO: `/v3/projects` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:42.308236 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f049e725-1cbb-4cd0-9af4-67c0ece20040 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:42.317817 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f049e725-1cbb-4cd0-9af4-67c0ece20040 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:42.440221 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 844/1679] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:29:42 2022] POST /identity/v3/projects => generated 381 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:29:42.447902 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44cb7d1-4f31-48d7-92fc-8b22444a9832 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:42.466880 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44cb7d1-4f31-48d7-92fc-8b22444a9832 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:42.587828 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:29:42.643732 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9c3240-ccb2-4e77-9a66-9905f125116a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:42.644378 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c3240-ccb2-4e77-9a66-9905f125116a admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:42.644771 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c3240-ccb2-4e77-9a66-9905f125116a admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:42.646784 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c3240-ccb2-4e77-9a66-9905f125116a admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:42.648406 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9c3240-ccb2-4e77-9a66-9905f125116a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:42.653427 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9c3240-ccb2-4e77-9a66-9905f125116a admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:42.710228 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f049e725-1cbb-4cd0-9af4-67c0ece20040 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:42.719168 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 836/1680] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:29:42 2022] POST /identity/v3/users => generated 291 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:29:42.727276 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f049e725-1cbb-4cd0-9af4-67c0ece20040 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:42.740231 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a814b8-3505-49cb-bc0d-1ba9fc7478d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:42.742670 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a814b8-3505-49cb-bc0d-1ba9fc7478d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:42.743649 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a814b8-3505-49cb-bc0d-1ba9fc7478d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:42.744677 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a814b8-3505-49cb-bc0d-1ba9fc7478d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:42.745814 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a814b8-3505-49cb-bc0d-1ba9fc7478d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:42.750201 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a814b8-3505-49cb-bc0d-1ba9fc7478d8 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:42.788184 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9c3240-ccb2-4e77-9a66-9905f125116a admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:42.798773 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 845/1681] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:29:42 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:29:42.808093 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9c3240-ccb2-4e77-9a66-9905f125116a admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:42.819748 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a814b8-3505-49cb-bc0d-1ba9fc7478d8 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:42.823644 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-77a814b8-3505-49cb-bc0d-1ba9fc7478d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:29:42.835034 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eb81b5-e425-4b3b-8df2-95173667b6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:42.838426 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb81b5-e425-4b3b-8df2-95173667b6c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:42.838780 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb81b5-e425-4b3b-8df2-95173667b6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:42.839630 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb81b5-e425-4b3b-8df2-95173667b6c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:42.843570 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eb81b5-e425-4b3b-8df2-95173667b6c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:42.850353 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eb81b5-e425-4b3b-8df2-95173667b6c8 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:42.863758 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a814b8-3505-49cb-bc0d-1ba9fc7478d8 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:42.885133 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3f511a-a4cf-4ec1-bd43-18b38e80c1a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:42.885809 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f511a-a4cf-4ec1-bd43-18b38e80c1a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:42.886093 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f511a-a4cf-4ec1-bd43-18b38e80c1a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:42.886372 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f511a-a4cf-4ec1-bd43-18b38e80c1a6 admin admin] PATH_INFO: `/v3/projects/112f55a5b99a478d868f3b95d3f7b953` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:42.895810 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 837/1682] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:29:42 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:29:42.897752 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eb81b5-e425-4b3b-8df2-95173667b6c8 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:42.900977 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3f511a-a4cf-4ec1-bd43-18b38e80c1a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=112f55a5b99a478d868f3b95d3f7b953)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:42.910268 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3f511a-a4cf-4ec1-bd43-18b38e80c1a6 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:42.942319 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eb81b5-e425-4b3b-8df2-95173667b6c8 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:42.959804 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7444b4-c31e-4551-8f97-6f8d6c7951e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:42.960502 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7444b4-c31e-4551-8f97-6f8d6c7951e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:42.960785 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7444b4-c31e-4551-8f97-6f8d6c7951e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:42.961060 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7444b4-c31e-4551-8f97-6f8d6c7951e0 admin admin] PATH_INFO: `/v3/projects/f2fbce17e1be41e69d50b7bced08a666/users/ec82330e1a29471f97da066f08c57fb6/roles/b5cfd7a855a448359e9017f51d32b6fc` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:43.005507 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7444b4-c31e-4551-8f97-6f8d6c7951e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2fbce17e1be41e69d50b7bced08a666, user_id=ec82330e1a29471f97da066f08c57fb6, role_id=b5cfd7a855a448359e9017f51d32b6fc)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:43.008487 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7444b4-c31e-4551-8f97-6f8d6c7951e0 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:43.050990 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 838/1683] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:29:42 2022] PUT /identity/v3/projects/f2fbce17e1be41e69d50b7bced08a666/users/ec82330e1a29471f97da066f08c57fb6/roles/b5cfd7a855a448359e9017f51d32b6fc => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:29:43.056937 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1029eaf7-871b-400d-9743-a8e1ce7970d8 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:43.058384 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1029eaf7-871b-400d-9743-a8e1ce7970d8 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:43.059418 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1029eaf7-871b-400d-9743-a8e1ce7970d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:43.072804 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-7e3f511a-a4cf-4ec1-bd43-18b38e80c1a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '112f55a5b99a478d868f3b95d3f7b953', 'request_id': 'req-7e3f511a-a4cf-4ec1-bd43-18b38e80c1a6'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:29:43.089435 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-7e3f511a-a4cf-4ec1-bd43-18b38e80c1a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '112f55a5b99a478d868f3b95d3f7b953', 'request_id': 'req-7e3f511a-a4cf-4ec1-bd43-18b38e80c1a6'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:29:43.111553 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-7e3f511a-a4cf-4ec1-bd43-18b38e80c1a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '112f55a5b99a478d868f3b95d3f7b953', 'request_id': 'req-7e3f511a-a4cf-4ec1-bd43-18b38e80c1a6'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:29:43.137886 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-1029eaf7-871b-400d-9743-a8e1ce7970d8 None None] MFA Rules not processed for user `ec82330e1a29471f97da066f08c57fb6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:29:43.139286 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-1029eaf7-871b-400d-9743-a8e1ce7970d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:29:43.163050 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-7e3f511a-a4cf-4ec1-bd43-18b38e80c1a6 admin admin] The token cache is being invalidate because project 112f55a5b99a478d868f3b95d3f7b953 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:29:43.163352 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-7e3f511a-a4cf-4ec1-bd43-18b38e80c1a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:29:43.166134 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-7e3f511a-a4cf-4ec1-bd43-18b38e80c1a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:29:43.170820 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 846/1684] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:29:42 2022] DELETE /identity/v3/projects/112f55a5b99a478d868f3b95d3f7b953 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:29:43.176097 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa70e2-bf7b-4325-9d0d-62013540c6de None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:43.176444 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa70e2-bf7b-4325-9d0d-62013540c6de None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:43.176722 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa70e2-bf7b-4325-9d0d-62013540c6de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:43.234111 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-f1aa70e2-bf7b-4325-9d0d-62013540c6de None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:29:43.235418 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-f1aa70e2-bf7b-4325-9d0d-62013540c6de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:29:43.244916 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:29:43.334345 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 839/1685] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:29:43 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:29:43.338655 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1029eaf7-871b-400d-9743-a8e1ce7970d8 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:43.341515 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-1029eaf7-871b-400d-9743-a8e1ce7970d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:29:43.402344 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 847/1686] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:29:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:29:43.421634 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b513ab35-8fc0-4ac6-999a-c8b1e7bc425b None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:43.422429 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b513ab35-8fc0-4ac6-999a-c8b1e7bc425b None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:43.423209 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b513ab35-8fc0-4ac6-999a-c8b1e7bc425b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:43.476318 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-b513ab35-8fc0-4ac6-999a-c8b1e7bc425b None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:29:43.477605 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-b513ab35-8fc0-4ac6-999a-c8b1e7bc425b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:29:43.502768 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 848/1687] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:29:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:29:43.509206 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b513ab35-8fc0-4ac6-999a-c8b1e7bc425b None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:43.545901 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1029eaf7-871b-400d-9743-a8e1ce7970d8 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:43.552317 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e21758b-275b-4233-86a9-5c8aa89bca06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:43.553238 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21758b-275b-4233-86a9-5c8aa89bca06 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:43.553516 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21758b-275b-4233-86a9-5c8aa89bca06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:43.553788 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21758b-275b-4233-86a9-5c8aa89bca06 admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:43.554502 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e21758b-275b-4233-86a9-5c8aa89bca06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:43.556491 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e21758b-275b-4233-86a9-5c8aa89bca06 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:43.557733 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b513ab35-8fc0-4ac6-999a-c8b1e7bc425b None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:43.584211 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c4c3d3-91e5-49ef-abc0-dfda4cc3b1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:43.591855 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c4c3d3-91e5-49ef-abc0-dfda4cc3b1bc admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:43.592622 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c4c3d3-91e5-49ef-abc0-dfda4cc3b1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:43.596525 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c4c3d3-91e5-49ef-abc0-dfda4cc3b1bc admin admin] PATH_INFO: `/v3/domains` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:43.598573 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c4c3d3-91e5-49ef-abc0-dfda4cc3b1bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:29:43.599251 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c4c3d3-91e5-49ef-abc0-dfda4cc3b1bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:43.601618 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c4c3d3-91e5-49ef-abc0-dfda4cc3b1bc admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:43.644013 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 849/1688] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 12:29:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:29:43.645981 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c4c3d3-91e5-49ef-abc0-dfda4cc3b1bc admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:43.667563 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c4c3d3-91e5-49ef-abc0-dfda4cc3b1bc admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:43.671634 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 840/1689] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:29:43 2022] POST /identity/v3/projects => generated 379 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:29:43.681733 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e21758b-275b-4233-86a9-5c8aa89bca06 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:43.755979 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:29:43.921480 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f235d8-826b-4428-860d-853076aa6296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:43.922252 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f235d8-826b-4428-860d-853076aa6296 admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:43.922646 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f235d8-826b-4428-860d-853076aa6296 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:43.923104 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f235d8-826b-4428-860d-853076aa6296 admin admin] PATH_INFO: `/v3/projects` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:43.923875 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f235d8-826b-4428-860d-853076aa6296 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:43.925951 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f235d8-826b-4428-860d-853076aa6296 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:44.011242 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 850/1690] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:29:43 2022] POST /identity/v3/projects => generated 393 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:29:44.016029 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f235d8-826b-4428-860d-853076aa6296 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:44.026059 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e21758b-275b-4233-86a9-5c8aa89bca06 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:44.201535 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f235d8-826b-4428-860d-853076aa6296 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:44.216923 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd84292-adb8-4381-8e8c-be0d56a8ef4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:44.217871 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd84292-adb8-4381-8e8c-be0d56a8ef4e admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:44.218334 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd84292-adb8-4381-8e8c-be0d56a8ef4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:44.218723 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd84292-adb8-4381-8e8c-be0d56a8ef4e admin admin] PATH_INFO: `/v3/users` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:44.220565 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd84292-adb8-4381-8e8c-be0d56a8ef4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:44.222659 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd84292-adb8-4381-8e8c-be0d56a8ef4e admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:44.272971 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3c7f9f-6422-4402-b09a-9d2c7383dcd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:44.273826 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3c7f9f-6422-4402-b09a-9d2c7383dcd3 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:44.273930 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3c7f9f-6422-4402-b09a-9d2c7383dcd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:44.276598 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3c7f9f-6422-4402-b09a-9d2c7383dcd3 admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:44.277335 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3c7f9f-6422-4402-b09a-9d2c7383dcd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:44.284853 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 851/1691] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:29:44 2022] POST /identity/v3/users => generated 297 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:29:44.285992 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd84292-adb8-4381-8e8c-be0d56a8ef4e admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:44.286170 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3c7f9f-6422-4402-b09a-9d2c7383dcd3 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:44.314631 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:29:44.329944 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 841/1692] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:29:43 2022] POST /identity/v3/users => generated 296 bytes in 649 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:29:44.330956 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd84292-adb8-4381-8e8c-be0d56a8ef4e admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:44.333422 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3c7f9f-6422-4402-b09a-9d2c7383dcd3 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:44.347244 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bb2e52-4435-4a7b-aa25-06306923e2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:44.349925 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb2e52-4435-4a7b-aa25-06306923e2d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:44.354730 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb2e52-4435-4a7b-aa25-06306923e2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:44.355172 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb2e52-4435-4a7b-aa25-06306923e2d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:44.356122 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bb2e52-4435-4a7b-aa25-06306923e2d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:44.359056 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3c7f9f-6422-4402-b09a-9d2c7383dcd3 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:44.361131 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bb2e52-4435-4a7b-aa25-06306923e2d1 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:44.385254 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac60d91e-b7d3-4d82-ad51-8d774ecefd2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:44.385896 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac60d91e-b7d3-4d82-ad51-8d774ecefd2d admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:44.386176 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac60d91e-b7d3-4d82-ad51-8d774ecefd2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:44.386450 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac60d91e-b7d3-4d82-ad51-8d774ecefd2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:44.388552 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac60d91e-b7d3-4d82-ad51-8d774ecefd2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:44.389635 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac60d91e-b7d3-4d82-ad51-8d774ecefd2d admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:44.406220 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 842/1693] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:29:44 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:29:44.409918 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 852/1694] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:29:44 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:29:44.410139 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac60d91e-b7d3-4d82-ad51-8d774ecefd2d admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:44.410899 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bb2e52-4435-4a7b-aa25-06306923e2d1 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:44.429273 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bb2e52-4435-4a7b-aa25-06306923e2d1 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:44.430363 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac60d91e-b7d3-4d82-ad51-8d774ecefd2d admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:44.446803 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e5686d-640c-473c-a936-c76d45d4d61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:44.447476 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e5686d-640c-473c-a936-c76d45d4d61a admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:44.447750 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e5686d-640c-473c-a936-c76d45d4d61a admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:44.448019 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e5686d-640c-473c-a936-c76d45d4d61a admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:44.448670 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e5686d-640c-473c-a936-c76d45d4d61a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:44.453145 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e5686d-640c-473c-a936-c76d45d4d61a admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:44.453525 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deffb419-d430-42cb-a292-818987ec392b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:44.454226 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deffb419-d430-42cb-a292-818987ec392b admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:44.454507 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deffb419-d430-42cb-a292-818987ec392b admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:44.454783 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deffb419-d430-42cb-a292-818987ec392b admin admin] PATH_INFO: `/v3/projects/83d0d866cadf453d8e2e8bd38a112790/users/0923a66e76424981a2db2a9eb1f3e7bc/roles/a332ef951db949b0bad7019fbd28a1b9` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:44.470008 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 853/1695] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:29:44 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:29:44.476146 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e5686d-640c-473c-a936-c76d45d4d61a admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:44.505671 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e5686d-640c-473c-a936-c76d45d4d61a admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:44.508200 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deffb419-d430-42cb-a292-818987ec392b admin admin] RBAC: Authorizing `identity:create_grant(project_id=83d0d866cadf453d8e2e8bd38a112790, user_id=0923a66e76424981a2db2a9eb1f3e7bc, role_id=a332ef951db949b0bad7019fbd28a1b9)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:44.516489 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deffb419-d430-42cb-a292-818987ec392b admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:44.523810 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd2074b-4afb-413f-8b70-c7122188ef1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:44.526088 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2074b-4afb-413f-8b70-c7122188ef1c admin admin] REQUEST_METHOD: `PUT` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:44.527787 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2074b-4afb-413f-8b70-c7122188ef1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:44.528341 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2074b-4afb-413f-8b70-c7122188ef1c admin admin] PATH_INFO: `/v3/projects/a4e37b7f651348edb2674302a232e1a2/users/5d60659c6e8a424f9bec4cfa018b44e4/roles/b5cfd7a855a448359e9017f51d32b6fc` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:44.560211 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 843/1696] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:29:44 2022] PUT /identity/v3/projects/83d0d866cadf453d8e2e8bd38a112790/users/0923a66e76424981a2db2a9eb1f3e7bc/roles/a332ef951db949b0bad7019fbd28a1b9 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:29:44.563894 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deffb419-d430-42cb-a292-818987ec392b admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:44.572605 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd2074b-4afb-413f-8b70-c7122188ef1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4e37b7f651348edb2674302a232e1a2, user_id=5d60659c6e8a424f9bec4cfa018b44e4, role_id=b5cfd7a855a448359e9017f51d32b6fc)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:44.575885 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd2074b-4afb-413f-8b70-c7122188ef1c admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:44.616574 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 854/1697] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:29:44 2022] PUT /identity/v3/projects/a4e37b7f651348edb2674302a232e1a2/users/5d60659c6e8a424f9bec4cfa018b44e4/roles/b5cfd7a855a448359e9017f51d32b6fc => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:29:44.623675 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7283e4-0d49-4241-a578-c3d5c3d60610 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:44.624236 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7283e4-0d49-4241-a578-c3d5c3d60610 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:44.624649 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7283e4-0d49-4241-a578-c3d5c3d60610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:44.703188 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-fa7283e4-0d49-4241-a578-c3d5c3d60610 None None] MFA Rules not processed for user `5d60659c6e8a424f9bec4cfa018b44e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:29:44.704495 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-fa7283e4-0d49-4241-a578-c3d5c3d60610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:29:44.718740 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deffb419-d430-42cb-a292-818987ec392b admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:44.746334 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:29:44.848842 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1004c6d2-db62-4f14-ae2a-06c8fb48c93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:44.849596 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004c6d2-db62-4f14-ae2a-06c8fb48c93e admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:44.849876 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004c6d2-db62-4f14-ae2a-06c8fb48c93e admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:44.850215 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004c6d2-db62-4f14-ae2a-06c8fb48c93e admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:44.850981 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1004c6d2-db62-4f14-ae2a-06c8fb48c93e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:44.853053 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1004c6d2-db62-4f14-ae2a-06c8fb48c93e admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:44.868271 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 844/1698] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:29:44 2022] GET /identity/v3/roles => generated 1420 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:29:44.882412 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1004c6d2-db62-4f14-ae2a-06c8fb48c93e admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:44.895776 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1004c6d2-db62-4f14-ae2a-06c8fb48c93e admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:44.903878 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468e8c83-75ea-4026-bf2e-8e56e702d867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:44.904878 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e8c83-75ea-4026-bf2e-8e56e702d867 admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:44.905268 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e8c83-75ea-4026-bf2e-8e56e702d867 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:44.905646 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e8c83-75ea-4026-bf2e-8e56e702d867 admin admin] PATH_INFO: `/v3/projects/83d0d866cadf453d8e2e8bd38a112790/users/0923a66e76424981a2db2a9eb1f3e7bc/roles/a332ef951db949b0bad7019fbd28a1b9` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:44.908110 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468e8c83-75ea-4026-bf2e-8e56e702d867 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83d0d866cadf453d8e2e8bd38a112790, user_id=0923a66e76424981a2db2a9eb1f3e7bc, role_id=a332ef951db949b0bad7019fbd28a1b9)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:44.911769 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468e8c83-75ea-4026-bf2e-8e56e702d867 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:44.926817 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 845/1699] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:29:44 2022] PUT /identity/v3/projects/83d0d866cadf453d8e2e8bd38a112790/users/0923a66e76424981a2db2a9eb1f3e7bc/roles/a332ef951db949b0bad7019fbd28a1b9 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:29:44.943295 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 855/1700] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:29:44 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:29:44.945002 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7283e4-0d49-4241-a578-c3d5c3d60610 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:44.951304 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b9d8ca-57ef-473a-8903-bfeff2028ab5 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:44.952806 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b9d8ca-57ef-473a-8903-bfeff2028ab5 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:44.953951 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b9d8ca-57ef-473a-8903-bfeff2028ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:44.968765 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7283e4-0d49-4241-a578-c3d5c3d60610 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:45.000745 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-96b9d8ca-57ef-473a-8903-bfeff2028ab5 None None] MFA Rules not processed for user `0923a66e76424981a2db2a9eb1f3e7bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:29:45.003410 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-96b9d8ca-57ef-473a-8903-bfeff2028ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:29:45.114325 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64799cb0-db02-4924-9326-1735482f05f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:45.114883 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64799cb0-db02-4924-9326-1735482f05f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:45.115198 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64799cb0-db02-4924-9326-1735482f05f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:45.115887 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64799cb0-db02-4924-9326-1735482f05f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:45.116125 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64799cb0-db02-4924-9326-1735482f05f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:45.118072 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64799cb0-db02-4924-9326-1735482f05f8 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:45.133147 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 846/1701] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:29:44 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:29:45.146099 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b9d8ca-57ef-473a-8903-bfeff2028ab5 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:45.148971 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-96b9d8ca-57ef-473a-8903-bfeff2028ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:29:45.178902 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 856/1702] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:29:44 2022] POST /identity/v3/projects => generated 393 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:29:45.185047 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64799cb0-db02-4924-9326-1735482f05f8 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:45.271072 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:29:45.316543 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b9d8ca-57ef-473a-8903-bfeff2028ab5 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:45.350140 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64799cb0-db02-4924-9326-1735482f05f8 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:45.361596 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0464e561-4c8c-45cb-a940-2689802c6bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:45.362247 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464e561-4c8c-45cb-a940-2689802c6bcf admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:45.362524 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464e561-4c8c-45cb-a940-2689802c6bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:45.362912 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464e561-4c8c-45cb-a940-2689802c6bcf admin admin] PATH_INFO: `/v3/users` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:45.363553 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0464e561-4c8c-45cb-a940-2689802c6bcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:45.365486 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0464e561-4c8c-45cb-a940-2689802c6bcf admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:45.424600 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 857/1703] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:29:45 2022] POST /identity/v3/users => generated 303 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:29:45.425614 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0464e561-4c8c-45cb-a940-2689802c6bcf admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:45.447209 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:29:45.449418 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0464e561-4c8c-45cb-a940-2689802c6bcf admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:45.471558 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c326b4-3f02-486b-a11e-ec005da1d20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:45.472200 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c326b4-3f02-486b-a11e-ec005da1d20f admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:45.472667 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c326b4-3f02-486b-a11e-ec005da1d20f admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:45.472938 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c326b4-3f02-486b-a11e-ec005da1d20f admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:45.473612 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c326b4-3f02-486b-a11e-ec005da1d20f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:45.484917 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90b06cb-eac6-4607-8dc5-1ddb6a8cb826 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e79503178ac54e62ba385467d5617ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:45.485916 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b06cb-eac6-4607-8dc5-1ddb6a8cb826 service cinder] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:45.486411 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b06cb-eac6-4607-8dc5-1ddb6a8cb826 service cinder] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:45.487322 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b06cb-eac6-4607-8dc5-1ddb6a8cb826 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:45.488127 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c326b4-3f02-486b-a11e-ec005da1d20f admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:45.517369 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 858/1704] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:29:45 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:29:45.518826 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c326b4-3f02-486b-a11e-ec005da1d20f admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:45.576947 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c326b4-3f02-486b-a11e-ec005da1d20f admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:45.595637 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dcbb52-e22c-4cf4-956b-1b226cf64177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:45.596333 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dcbb52-e22c-4cf4-956b-1b226cf64177 admin admin] REQUEST_METHOD: `PUT` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:45.596610 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dcbb52-e22c-4cf4-956b-1b226cf64177 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:45.596882 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dcbb52-e22c-4cf4-956b-1b226cf64177 admin admin] PATH_INFO: `/v3/projects/22436707f34d4d28b6979d4f673041e8/users/6a05818043db4a7e9a6da36ac2df170e/roles/a332ef951db949b0bad7019fbd28a1b9` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:45.663792 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dcbb52-e22c-4cf4-956b-1b226cf64177 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22436707f34d4d28b6979d4f673041e8, user_id=6a05818043db4a7e9a6da36ac2df170e, role_id=a332ef951db949b0bad7019fbd28a1b9)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:45.678255 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dcbb52-e22c-4cf4-956b-1b226cf64177 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:45.697981 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90b06cb-eac6-4607-8dc5-1ddb6a8cb826 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:45.700871 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90b06cb-eac6-4607-8dc5-1ddb6a8cb826 service cinder] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:45.731007 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 859/1705] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:29:45 2022] PUT /identity/v3/projects/22436707f34d4d28b6979d4f673041e8/users/6a05818043db4a7e9a6da36ac2df170e/roles/a332ef951db949b0bad7019fbd28a1b9 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:29:45.732992 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dcbb52-e22c-4cf4-956b-1b226cf64177 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:45.740623 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 847/1706] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:29:45 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 595 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:29:46.000824 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dcbb52-e22c-4cf4-956b-1b226cf64177 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:46.026624 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90b06cb-eac6-4607-8dc5-1ddb6a8cb826 service cinder] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:46.030938 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-f90b06cb-eac6-4607-8dc5-1ddb6a8cb826 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:29:46.040791 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c903f55-d058-4b44-b874-1a844810f3b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:46.041454 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c903f55-d058-4b44-b874-1a844810f3b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:46.041732 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c903f55-d058-4b44-b874-1a844810f3b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:46.042005 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c903f55-d058-4b44-b874-1a844810f3b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:46.042675 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c903f55-d058-4b44-b874-1a844810f3b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:46.045104 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c903f55-d058-4b44-b874-1a844810f3b3 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:46.070150 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 860/1707] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:29:45 2022] GET /identity/v3/roles => generated 1420 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:29:46.071119 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c903f55-d058-4b44-b874-1a844810f3b3 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:46.086799 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c903f55-d058-4b44-b874-1a844810f3b3 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:46.090415 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90b06cb-eac6-4607-8dc5-1ddb6a8cb826 service cinder] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:46.093779 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d3cf99-c897-4fcb-b7ee-489b1bb16516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:46.094383 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d3cf99-c897-4fcb-b7ee-489b1bb16516 admin admin] REQUEST_METHOD: `PUT` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:46.094661 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d3cf99-c897-4fcb-b7ee-489b1bb16516 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:46.094982 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d3cf99-c897-4fcb-b7ee-489b1bb16516 admin admin] PATH_INFO: `/v3/projects/22436707f34d4d28b6979d4f673041e8/users/6a05818043db4a7e9a6da36ac2df170e/roles/a332ef951db949b0bad7019fbd28a1b9` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:46.097082 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d3cf99-c897-4fcb-b7ee-489b1bb16516 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22436707f34d4d28b6979d4f673041e8, user_id=6a05818043db4a7e9a6da36ac2df170e, role_id=a332ef951db949b0bad7019fbd28a1b9)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:46.108995 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d3cf99-c897-4fcb-b7ee-489b1bb16516 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:46.122573 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 861/1708] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:29:46 2022] PUT /identity/v3/projects/22436707f34d4d28b6979d4f673041e8/users/6a05818043db4a7e9a6da36ac2df170e/roles/a332ef951db949b0bad7019fbd28a1b9 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:29:46.134783 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d967db5-c80b-4578-953b-67bf982e90bc None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:46.134783 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d967db5-c80b-4578-953b-67bf982e90bc None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:46.134783 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d967db5-c80b-4578-953b-67bf982e90bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:46.198436 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-2d967db5-c80b-4578-953b-67bf982e90bc None None] MFA Rules not processed for user `6a05818043db4a7e9a6da36ac2df170e`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:29:46.200544 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-2d967db5-c80b-4578-953b-67bf982e90bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:29:46.369865 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:29:46.393495 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc6f727-b48d-4d72-b7c0-ade50da430ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e79503178ac54e62ba385467d5617ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:46.398364 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc6f727-b48d-4d72-b7c0-ade50da430ee service cinder] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:46.399176 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc6f727-b48d-4d72-b7c0-ade50da430ee service cinder] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:46.400392 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc6f727-b48d-4d72-b7c0-ade50da430ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:46.404669 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 862/1709] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:29:46 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:29:46.701441 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d967db5-c80b-4578-953b-67bf982e90bc None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:46.765907 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc6f727-b48d-4d72-b7c0-ade50da430ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:46.767645 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc6f727-b48d-4d72-b7c0-ade50da430ee service cinder] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:46.833070 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 848/1710] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:29:46 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 808 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:29:46.878815 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d967db5-c80b-4578-953b-67bf982e90bc None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:46.891573 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae38e6a8-d07c-44ff-af8d-ea7e5534fce7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e79503178ac54e62ba385467d5617ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:46.892309 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae38e6a8-d07c-44ff-af8d-ea7e5534fce7 service cinder] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:46.892579 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae38e6a8-d07c-44ff-af8d-ea7e5534fce7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:46.892848 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae38e6a8-d07c-44ff-af8d-ea7e5534fce7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:46.924347 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae38e6a8-d07c-44ff-af8d-ea7e5534fce7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:46.925722 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae38e6a8-d07c-44ff-af8d-ea7e5534fce7 service cinder] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:46.959177 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 863/1711] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:29:46 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:29:47.319158 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc6f727-b48d-4d72-b7c0-ade50da430ee service cinder] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:47.323420 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed6519-f698-49de-89d1-84c4265f0b61 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:47.323698 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed6519-f698-49de-89d1-84c4265f0b61 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:47.325582 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed6519-f698-49de-89d1-84c4265f0b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:47.338939 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc6f727-b48d-4d72-b7c0-ade50da430ee service cinder] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:47.368685 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf22a3c5-c0c2-4cec-85eb-588d3535128c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e79503178ac54e62ba385467d5617ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:47.369317 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf22a3c5-c0c2-4cec-85eb-588d3535128c service cinder] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:47.369755 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf22a3c5-c0c2-4cec-85eb-588d3535128c service cinder] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:47.370188 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf22a3c5-c0c2-4cec-85eb-588d3535128c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:47.423118 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-4eed6519-f698-49de-89d1-84c4265f0b61 None None] MFA Rules not processed for user `937aa5c23271467f83b05f570fde7468`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:29:47.426097 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-4eed6519-f698-49de-89d1-84c4265f0b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:29:47.514318 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:29:47.575929 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf22a3c5-c0c2-4cec-85eb-588d3535128c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:47.584907 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf22a3c5-c0c2-4cec-85eb-588d3535128c service cinder] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:47.606345 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 849/1712] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:29:47 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:29:47.700410 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 864/1713] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:29:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:29:47.734311 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf22a3c5-c0c2-4cec-85eb-588d3535128c service cinder] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:47.737510 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-cf22a3c5-c0c2-4cec-85eb-588d3535128c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:29:47.796736 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea05fd2-8171-4552-810b-d9ec4af32d5f None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:47.797377 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea05fd2-8171-4552-810b-d9ec4af32d5f None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:47.797862 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea05fd2-8171-4552-810b-d9ec4af32d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:47.924596 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-6ea05fd2-8171-4552-810b-d9ec4af32d5f None None] MFA Rules not processed for user `64886d73c79649d1a824170a33f53fcb`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:29:47.926034 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-6ea05fd2-8171-4552-810b-d9ec4af32d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:29:48.149652 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 865/1714] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:29:47 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:29:48.153497 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32482c0-13f7-400a-8c32-1cd95d6b1082 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:48.155505 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32482c0-13f7-400a-8c32-1cd95d6b1082 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:48.158047 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32482c0-13f7-400a-8c32-1cd95d6b1082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:48.171134 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf22a3c5-c0c2-4cec-85eb-588d3535128c service cinder] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:48.212107 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9440ad-ab23-4401-a967-4cf2d9f7cac9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62401c8e1457450590f4147e0665265a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:48.213019 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9440ad-ab23-4401-a967-4cf2d9f7cac9 service nova] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:48.219280 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9440ad-ab23-4401-a967-4cf2d9f7cac9 service nova] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:48.222069 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9440ad-ab23-4401-a967-4cf2d9f7cac9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:48.271176 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-e32482c0-13f7-400a-8c32-1cd95d6b1082 None None] MFA Rules not processed for user `ee19faf2a2c54b19a9dc01d28f045b3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:29:48.272690 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-e32482c0-13f7-400a-8c32-1cd95d6b1082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:29:48.276952 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9440ad-ab23-4401-a967-4cf2d9f7cac9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:48.294069 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9440ad-ab23-4401-a967-4cf2d9f7cac9 service nova] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:48.299034 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:29:48.369943 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 850/1715] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:29:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 633 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:29:48.373293 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ef434-e78c-4ca0-8ba9-db20acac56c7 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:48.373765 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ef434-e78c-4ca0-8ba9-db20acac56c7 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:48.374197 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ef434-e78c-4ca0-8ba9-db20acac56c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:48.454435 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-974ef434-e78c-4ca0-8ba9-db20acac56c7 None None] MFA Rules not processed for user `64886d73c79649d1a824170a33f53fcb`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:29:48.461056 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-974ef434-e78c-4ca0-8ba9-db20acac56c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:29:48.490714 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 851/1716] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:29:48 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:29:48.504071 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974ef434-e78c-4ca0-8ba9-db20acac56c7 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:48.506193 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-974ef434-e78c-4ca0-8ba9-db20acac56c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:29:48.605149 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 866/1717] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:29:48 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 455 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:29:48.606628 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974ef434-e78c-4ca0-8ba9-db20acac56c7 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:48.652403 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98725e34-9ac4-46c8-aaff-3ac7df865efc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62401c8e1457450590f4147e0665265a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:48.657451 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98725e34-9ac4-46c8-aaff-3ac7df865efc service nova] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:48.657960 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98725e34-9ac4-46c8-aaff-3ac7df865efc service nova] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:48.658726 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98725e34-9ac4-46c8-aaff-3ac7df865efc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:48.697078 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98725e34-9ac4-46c8-aaff-3ac7df865efc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:48.702885 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98725e34-9ac4-46c8-aaff-3ac7df865efc service nova] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:48.736190 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 852/1718] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:29:48 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:29:49.059138 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32482c0-13f7-400a-8c32-1cd95d6b1082 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:49.095434 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32482c0-13f7-400a-8c32-1cd95d6b1082 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:49.149142 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ac3eb2-b7c6-4245-95c9-6bd9e6b484f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62401c8e1457450590f4147e0665265a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:49.150782 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ac3eb2-b7c6-4245-95c9-6bd9e6b484f9 service nova] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:49.155759 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ac3eb2-b7c6-4245-95c9-6bd9e6b484f9 service nova] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:49.161072 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ac3eb2-b7c6-4245-95c9-6bd9e6b484f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:49.207234 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ac3eb2-b7c6-4245-95c9-6bd9e6b484f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:49.218207 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ac3eb2-b7c6-4245-95c9-6bd9e6b484f9 service nova] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:49.280102 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 867/1719] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:29:49 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:29:50.931651 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b8b4c-beb8-4f45-b511-cc9f8b0e5e30 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:50.932196 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b8b4c-beb8-4f45-b511-cc9f8b0e5e30 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:50.932397 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b8b4c-beb8-4f45-b511-cc9f8b0e5e30 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:50.936641 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 853/1720] 10.222.0.79 () {54 vars in 912 bytes} [Wed Aug 31 12:29:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:29:50.944603 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80559ac-346d-48ac-a2e9-ef0aa09198cc None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:50.945131 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80559ac-346d-48ac-a2e9-ef0aa09198cc None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:50.945219 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80559ac-346d-48ac-a2e9-ef0aa09198cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:51.057146 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-c80559ac-346d-48ac-a2e9-ef0aa09198cc None None] MFA Rules not processed for user `1569b43c774c45ff80577d879ba9d819`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:29:51.060740 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-c80559ac-346d-48ac-a2e9-ef0aa09198cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:29:51.246213 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 868/1721] 10.222.0.79 () {58 vars in 1009 bytes} [Wed Aug 31 12:29:50 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:29:51.375860 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e78421-b170-49d0-aa03-fb747c43c03d None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:51.376638 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e78421-b170-49d0-aa03-fb747c43c03d None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:51.377115 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e78421-b170-49d0-aa03-fb747c43c03d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:51.398106 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80559ac-346d-48ac-a2e9-ef0aa09198cc None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:51.399859 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-c80559ac-346d-48ac-a2e9-ef0aa09198cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:29:51.419776 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80559ac-346d-48ac-a2e9-ef0aa09198cc None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:51.432391 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7a1725-a333-481a-bff5-9a7eadc5484c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:51.433263 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a1725-a333-481a-bff5-9a7eadc5484c service neutron] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:51.434249 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a1725-a333-481a-bff5-9a7eadc5484c service neutron] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:51.434705 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a1725-a333-481a-bff5-9a7eadc5484c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:51.442612 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-a8e78421-b170-49d0-aa03-fb747c43c03d None None] MFA Rules not processed for user `f8a3ebaaec7442039ecda2d63c54cc59`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:29:51.445739 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-a8e78421-b170-49d0-aa03-fb747c43c03d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:29:51.455278 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7a1725-a333-481a-bff5-9a7eadc5484c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:51.457154 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7a1725-a333-481a-bff5-9a7eadc5484c service neutron] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:51.482590 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 869/1722] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:29:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:29:51.607831 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 854/1723] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:29:51 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:29:51.623771 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f4e16b-b70a-4486-88e4-169d8ae76d22 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:51.624165 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f4e16b-b70a-4486-88e4-169d8ae76d22 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:51.625232 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f4e16b-b70a-4486-88e4-169d8ae76d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:51.670903 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-e6f4e16b-b70a-4486-88e4-169d8ae76d22 None None] MFA Rules not processed for user `f8a3ebaaec7442039ecda2d63c54cc59`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:29:51.677111 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-e6f4e16b-b70a-4486-88e4-169d8ae76d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:29:51.693844 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 870/1724] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:29:51 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:29:51.703521 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e78421-b170-49d0-aa03-fb747c43c03d None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:51.732563 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e78421-b170-49d0-aa03-fb747c43c03d None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:51.745153 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a53f07-d409-412d-9e01-5a3ae30143af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62401c8e1457450590f4147e0665265a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:51.746196 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a53f07-d409-412d-9e01-5a3ae30143af service nova] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:51.746543 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a53f07-d409-412d-9e01-5a3ae30143af service nova] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:51.748119 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a53f07-d409-412d-9e01-5a3ae30143af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:51.770613 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a53f07-d409-412d-9e01-5a3ae30143af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:51.773229 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a53f07-d409-412d-9e01-5a3ae30143af service nova] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:51.798166 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 855/1725] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:29:51 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:29:53.175492 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f4e16b-b70a-4486-88e4-169d8ae76d22 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:53.178168 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-e6f4e16b-b70a-4486-88e4-169d8ae76d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:29:53.454632 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f4e16b-b70a-4486-88e4-169d8ae76d22 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:53.488232 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fd6379-76b2-4923-9030-0534530e1162 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6deab40ae6244d4b9affa47b274aea3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:53.488431 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd6379-76b2-4923-9030-0534530e1162 service placement] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:53.499478 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd6379-76b2-4923-9030-0534530e1162 service placement] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:53.499858 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd6379-76b2-4923-9030-0534530e1162 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:53.505294 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-90fd6379-76b2-4923-9030-0534530e1162 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:29:53.584767 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fd6379-76b2-4923-9030-0534530e1162 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:53.586421 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fd6379-76b2-4923-9030-0534530e1162 service placement] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:53.593826 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28453b12-887b-434c-a126-c3630d4437d2 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:53.600720 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28453b12-887b-434c-a126-c3630d4437d2 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:53.608526 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:29:53.611609 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28453b12-887b-434c-a126-c3630d4437d2 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:53.615903 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 856/1726] 10.222.0.79 () {54 vars in 912 bytes} [Wed Aug 31 12:29:53 2022] GET /identity => generated 270 bytes in 43 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:29:53.624592 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08253004-1769-4383-bc70-990d143a0b14 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:53.628167 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 871/1727] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:29:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:29:53.643158 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08253004-1769-4383-bc70-990d143a0b14 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:53.644187 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08253004-1769-4383-bc70-990d143a0b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:53.692106 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b3de8-8521-4ff5-84ce-6cbaeeaa3aad None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:53.692423 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b3de8-8521-4ff5-84ce-6cbaeeaa3aad None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:53.692696 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b3de8-8521-4ff5-84ce-6cbaeeaa3aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:53.738448 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-7c0b3de8-8521-4ff5-84ce-6cbaeeaa3aad None None] MFA Rules not processed for user `64886d73c79649d1a824170a33f53fcb`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:29:53.741760 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-7c0b3de8-8521-4ff5-84ce-6cbaeeaa3aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:29:53.779548 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 872/1728] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:29:53 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:29:53.816313 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-08253004-1769-4383-bc70-990d143a0b14 None None] MFA Rules not processed for user `1569b43c774c45ff80577d879ba9d819`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:29:53.821382 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-08253004-1769-4383-bc70-990d143a0b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:29:53.848607 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 857/1729] 10.222.0.79 () {58 vars in 1009 bytes} [Wed Aug 31 12:29:53 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:29:53.893329 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0b3de8-8521-4ff5-84ce-6cbaeeaa3aad None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:53.896053 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-7c0b3de8-8521-4ff5-84ce-6cbaeeaa3aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:29:53.954799 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0b3de8-8521-4ff5-84ce-6cbaeeaa3aad None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:53.985119 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375d4cac-848a-40e3-81e3-9d1125f44882 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:53.986487 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d4cac-848a-40e3-81e3-9d1125f44882 service neutron] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:53.994147 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d4cac-848a-40e3-81e3-9d1125f44882 service neutron] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:53.995286 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d4cac-848a-40e3-81e3-9d1125f44882 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:54.044174 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375d4cac-848a-40e3-81e3-9d1125f44882 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:54.056859 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375d4cac-848a-40e3-81e3-9d1125f44882 service neutron] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:54.088258 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 873/1730] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:29:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:29:55.058297 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461955bf-c1ff-4db6-b9d3-1bc7ada0d7b2 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:55.062202 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461955bf-c1ff-4db6-b9d3-1bc7ada0d7b2 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:55.064459 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461955bf-c1ff-4db6-b9d3-1bc7ada0d7b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:55.114042 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-461955bf-c1ff-4db6-b9d3-1bc7ada0d7b2 None None] MFA Rules not processed for user `937aa5c23271467f83b05f570fde7468`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:29:55.115455 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-461955bf-c1ff-4db6-b9d3-1bc7ada0d7b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:29:55.128441 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 858/1731] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:29:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:29:56.383003 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1911ccd-eeeb-4388-a4b6-b4496938370c None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:56.383526 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1911ccd-eeeb-4388-a4b6-b4496938370c None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:56.383651 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1911ccd-eeeb-4388-a4b6-b4496938370c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:56.407113 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461955bf-c1ff-4db6-b9d3-1bc7ada0d7b2 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:56.457898 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:29:56.458217 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-b1911ccd-eeeb-4388-a4b6-b4496938370c None None] MFA Rules not processed for user `ee19faf2a2c54b19a9dc01d28f045b3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:29:56.462010 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-b1911ccd-eeeb-4388-a4b6-b4496938370c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:29:56.478945 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 874/1732] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:29:56 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:29:56.703386 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461955bf-c1ff-4db6-b9d3-1bc7ada0d7b2 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:56.726514 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb654ca-e122-48d8-be06-0a6f0885784d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:56.727306 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb654ca-e122-48d8-be06-0a6f0885784d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:56.727583 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb654ca-e122-48d8-be06-0a6f0885784d admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:56.727856 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb654ca-e122-48d8-be06-0a6f0885784d admin admin] PATH_INFO: `/v3/users/5d60659c6e8a424f9bec4cfa018b44e4` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:56.729725 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb654ca-e122-48d8-be06-0a6f0885784d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d60659c6e8a424f9bec4cfa018b44e4)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:56.739338 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb654ca-e122-48d8-be06-0a6f0885784d admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:57.036719 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-afb654ca-e122-48d8-be06-0a6f0885784d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d60659c6e8a424f9bec4cfa018b44e4'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:29:57.139966 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-afb654ca-e122-48d8-be06-0a6f0885784d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d60659c6e8a424f9bec4cfa018b44e4'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:29:57.146363 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-afb654ca-e122-48d8-be06-0a6f0885784d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d60659c6e8a424f9bec4cfa018b44e4'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:29:57.216359 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-afb654ca-e122-48d8-be06-0a6f0885784d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d60659c6e8a424f9bec4cfa018b44e4'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:29:57.217983 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-afb654ca-e122-48d8-be06-0a6f0885784d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d60659c6e8a424f9bec4cfa018b44e4'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:29:57.297292 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 859/1733] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:29:56 2022] DELETE /identity/v3/users/5d60659c6e8a424f9bec4cfa018b44e4 => generated 0 bytes in 891 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:29:57.307542 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ea3c5-6f9a-4930-861d-a2177f280dd9 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:57.310333 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ea3c5-6f9a-4930-861d-a2177f280dd9 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:57.311147 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ea3c5-6f9a-4930-861d-a2177f280dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:57.416226 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-f03ea3c5-6f9a-4930-861d-a2177f280dd9 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:29:57.421218 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-f03ea3c5-6f9a-4930-861d-a2177f280dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:29:57.763870 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 875/1734] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:29:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 462 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:29:57.775846 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb654ca-e122-48d8-be06-0a6f0885784d admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:57.782060 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-afb654ca-e122-48d8-be06-0a6f0885784d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:29:58.069516 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb654ca-e122-48d8-be06-0a6f0885784d admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:58.087433 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d040fdc-b900-4d37-9edc-255dbc8d66d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:58.088452 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d040fdc-b900-4d37-9edc-255dbc8d66d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:58.088923 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d040fdc-b900-4d37-9edc-255dbc8d66d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:58.089382 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d040fdc-b900-4d37-9edc-255dbc8d66d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:58.119464 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d040fdc-b900-4d37-9edc-255dbc8d66d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:58.122208 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d040fdc-b900-4d37-9edc-255dbc8d66d6 service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:58.182004 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 860/1735] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:29:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:29:59.181188 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03ea3c5-6f9a-4930-861d-a2177f280dd9 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:59.187616 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-f03ea3c5-6f9a-4930-861d-a2177f280dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:29:59.293867 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03ea3c5-6f9a-4930-861d-a2177f280dd9 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:29:59.360708 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3da0a79-32b7-4f6f-89df-fcc0bce05598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:29:59.361675 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da0a79-32b7-4f6f-89df-fcc0bce05598 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:29:59.362178 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da0a79-32b7-4f6f-89df-fcc0bce05598 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:29:59.380260 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da0a79-32b7-4f6f-89df-fcc0bce05598 admin admin] PATH_INFO: `/v3/projects/a4e37b7f651348edb2674302a232e1a2` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:29:59.392510 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3da0a79-32b7-4f6f-89df-fcc0bce05598 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4e37b7f651348edb2674302a232e1a2)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:29:59.414173 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3da0a79-32b7-4f6f-89df-fcc0bce05598 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:29:59.638572 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-d3da0a79-32b7-4f6f-89df-fcc0bce05598 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4e37b7f651348edb2674302a232e1a2', 'request_id': 'req-d3da0a79-32b7-4f6f-89df-fcc0bce05598'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:29:59.656218 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-d3da0a79-32b7-4f6f-89df-fcc0bce05598 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4e37b7f651348edb2674302a232e1a2', 'request_id': 'req-d3da0a79-32b7-4f6f-89df-fcc0bce05598'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:29:59.682347 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-d3da0a79-32b7-4f6f-89df-fcc0bce05598 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4e37b7f651348edb2674302a232e1a2', 'request_id': 'req-d3da0a79-32b7-4f6f-89df-fcc0bce05598'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:29:59.741033 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-d3da0a79-32b7-4f6f-89df-fcc0bce05598 admin admin] The token cache is being invalidate because project a4e37b7f651348edb2674302a232e1a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:29:59.741413 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-d3da0a79-32b7-4f6f-89df-fcc0bce05598 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:29:59.743423 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-d3da0a79-32b7-4f6f-89df-fcc0bce05598 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:29:59.748968 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 876/1736] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:29:59 2022] DELETE /identity/v3/projects/a4e37b7f651348edb2674302a232e1a2 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:29:59.754939 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d040fdc-b900-4d37-9edc-255dbc8d66d6 service neutron] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:29:59.810717 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d040fdc-b900-4d37-9edc-255dbc8d66d6 service neutron] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:00.067102 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:00.253721 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7531314-fba5-4611-9d5c-1cdbd0f136d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:00.266032 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7531314-fba5-4611-9d5c-1cdbd0f136d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:00.266732 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7531314-fba5-4611-9d5c-1cdbd0f136d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:00.267437 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7531314-fba5-4611-9d5c-1cdbd0f136d4 admin admin] PATH_INFO: `/v3/users/6a05818043db4a7e9a6da36ac2df170e` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:00.275508 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7531314-fba5-4611-9d5c-1cdbd0f136d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a05818043db4a7e9a6da36ac2df170e)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:00.292435 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7531314-fba5-4611-9d5c-1cdbd0f136d4 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:00.796985 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-f7531314-fba5-4611-9d5c-1cdbd0f136d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a05818043db4a7e9a6da36ac2df170e'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:00.899668 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-f7531314-fba5-4611-9d5c-1cdbd0f136d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a05818043db4a7e9a6da36ac2df170e'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:00.905078 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-f7531314-fba5-4611-9d5c-1cdbd0f136d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a05818043db4a7e9a6da36ac2df170e'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:00.929709 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-f7531314-fba5-4611-9d5c-1cdbd0f136d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a05818043db4a7e9a6da36ac2df170e'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:00.931157 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-f7531314-fba5-4611-9d5c-1cdbd0f136d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a05818043db4a7e9a6da36ac2df170e'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:01.007835 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 861/1737] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:29:59 2022] DELETE /identity/v3/users/6a05818043db4a7e9a6da36ac2df170e => generated 0 bytes in 1254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:30:01.282605 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3da0a79-32b7-4f6f-89df-fcc0bce05598 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:01.285710 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-d3da0a79-32b7-4f6f-89df-fcc0bce05598 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:01.370255 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a1c2c-f0bc-4f6b-b55a-5211eeb1b921 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:01.370758 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a1c2c-f0bc-4f6b-b55a-5211eeb1b921 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:01.371333 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a1c2c-f0bc-4f6b-b55a-5211eeb1b921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:01.440573 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3da0a79-32b7-4f6f-89df-fcc0bce05598 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:01.749006 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:01.773209 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de16c48f-cfbf-4d82-b380-167dca2c9753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:01.775723 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de16c48f-cfbf-4d82-b380-167dca2c9753 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:01.783461 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de16c48f-cfbf-4d82-b380-167dca2c9753 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:01.784074 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de16c48f-cfbf-4d82-b380-167dca2c9753 admin admin] PATH_INFO: `/v3/users/ec82330e1a29471f97da066f08c57fb6` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:01.786245 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de16c48f-cfbf-4d82-b380-167dca2c9753 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec82330e1a29471f97da066f08c57fb6)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:01.788902 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de16c48f-cfbf-4d82-b380-167dca2c9753 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:01.825859 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-d85a1c2c-f0bc-4f6b-b55a-5211eeb1b921 None None] MFA Rules not processed for user `149aa48acd504354a1d021885ca51334`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:30:01.835342 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-d85a1c2c-f0bc-4f6b-b55a-5211eeb1b921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:01.916130 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-de16c48f-cfbf-4d82-b380-167dca2c9753 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec82330e1a29471f97da066f08c57fb6'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:01.963825 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-de16c48f-cfbf-4d82-b380-167dca2c9753 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec82330e1a29471f97da066f08c57fb6'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:01.992353 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-de16c48f-cfbf-4d82-b380-167dca2c9753 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec82330e1a29471f97da066f08c57fb6'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:01.994019 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-de16c48f-cfbf-4d82-b380-167dca2c9753 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec82330e1a29471f97da066f08c57fb6'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:02.021504 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-de16c48f-cfbf-4d82-b380-167dca2c9753 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec82330e1a29471f97da066f08c57fb6'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:02.034906 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 877/1738] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:30:01 2022] DELETE /identity/v3/users/ec82330e1a29471f97da066f08c57fb6 => generated 0 bytes in 751 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:30:02.047785 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27483889-c39e-41f0-8eee-071808ed3b72 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:02.048332 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27483889-c39e-41f0-8eee-071808ed3b72 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:02.050225 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27483889-c39e-41f0-8eee-071808ed3b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:02.111825 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-27483889-c39e-41f0-8eee-071808ed3b72 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:30:02.113163 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-27483889-c39e-41f0-8eee-071808ed3b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:02.278909 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 862/1739] 10.222.0.79 () {58 vars in 1009 bytes} [Wed Aug 31 12:30:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 912 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:30:02.467077 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 878/1740] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:30:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:30:02.540664 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85a1c2c-f0bc-4f6b-b55a-5211eeb1b921 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:02.556696 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-d85a1c2c-f0bc-4f6b-b55a-5211eeb1b921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:02.736806 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:02.755215 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27483889-c39e-41f0-8eee-071808ed3b72 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:02.756973 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-27483889-c39e-41f0-8eee-071808ed3b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:02.883940 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85a1c2c-f0bc-4f6b-b55a-5211eeb1b921 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:03.046934 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477a29fb-e3f2-4b1f-85a7-9078d66ed090 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:03.047799 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a29fb-e3f2-4b1f-85a7-9078d66ed090 service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:03.050466 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a29fb-e3f2-4b1f-85a7-9078d66ed090 service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:03.050956 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a29fb-e3f2-4b1f-85a7-9078d66ed090 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:03.082542 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477a29fb-e3f2-4b1f-85a7-9078d66ed090 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:03.084961 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477a29fb-e3f2-4b1f-85a7-9078d66ed090 service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:03.125769 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 863/1741] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:30:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 586 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:30:03.131646 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:03.172373 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27483889-c39e-41f0-8eee-071808ed3b72 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:03.195971 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5a7399-0500-4ed8-963c-cdcba5384729 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896540cc14f40b08d05ade32cfd0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:03.196985 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5a7399-0500-4ed8-963c-cdcba5384729 service swift] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:03.197458 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5a7399-0500-4ed8-963c-cdcba5384729 service swift] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:03.202141 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5a7399-0500-4ed8-963c-cdcba5384729 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:03.474939 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5a7399-0500-4ed8-963c-cdcba5384729 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:03.482593 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5a7399-0500-4ed8-963c-cdcba5384729 service swift] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:03.500873 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 879/1742] 10.222.0.79 () {60 vars in 1384 bytes} [Wed Aug 31 12:30:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 746 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 12:30:05.796408 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477a29fb-e3f2-4b1f-85a7-9078d66ed090 service neutron] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:05.798840 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-477a29fb-e3f2-4b1f-85a7-9078d66ed090 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:05.858807 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477a29fb-e3f2-4b1f-85a7-9078d66ed090 service neutron] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:05.886976 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a9986c-ed32-4cd3-bd59-564fc8b4d039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:05.891250 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a9986c-ed32-4cd3-bd59-564fc8b4d039 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:05.891776 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a9986c-ed32-4cd3-bd59-564fc8b4d039 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:05.892950 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a9986c-ed32-4cd3-bd59-564fc8b4d039 admin admin] PATH_INFO: `/v3/projects/22436707f34d4d28b6979d4f673041e8` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:05.897276 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a9986c-ed32-4cd3-bd59-564fc8b4d039 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22436707f34d4d28b6979d4f673041e8)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:05.900403 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a9986c-ed32-4cd3-bd59-564fc8b4d039 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:06.337509 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-51a9986c-ed32-4cd3-bd59-564fc8b4d039 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22436707f34d4d28b6979d4f673041e8', 'request_id': 'req-51a9986c-ed32-4cd3-bd59-564fc8b4d039'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:06.374086 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-51a9986c-ed32-4cd3-bd59-564fc8b4d039 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22436707f34d4d28b6979d4f673041e8', 'request_id': 'req-51a9986c-ed32-4cd3-bd59-564fc8b4d039'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:06.417046 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-51a9986c-ed32-4cd3-bd59-564fc8b4d039 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22436707f34d4d28b6979d4f673041e8', 'request_id': 'req-51a9986c-ed32-4cd3-bd59-564fc8b4d039'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:06.505072 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-51a9986c-ed32-4cd3-bd59-564fc8b4d039 admin admin] The token cache is being invalidate because project 22436707f34d4d28b6979d4f673041e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:30:06.505683 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-51a9986c-ed32-4cd3-bd59-564fc8b4d039 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:06.507499 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-51a9986c-ed32-4cd3-bd59-564fc8b4d039 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:06.524093 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 864/1743] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:30:05 2022] DELETE /identity/v3/projects/22436707f34d4d28b6979d4f673041e8 => generated 0 bytes in 725 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:30:06.541938 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c387cfb-2187-478c-855e-3f095fb9fcb8 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:06.552242 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c387cfb-2187-478c-855e-3f095fb9fcb8 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:06.553286 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c387cfb-2187-478c-855e-3f095fb9fcb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:06.633862 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-6c387cfb-2187-478c-855e-3f095fb9fcb8 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:30:06.636506 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-6c387cfb-2187-478c-855e-3f095fb9fcb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:06.919707 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 880/1744] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:30:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:30:06.933948 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee51e4-b0e0-4d20-b455-a2e625bb9db6 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:06.934826 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee51e4-b0e0-4d20-b455-a2e625bb9db6 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:06.934996 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee51e4-b0e0-4d20-b455-a2e625bb9db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:07.083592 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-2dee51e4-b0e0-4d20-b455-a2e625bb9db6 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:30:07.099244 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-2dee51e4-b0e0-4d20-b455-a2e625bb9db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:07.142455 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 865/1745] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:30:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:30:07.147991 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c387cfb-2187-478c-855e-3f095fb9fcb8 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:07.186786 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c387cfb-2187-478c-855e-3f095fb9fcb8 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:07.231427 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfb9836-32eb-40ee-be60-5cfd616f4f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:07.236188 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfb9836-32eb-40ee-be60-5cfd616f4f89 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:07.241348 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfb9836-32eb-40ee-be60-5cfd616f4f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:07.248875 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfb9836-32eb-40ee-be60-5cfd616f4f89 admin admin] PATH_INFO: `/v3/domains` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:07.250052 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfb9836-32eb-40ee-be60-5cfd616f4f89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:30:07.251409 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfb9836-32eb-40ee-be60-5cfd616f4f89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:07.253455 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfb9836-32eb-40ee-be60-5cfd616f4f89 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:07.293998 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dee51e4-b0e0-4d20-b455-a2e625bb9db6 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:07.304473 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 881/1746] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 12:30:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:30:07.307218 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dee51e4-b0e0-4d20-b455-a2e625bb9db6 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:07.326783 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63417ed-841e-402d-b267-9693ab70abeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:07.327884 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63417ed-841e-402d-b267-9693ab70abeb admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:07.328400 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63417ed-841e-402d-b267-9693ab70abeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:07.328892 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63417ed-841e-402d-b267-9693ab70abeb admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:07.329823 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63417ed-841e-402d-b267-9693ab70abeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:07.343906 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63417ed-841e-402d-b267-9693ab70abeb admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:07.455143 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 866/1747] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:30:07 2022] POST /identity/v3/projects => generated 383 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:30:07.456526 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfb9836-32eb-40ee-be60-5cfd616f4f89 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:07.477702 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfb9836-32eb-40ee-be60-5cfd616f4f89 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:07.843314 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03b9063-9a15-415d-bd1b-2333676ce69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:07.844277 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03b9063-9a15-415d-bd1b-2333676ce69b admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:07.844277 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03b9063-9a15-415d-bd1b-2333676ce69b admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:07.845356 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03b9063-9a15-415d-bd1b-2333676ce69b admin admin] PATH_INFO: `/v3/users` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:07.849022 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03b9063-9a15-415d-bd1b-2333676ce69b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:07.856843 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03b9063-9a15-415d-bd1b-2333676ce69b admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:07.915419 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 882/1748] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:30:07 2022] POST /identity/v3/users => generated 292 bytes in 460 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:30:07.923217 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63417ed-841e-402d-b267-9693ab70abeb admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:07.957249 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63417ed-841e-402d-b267-9693ab70abeb admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:07.977313 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7237bbc8-ad9d-4ca9-991b-e153ba2f5a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:07.978706 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7237bbc8-ad9d-4ca9-991b-e153ba2f5a67 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:07.979712 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7237bbc8-ad9d-4ca9-991b-e153ba2f5a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:07.981210 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7237bbc8-ad9d-4ca9-991b-e153ba2f5a67 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:07.983051 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7237bbc8-ad9d-4ca9-991b-e153ba2f5a67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:07.986222 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7237bbc8-ad9d-4ca9-991b-e153ba2f5a67 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:08.034294 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 867/1749] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:30:07 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:30:08.035204 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03b9063-9a15-415d-bd1b-2333676ce69b admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:08.086713 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03b9063-9a15-415d-bd1b-2333676ce69b admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:08.120876 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f680c583-75f0-4009-8931-7afac09e5109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:08.125967 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680c583-75f0-4009-8931-7afac09e5109 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:08.128391 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680c583-75f0-4009-8931-7afac09e5109 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:08.132958 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680c583-75f0-4009-8931-7afac09e5109 admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:08.135378 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f680c583-75f0-4009-8931-7afac09e5109 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:08.145854 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f680c583-75f0-4009-8931-7afac09e5109 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:08.223441 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 883/1750] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:30:08 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:30:08.231180 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7237bbc8-ad9d-4ca9-991b-e153ba2f5a67 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:08.278385 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7237bbc8-ad9d-4ca9-991b-e153ba2f5a67 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:08.310558 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d32559b-57e5-4080-87c5-310bcc0b5ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:08.311762 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d32559b-57e5-4080-87c5-310bcc0b5ca7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:08.312228 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d32559b-57e5-4080-87c5-310bcc0b5ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:08.312678 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d32559b-57e5-4080-87c5-310bcc0b5ca7 admin admin] PATH_INFO: `/v3/projects/6aeb25ef58f64bd1aa98e5ea22d5df48/users/027b7ea48e734a35a4ad2efb2cca7802/roles/b5cfd7a855a448359e9017f51d32b6fc` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:08.408215 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d32559b-57e5-4080-87c5-310bcc0b5ca7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6aeb25ef58f64bd1aa98e5ea22d5df48, user_id=027b7ea48e734a35a4ad2efb2cca7802, role_id=b5cfd7a855a448359e9017f51d32b6fc)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:08.434148 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d32559b-57e5-4080-87c5-310bcc0b5ca7 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:08.495886 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 868/1751] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:30:08 2022] PUT /identity/v3/projects/6aeb25ef58f64bd1aa98e5ea22d5df48/users/027b7ea48e734a35a4ad2efb2cca7802/roles/b5cfd7a855a448359e9017f51d32b6fc => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:30:08.514521 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc94b968-f9c6-477c-a01c-f924ce925fbd None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:08.515136 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc94b968-f9c6-477c-a01c-f924ce925fbd None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:08.515595 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc94b968-f9c6-477c-a01c-f924ce925fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:08.532499 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:08.556296 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d32559b-57e5-4080-87c5-310bcc0b5ca7 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:08.560959 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-8d32559b-57e5-4080-87c5-310bcc0b5ca7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:08.580780 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:08.632781 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-cc94b968-f9c6-477c-a01c-f924ce925fbd None None] MFA Rules not processed for user `027b7ea48e734a35a4ad2efb2cca7802`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:30:08.637549 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-cc94b968-f9c6-477c-a01c-f924ce925fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:08.905012 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d32559b-57e5-4080-87c5-310bcc0b5ca7 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:08.955902 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d59b456-abbf-47a5-bb63-cafaa1843aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:08.965031 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d59b456-abbf-47a5-bb63-cafaa1843aaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:08.965774 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d59b456-abbf-47a5-bb63-cafaa1843aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:08.968164 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d59b456-abbf-47a5-bb63-cafaa1843aaa admin admin] PATH_INFO: `/v3/projects/f2fbce17e1be41e69d50b7bced08a666` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:08.972599 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 884/1752] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:30:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 459 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:30:08.977129 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d59b456-abbf-47a5-bb63-cafaa1843aaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2fbce17e1be41e69d50b7bced08a666)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:08.981502 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc94b968-f9c6-477c-a01c-f924ce925fbd None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:08.983857 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d59b456-abbf-47a5-bb63-cafaa1843aaa admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:08.984571 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-cc94b968-f9c6-477c-a01c-f924ce925fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:09.014364 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc94b968-f9c6-477c-a01c-f924ce925fbd None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:09.026292 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c33ac89-1564-4d5a-ad0c-30d750da5de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:09.028127 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c33ac89-1564-4d5a-ad0c-30d750da5de4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:09.029073 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c33ac89-1564-4d5a-ad0c-30d750da5de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:09.029788 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c33ac89-1564-4d5a-ad0c-30d750da5de4 admin admin] PATH_INFO: `/v3/users/d39f66fe1acb4877b79e2ea77ec28f89` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:09.033240 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c33ac89-1564-4d5a-ad0c-30d750da5de4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d39f66fe1acb4877b79e2ea77ec28f89)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:09.051080 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c33ac89-1564-4d5a-ad0c-30d750da5de4 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:09.115541 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-9d59b456-abbf-47a5-bb63-cafaa1843aaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2fbce17e1be41e69d50b7bced08a666', 'request_id': 'req-9d59b456-abbf-47a5-bb63-cafaa1843aaa'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:09.142793 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-9d59b456-abbf-47a5-bb63-cafaa1843aaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2fbce17e1be41e69d50b7bced08a666', 'request_id': 'req-9d59b456-abbf-47a5-bb63-cafaa1843aaa'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:09.169675 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-9d59b456-abbf-47a5-bb63-cafaa1843aaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2fbce17e1be41e69d50b7bced08a666', 'request_id': 'req-9d59b456-abbf-47a5-bb63-cafaa1843aaa'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:09.200914 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-9d59b456-abbf-47a5-bb63-cafaa1843aaa admin admin] The token cache is being invalidate because project f2fbce17e1be41e69d50b7bced08a666 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:30:09.201231 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-9d59b456-abbf-47a5-bb63-cafaa1843aaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:09.203472 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-9d59b456-abbf-47a5-bb63-cafaa1843aaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:09.205363 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 869/1753] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:30:08 2022] DELETE /identity/v3/projects/f2fbce17e1be41e69d50b7bced08a666 => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:30:09.207854 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d59b456-abbf-47a5-bb63-cafaa1843aaa admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:09.211110 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-9d59b456-abbf-47a5-bb63-cafaa1843aaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:09.238911 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-0c33ac89-1564-4d5a-ad0c-30d750da5de4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd39f66fe1acb4877b79e2ea77ec28f89'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:09.293274 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-0c33ac89-1564-4d5a-ad0c-30d750da5de4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd39f66fe1acb4877b79e2ea77ec28f89'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:09.340528 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-0c33ac89-1564-4d5a-ad0c-30d750da5de4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd39f66fe1acb4877b79e2ea77ec28f89'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:09.348930 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-0c33ac89-1564-4d5a-ad0c-30d750da5de4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd39f66fe1acb4877b79e2ea77ec28f89'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:09.399288 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-0c33ac89-1564-4d5a-ad0c-30d750da5de4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd39f66fe1acb4877b79e2ea77ec28f89'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:09.423651 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 885/1754] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:30:08 2022] DELETE /identity/v3/users/d39f66fe1acb4877b79e2ea77ec28f89 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:30:09.425419 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c33ac89-1564-4d5a-ad0c-30d750da5de4 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:09.428580 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-0c33ac89-1564-4d5a-ad0c-30d750da5de4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:09.505748 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d59b456-abbf-47a5-bb63-cafaa1843aaa admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:09.644748 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:09.742517 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c33ac89-1564-4d5a-ad0c-30d750da5de4 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:09.757414 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8a92b0-4c1c-4c55-b305-ec5f154a6e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:09.758302 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a92b0-4c1c-4c55-b305-ec5f154a6e47 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:09.759008 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a92b0-4c1c-4c55-b305-ec5f154a6e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:09.759566 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a92b0-4c1c-4c55-b305-ec5f154a6e47 admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:09.760355 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8a92b0-4c1c-4c55-b305-ec5f154a6e47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:09.763197 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8a92b0-4c1c-4c55-b305-ec5f154a6e47 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:09.775023 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e935875-fabc-45de-ab34-e746710ca120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:09.777166 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e935875-fabc-45de-ab34-e746710ca120 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:09.777166 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e935875-fabc-45de-ab34-e746710ca120 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:09.778050 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e935875-fabc-45de-ab34-e746710ca120 admin admin] PATH_INFO: `/v3/users/0923a66e76424981a2db2a9eb1f3e7bc` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:09.784205 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e935875-fabc-45de-ab34-e746710ca120 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0923a66e76424981a2db2a9eb1f3e7bc)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:09.787654 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e935875-fabc-45de-ab34-e746710ca120 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:09.825215 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:09.847459 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 870/1755] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:30:09 2022] POST /identity/v3/projects => generated 381 bytes in 641 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:30:09.849303 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccc9633-ab77-4240-98be-630e8d4101ec None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:09.849639 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccc9633-ab77-4240-98be-630e8d4101ec None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:09.850148 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccc9633-ab77-4240-98be-630e8d4101ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:09.916564 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-2ccc9633-ab77-4240-98be-630e8d4101ec None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:30:09.918842 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-2ccc9633-ab77-4240-98be-630e8d4101ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:09.936808 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-9e935875-fabc-45de-ab34-e746710ca120 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0923a66e76424981a2db2a9eb1f3e7bc'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:09.968334 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-9e935875-fabc-45de-ab34-e746710ca120 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0923a66e76424981a2db2a9eb1f3e7bc'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:09.981301 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-9e935875-fabc-45de-ab34-e746710ca120 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0923a66e76424981a2db2a9eb1f3e7bc'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:09.997421 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-9e935875-fabc-45de-ab34-e746710ca120 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0923a66e76424981a2db2a9eb1f3e7bc'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:10.032354 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-9e935875-fabc-45de-ab34-e746710ca120 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0923a66e76424981a2db2a9eb1f3e7bc'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:10.055418 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 886/1756] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:30:09 2022] DELETE /identity/v3/users/0923a66e76424981a2db2a9eb1f3e7bc => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:30:10.057648 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e935875-fabc-45de-ab34-e746710ca120 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:10.067232 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-9e935875-fabc-45de-ab34-e746710ca120 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:10.079001 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 871/1757] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:30:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:30:10.118891 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccc9633-ab77-4240-98be-630e8d4101ec None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:10.120398 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-2ccc9633-ab77-4240-98be-630e8d4101ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:10.245520 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e935875-fabc-45de-ab34-e746710ca120 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:10.258783 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccc9633-ab77-4240-98be-630e8d4101ec None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:10.271334 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97606722-c37c-46d4-88a7-d6cb93880ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:10.275819 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97606722-c37c-46d4-88a7-d6cb93880ee6 admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:10.280881 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97606722-c37c-46d4-88a7-d6cb93880ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:10.281261 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97606722-c37c-46d4-88a7-d6cb93880ee6 admin admin] PATH_INFO: `/v3/users` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:10.282259 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97606722-c37c-46d4-88a7-d6cb93880ee6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:10.288750 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97606722-c37c-46d4-88a7-d6cb93880ee6 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:10.327836 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 887/1758] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:30:10 2022] POST /identity/v3/users => generated 297 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:30:10.329613 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97606722-c37c-46d4-88a7-d6cb93880ee6 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:10.342577 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97606722-c37c-46d4-88a7-d6cb93880ee6 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:10.350929 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c04d70-f581-4369-8626-78ff56519a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:10.351898 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c04d70-f581-4369-8626-78ff56519a6a admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:10.359772 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c04d70-f581-4369-8626-78ff56519a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:10.360101 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c04d70-f581-4369-8626-78ff56519a6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:10.360859 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c04d70-f581-4369-8626-78ff56519a6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:10.362967 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c04d70-f581-4369-8626-78ff56519a6a admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:10.398304 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211cf921-2278-4097-ae43-f4dcf5ac8054 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:10.399830 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211cf921-2278-4097-ae43-f4dcf5ac8054 service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:10.400440 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211cf921-2278-4097-ae43-f4dcf5ac8054 service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:10.400934 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211cf921-2278-4097-ae43-f4dcf5ac8054 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:10.406389 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 888/1759] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:30:10 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:30:10.411978 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c04d70-f581-4369-8626-78ff56519a6a admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:10.419300 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211cf921-2278-4097-ae43-f4dcf5ac8054 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:10.421291 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211cf921-2278-4097-ae43-f4dcf5ac8054 service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:10.425457 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c04d70-f581-4369-8626-78ff56519a6a admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:10.432114 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8871307-5607-4b44-ae06-fd06e8f55a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:10.432927 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8871307-5607-4b44-ae06-fd06e8f55a4f admin admin] REQUEST_METHOD: `PUT` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:10.433214 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8871307-5607-4b44-ae06-fd06e8f55a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:10.434231 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8871307-5607-4b44-ae06-fd06e8f55a4f admin admin] PATH_INFO: `/v3/projects/cccd742c0cf549e3bfdeb569643817b9/users/2c7ad9de333c40a8b583afb4f0b5fef4/roles/a332ef951db949b0bad7019fbd28a1b9` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:10.447735 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 872/1760] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:30:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:30:10.462334 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8871307-5607-4b44-ae06-fd06e8f55a4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cccd742c0cf549e3bfdeb569643817b9, user_id=2c7ad9de333c40a8b583afb4f0b5fef4, role_id=a332ef951db949b0bad7019fbd28a1b9)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:10.465809 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8871307-5607-4b44-ae06-fd06e8f55a4f admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:10.490418 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 889/1761] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:30:10 2022] PUT /identity/v3/projects/cccd742c0cf549e3bfdeb569643817b9/users/2c7ad9de333c40a8b583afb4f0b5fef4/roles/a332ef951db949b0bad7019fbd28a1b9 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:30:10.494363 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211cf921-2278-4097-ae43-f4dcf5ac8054 service neutron] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:10.510340 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211cf921-2278-4097-ae43-f4dcf5ac8054 service neutron] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:10.543550 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:10.617325 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dde2a6-f874-4f51-88e8-dced9d275ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:10.618396 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dde2a6-f874-4f51-88e8-dced9d275ddf admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:10.618881 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dde2a6-f874-4f51-88e8-dced9d275ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:10.619280 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dde2a6-f874-4f51-88e8-dced9d275ddf admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:10.621487 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dde2a6-f874-4f51-88e8-dced9d275ddf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:10.623315 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dde2a6-f874-4f51-88e8-dced9d275ddf admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:10.643449 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 873/1762] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:30:10 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:30:10.648629 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8871307-5607-4b44-ae06-fd06e8f55a4f admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:10.669268 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8871307-5607-4b44-ae06-fd06e8f55a4f admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:10.677312 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e40f0c-d014-452b-9fc7-76e958ca058e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:10.680141 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e40f0c-d014-452b-9fc7-76e958ca058e admin admin] REQUEST_METHOD: `PUT` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:10.680431 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e40f0c-d014-452b-9fc7-76e958ca058e admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:10.683284 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e40f0c-d014-452b-9fc7-76e958ca058e admin admin] PATH_INFO: `/v3/projects/cccd742c0cf549e3bfdeb569643817b9/users/2c7ad9de333c40a8b583afb4f0b5fef4/roles/a332ef951db949b0bad7019fbd28a1b9` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:10.686527 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e40f0c-d014-452b-9fc7-76e958ca058e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cccd742c0cf549e3bfdeb569643817b9, user_id=2c7ad9de333c40a8b583afb4f0b5fef4, role_id=a332ef951db949b0bad7019fbd28a1b9)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:10.689832 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e40f0c-d014-452b-9fc7-76e958ca058e admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:10.715539 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 890/1763] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:30:10 2022] PUT /identity/v3/projects/cccd742c0cf549e3bfdeb569643817b9/users/2c7ad9de333c40a8b583afb4f0b5fef4/roles/a332ef951db949b0bad7019fbd28a1b9 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:30:10.727648 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f30c0-14e1-4d2c-a7a1-e08318971e01 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:10.727931 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f30c0-14e1-4d2c-a7a1-e08318971e01 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:10.728231 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f30c0-14e1-4d2c-a7a1-e08318971e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:10.785483 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-677f30c0-14e1-4d2c-a7a1-e08318971e01 None None] MFA Rules not processed for user `2c7ad9de333c40a8b583afb4f0b5fef4`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:30:10.792361 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-677f30c0-14e1-4d2c-a7a1-e08318971e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:10.899611 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e40f0c-d014-452b-9fc7-76e958ca058e admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:10.901824 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-60e40f0c-d014-452b-9fc7-76e958ca058e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:10.955480 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 874/1764] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:30:10 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:30:10.964483 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677f30c0-14e1-4d2c-a7a1-e08318971e01 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:10.966575 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-677f30c0-14e1-4d2c-a7a1-e08318971e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:10.992604 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=84,keystone:DELETE=10,keystone:INSERT=6 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:11.091110 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e40f0c-d014-452b-9fc7-76e958ca058e admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:11.117292 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d927b1a-86ae-4509-808e-43d8ac1ce05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:11.118015 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d927b1a-86ae-4509-808e-43d8ac1ce05d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:11.118298 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d927b1a-86ae-4509-808e-43d8ac1ce05d admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:11.118573 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d927b1a-86ae-4509-808e-43d8ac1ce05d admin admin] PATH_INFO: `/v3/projects/83d0d866cadf453d8e2e8bd38a112790` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:11.131262 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d927b1a-86ae-4509-808e-43d8ac1ce05d admin admin] RBAC: Authorizing `identity:delete_project(project_id=83d0d866cadf453d8e2e8bd38a112790)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:11.140894 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d927b1a-86ae-4509-808e-43d8ac1ce05d admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:11.180343 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677f30c0-14e1-4d2c-a7a1-e08318971e01 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:11.186534 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1351b9-af5a-4cbc-b47b-63c1cc350eec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e79503178ac54e62ba385467d5617ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:11.187219 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1351b9-af5a-4cbc-b47b-63c1cc350eec service cinder] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:11.187534 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1351b9-af5a-4cbc-b47b-63c1cc350eec service cinder] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:11.187890 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1351b9-af5a-4cbc-b47b-63c1cc350eec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:11.212036 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1351b9-af5a-4cbc-b47b-63c1cc350eec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:11.215795 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1351b9-af5a-4cbc-b47b-63c1cc350eec service cinder] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:11.253953 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 875/1765] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:30:10 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:30:11.286943 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1351b9-af5a-4cbc-b47b-63c1cc350eec service cinder] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:11.288699 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-5f1351b9-af5a-4cbc-b47b-63c1cc350eec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:11.311793 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-8d927b1a-86ae-4509-808e-43d8ac1ce05d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83d0d866cadf453d8e2e8bd38a112790', 'request_id': 'req-8d927b1a-86ae-4509-808e-43d8ac1ce05d'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:11.323851 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1351b9-af5a-4cbc-b47b-63c1cc350eec service cinder] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:11.365931 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-8d927b1a-86ae-4509-808e-43d8ac1ce05d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83d0d866cadf453d8e2e8bd38a112790', 'request_id': 'req-8d927b1a-86ae-4509-808e-43d8ac1ce05d'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:11.405620 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-8d927b1a-86ae-4509-808e-43d8ac1ce05d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83d0d866cadf453d8e2e8bd38a112790', 'request_id': 'req-8d927b1a-86ae-4509-808e-43d8ac1ce05d'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:11.465736 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-8d927b1a-86ae-4509-808e-43d8ac1ce05d admin admin] The token cache is being invalidate because project 83d0d866cadf453d8e2e8bd38a112790 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:30:11.466501 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-8d927b1a-86ae-4509-808e-43d8ac1ce05d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:11.473415 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-8d927b1a-86ae-4509-808e-43d8ac1ce05d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:11.480017 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 891/1766] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:30:10 2022] DELETE /identity/v3/projects/83d0d866cadf453d8e2e8bd38a112790 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:30:11.481781 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d927b1a-86ae-4509-808e-43d8ac1ce05d admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:11.484901 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-8d927b1a-86ae-4509-808e-43d8ac1ce05d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:11.576269 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:11.654017 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c775c9e8-01e7-448f-8eec-5932494c7a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:11.656816 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c775c9e8-01e7-448f-8eec-5932494c7a9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:11.660743 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c775c9e8-01e7-448f-8eec-5932494c7a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:11.662331 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c775c9e8-01e7-448f-8eec-5932494c7a9e admin admin] PATH_INFO: `/v3/projects/68fa0055c1184e18bdfde9cf95cae39d` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:11.667156 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c775c9e8-01e7-448f-8eec-5932494c7a9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=68fa0055c1184e18bdfde9cf95cae39d)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:11.683594 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c775c9e8-01e7-448f-8eec-5932494c7a9e admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:11.806632 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d927b1a-86ae-4509-808e-43d8ac1ce05d admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:11.820037 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf61390-914f-43cd-8d93-0d376f014363 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e79503178ac54e62ba385467d5617ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:11.821338 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf61390-914f-43cd-8d93-0d376f014363 service cinder] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:11.824897 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf61390-914f-43cd-8d93-0d376f014363 service cinder] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:11.825886 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf61390-914f-43cd-8d93-0d376f014363 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:11.836578 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-fbf61390-914f-43cd-8d93-0d376f014363 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:12.045181 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf61390-914f-43cd-8d93-0d376f014363 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:12.046229 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf61390-914f-43cd-8d93-0d376f014363 service cinder] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:12.084542 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-c775c9e8-01e7-448f-8eec-5932494c7a9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68fa0055c1184e18bdfde9cf95cae39d', 'request_id': 'req-c775c9e8-01e7-448f-8eec-5932494c7a9e'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:12.098079 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 892/1767] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:30:11 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 617 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:30:12.103175 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a9d6f4-6148-45b8-9952-4d7365f102b5 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:12.105350 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a9d6f4-6148-45b8-9952-4d7365f102b5 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:12.106372 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a9d6f4-6148-45b8-9952-4d7365f102b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:12.141981 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-c775c9e8-01e7-448f-8eec-5932494c7a9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68fa0055c1184e18bdfde9cf95cae39d', 'request_id': 'req-c775c9e8-01e7-448f-8eec-5932494c7a9e'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:12.204526 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-c775c9e8-01e7-448f-8eec-5932494c7a9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68fa0055c1184e18bdfde9cf95cae39d', 'request_id': 'req-c775c9e8-01e7-448f-8eec-5932494c7a9e'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:12.256598 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-b7a9d6f4-6148-45b8-9952-4d7365f102b5 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:30:12.275312 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-b7a9d6f4-6148-45b8-9952-4d7365f102b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:12.316143 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-c775c9e8-01e7-448f-8eec-5932494c7a9e admin admin] The token cache is being invalidate because project 68fa0055c1184e18bdfde9cf95cae39d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:30:12.316585 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-c775c9e8-01e7-448f-8eec-5932494c7a9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:12.326460 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-c775c9e8-01e7-448f-8eec-5932494c7a9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:12.344979 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:12.354321 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 876/1768] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:30:11 2022] DELETE /identity/v3/projects/68fa0055c1184e18bdfde9cf95cae39d => generated 0 bytes in 1066 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:30:12.363629 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c775c9e8-01e7-448f-8eec-5932494c7a9e admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:12.388022 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-c775c9e8-01e7-448f-8eec-5932494c7a9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:12.736330 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 893/1769] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:30:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 637 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:30:12.739295 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790e988-39f1-4a57-bedc-06235be83439 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:12.739772 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790e988-39f1-4a57-bedc-06235be83439 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:12.739893 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790e988-39f1-4a57-bedc-06235be83439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:12.786037 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c775c9e8-01e7-448f-8eec-5932494c7a9e admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:12.806711 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d49519-337e-422d-8e19-62b74f80d11e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:12.809119 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d49519-337e-422d-8e19-62b74f80d11e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:12.815378 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d49519-337e-422d-8e19-62b74f80d11e admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:12.816813 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-2790e988-39f1-4a57-bedc-06235be83439 None None] MFA Rules not processed for user `1569b43c774c45ff80577d879ba9d819`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:30:12.817355 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d49519-337e-422d-8e19-62b74f80d11e admin admin] PATH_INFO: `/v3/users/55e2339341634da0be694de3c4f28957` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:12.819724 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d49519-337e-422d-8e19-62b74f80d11e admin admin] RBAC: Authorizing `identity:delete_user(user_id=55e2339341634da0be694de3c4f28957)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:12.820870 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-2790e988-39f1-4a57-bedc-06235be83439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:12.826697 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d49519-337e-422d-8e19-62b74f80d11e admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:13.013537 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-e4d49519-337e-422d-8e19-62b74f80d11e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55e2339341634da0be694de3c4f28957'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:13.042867 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 894/1770] 10.222.0.85 () {58 vars in 1015 bytes} [Wed Aug 31 12:30:12 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:30:13.051283 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c54aa-b965-42cf-a298-f69338e8187a None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:13.051954 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c54aa-b965-42cf-a298-f69338e8187a None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:13.052106 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c54aa-b965-42cf-a298-f69338e8187a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:13.061626 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-e4d49519-337e-422d-8e19-62b74f80d11e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55e2339341634da0be694de3c4f28957'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:13.065977 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-e4d49519-337e-422d-8e19-62b74f80d11e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55e2339341634da0be694de3c4f28957'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:13.094601 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-e4d49519-337e-422d-8e19-62b74f80d11e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55e2339341634da0be694de3c4f28957'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:13.096378 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-e4d49519-337e-422d-8e19-62b74f80d11e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55e2339341634da0be694de3c4f28957'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:13.124252 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-ed6c54aa-b965-42cf-a298-f69338e8187a None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:30:13.130389 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-ed6c54aa-b965-42cf-a298-f69338e8187a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:13.137554 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:13.166493 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 895/1771] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:30:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:30:13.171194 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c54aa-b965-42cf-a298-f69338e8187a None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:13.177884 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-ed6c54aa-b965-42cf-a298-f69338e8187a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:13.241378 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 877/1772] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:30:12 2022] DELETE /identity/v3/users/55e2339341634da0be694de3c4f28957 => generated 0 bytes in 886 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:30:13.244501 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d49519-337e-422d-8e19-62b74f80d11e admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:13.298573 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c54aa-b965-42cf-a298-f69338e8187a None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:13.611481 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17784f90-8c2b-4e87-9ef6-ec2afbcdff14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:13.612242 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17784f90-8c2b-4e87-9ef6-ec2afbcdff14 service neutron] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:13.612582 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17784f90-8c2b-4e87-9ef6-ec2afbcdff14 service neutron] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:13.613163 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17784f90-8c2b-4e87-9ef6-ec2afbcdff14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:13.616241 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-17784f90-8c2b-4e87-9ef6-ec2afbcdff14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:13.645528 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d49519-337e-422d-8e19-62b74f80d11e admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:13.649583 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17784f90-8c2b-4e87-9ef6-ec2afbcdff14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:13.652289 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17784f90-8c2b-4e87-9ef6-ec2afbcdff14 service neutron] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:13.659027 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84063a5-a933-4aab-a3b9-b948e5004119 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:13.659027 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84063a5-a933-4aab-a3b9-b948e5004119 service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:13.659553 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84063a5-a933-4aab-a3b9-b948e5004119 service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:13.659811 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84063a5-a933-4aab-a3b9-b948e5004119 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:13.681597 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 896/1773] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:30:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:30:13.682829 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17784f90-8c2b-4e87-9ef6-ec2afbcdff14 service neutron] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:13.693365 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84063a5-a933-4aab-a3b9-b948e5004119 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:13.695637 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84063a5-a933-4aab-a3b9-b948e5004119 service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:13.735489 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 878/1774] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:30:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:30:13.736871 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84063a5-a933-4aab-a3b9-b948e5004119 service neutron] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:13.739925 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-b84063a5-a933-4aab-a3b9-b948e5004119 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:13.883178 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84063a5-a933-4aab-a3b9-b948e5004119 service neutron] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:13.908544 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:13.921221 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17784f90-8c2b-4e87-9ef6-ec2afbcdff14 service neutron] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:13.923581 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec8d027-7267-449b-8bb7-2c17bf404448 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:13.929312 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8d027-7267-449b-8bb7-2c17bf404448 service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:13.930604 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8d027-7267-449b-8bb7-2c17bf404448 service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:13.930941 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8d027-7267-449b-8bb7-2c17bf404448 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:13.941298 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd55a582-2686-4d0a-adc8-f2e9dfba4847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:13.941978 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55a582-2686-4d0a-adc8-f2e9dfba4847 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:13.942284 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55a582-2686-4d0a-adc8-f2e9dfba4847 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:13.942590 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55a582-2686-4d0a-adc8-f2e9dfba4847 admin admin] PATH_INFO: `/v3/domains` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:13.947621 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd55a582-2686-4d0a-adc8-f2e9dfba4847 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:30:13.947934 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd55a582-2686-4d0a-adc8-f2e9dfba4847 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:13.950350 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd55a582-2686-4d0a-adc8-f2e9dfba4847 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:13.961732 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec8d027-7267-449b-8bb7-2c17bf404448 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:13.967475 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec8d027-7267-449b-8bb7-2c17bf404448 service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:14.000590 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 879/1775] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:30:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:30:14.005118 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec8d027-7267-449b-8bb7-2c17bf404448 service neutron] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:14.031278 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 897/1776] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 12:30:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:30:14.032345 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd55a582-2686-4d0a-adc8-f2e9dfba4847 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:14.034149 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec8d027-7267-449b-8bb7-2c17bf404448 service neutron] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:14.047978 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdc60cc-7bee-433f-95f1-1a7da24a1cd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:14.052366 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdc60cc-7bee-433f-95f1-1a7da24a1cd2 service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:14.054235 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdc60cc-7bee-433f-95f1-1a7da24a1cd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:14.057020 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdc60cc-7bee-433f-95f1-1a7da24a1cd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:14.065740 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd55a582-2686-4d0a-adc8-f2e9dfba4847 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:14.076729 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bd6aae-feca-494c-b795-770c9c570277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:14.077684 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bd6aae-feca-494c-b795-770c9c570277 admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:14.078121 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bd6aae-feca-494c-b795-770c9c570277 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:14.078549 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bd6aae-feca-494c-b795-770c9c570277 admin admin] PATH_INFO: `/v3/projects` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:14.079453 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bd6aae-feca-494c-b795-770c9c570277 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:14.081711 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bd6aae-feca-494c-b795-770c9c570277 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:14.096631 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdc60cc-7bee-433f-95f1-1a7da24a1cd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:14.101432 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdc60cc-7bee-433f-95f1-1a7da24a1cd2 service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:14.142484 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 880/1777] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:30:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:30:14.143089 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 898/1778] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:30:14 2022] POST /identity/v3/projects => generated 373 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:30:14.144491 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdc60cc-7bee-433f-95f1-1a7da24a1cd2 service neutron] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:14.199791 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdc60cc-7bee-433f-95f1-1a7da24a1cd2 service neutron] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:14.487108 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d68481-3224-4148-90a5-0dd2d720ad61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:14.487108 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d68481-3224-4148-90a5-0dd2d720ad61 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:14.487108 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d68481-3224-4148-90a5-0dd2d720ad61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:14.487108 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d68481-3224-4148-90a5-0dd2d720ad61 admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:14.492198 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d68481-3224-4148-90a5-0dd2d720ad61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:14.492198 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d68481-3224-4148-90a5-0dd2d720ad61 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:14.548762 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 881/1779] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:30:14 2022] POST /identity/v3/users => generated 287 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:30:14.554260 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bd6aae-feca-494c-b795-770c9c570277 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:14.585667 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bd6aae-feca-494c-b795-770c9c570277 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:14.611629 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371ac874-c328-46af-bc59-e75b447ee1d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:14.612270 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ac874-c328-46af-bc59-e75b447ee1d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:14.612556 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ac874-c328-46af-bc59-e75b447ee1d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:14.612849 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ac874-c328-46af-bc59-e75b447ee1d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:14.617295 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371ac874-c328-46af-bc59-e75b447ee1d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:14.620350 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371ac874-c328-46af-bc59-e75b447ee1d2 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:14.672395 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 899/1780] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:30:14 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:30:14.673914 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d68481-3224-4148-90a5-0dd2d720ad61 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:14.706888 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d68481-3224-4148-90a5-0dd2d720ad61 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:14.727239 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51d407d-a543-4c68-a663-5418ecdb440c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:14.727889 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d407d-a543-4c68-a663-5418ecdb440c admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:14.728168 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d407d-a543-4c68-a663-5418ecdb440c admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:14.728442 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d407d-a543-4c68-a663-5418ecdb440c admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:14.729107 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51d407d-a543-4c68-a663-5418ecdb440c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:14.732784 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51d407d-a543-4c68-a663-5418ecdb440c admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:14.761409 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371ac874-c328-46af-bc59-e75b447ee1d2 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:14.763138 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 882/1781] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:30:14 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:30:14.780339 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371ac874-c328-46af-bc59-e75b447ee1d2 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:14.792306 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afc34ed-1df2-4545-b4cf-a3b13302fd21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:14.796774 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afc34ed-1df2-4545-b4cf-a3b13302fd21 admin admin] REQUEST_METHOD: `PUT` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:14.798146 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afc34ed-1df2-4545-b4cf-a3b13302fd21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:14.798982 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afc34ed-1df2-4545-b4cf-a3b13302fd21 admin admin] PATH_INFO: `/v3/projects/0a46eb3e938c46fb97931af0ba5a465d/users/063515e88123443788531e741d950ea2/roles/b5cfd7a855a448359e9017f51d32b6fc` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:14.849418 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afc34ed-1df2-4545-b4cf-a3b13302fd21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a46eb3e938c46fb97931af0ba5a465d, user_id=063515e88123443788531e741d950ea2, role_id=b5cfd7a855a448359e9017f51d32b6fc)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:14.852851 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afc34ed-1df2-4545-b4cf-a3b13302fd21 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:14.898262 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 900/1782] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:30:14 2022] PUT /identity/v3/projects/0a46eb3e938c46fb97931af0ba5a465d/users/063515e88123443788531e741d950ea2/roles/b5cfd7a855a448359e9017f51d32b6fc => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:30:14.899161 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f227b13c-2936-4c61-80b0-6a6524098ad6 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:14.899443 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f227b13c-2936-4c61-80b0-6a6524098ad6 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:14.899720 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f227b13c-2936-4c61-80b0-6a6524098ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:15.010545 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-f227b13c-2936-4c61-80b0-6a6524098ad6 None None] MFA Rules not processed for user `063515e88123443788531e741d950ea2`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:30:15.012684 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-f227b13c-2936-4c61-80b0-6a6524098ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:15.205104 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:15.297092 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 883/1783] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:30:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:30:15.302018 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afc34ed-1df2-4545-b4cf-a3b13302fd21 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:15.474324 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afc34ed-1df2-4545-b4cf-a3b13302fd21 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:15.485866 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91eea93-259d-41c0-a0ca-54b52f7b431b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:15.486165 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91eea93-259d-41c0-a0ca-54b52f7b431b admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:15.487766 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91eea93-259d-41c0-a0ca-54b52f7b431b admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:15.487926 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91eea93-259d-41c0-a0ca-54b52f7b431b admin admin] PATH_INFO: `/v3/projects` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:15.489869 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91eea93-259d-41c0-a0ca-54b52f7b431b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:15.491193 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91eea93-259d-41c0-a0ca-54b52f7b431b admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:15.601446 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 901/1784] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:30:15 2022] POST /identity/v3/projects => generated 371 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:30:15.606216 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f227b13c-2936-4c61-80b0-6a6524098ad6 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:15.636773 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f227b13c-2936-4c61-80b0-6a6524098ad6 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:15.813193 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cc4202-c672-4728-9131-f890a33d0899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:15.819250 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc4202-c672-4728-9131-f890a33d0899 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:15.824975 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc4202-c672-4728-9131-f890a33d0899 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:15.826683 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc4202-c672-4728-9131-f890a33d0899 admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:15.831905 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cc4202-c672-4728-9131-f890a33d0899 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:15.842351 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cc4202-c672-4728-9131-f890a33d0899 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:15.899521 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 884/1785] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:30:15 2022] POST /identity/v3/users => generated 292 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:30:15.901481 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91eea93-259d-41c0-a0ca-54b52f7b431b admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:15.922253 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91eea93-259d-41c0-a0ca-54b52f7b431b admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:15.942465 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8922e0f0-f1cf-40f0-a1e5-aa67be9617d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:15.944186 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922e0f0-f1cf-40f0-a1e5-aa67be9617d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:15.950925 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922e0f0-f1cf-40f0-a1e5-aa67be9617d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:15.951681 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922e0f0-f1cf-40f0-a1e5-aa67be9617d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:15.952935 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8922e0f0-f1cf-40f0-a1e5-aa67be9617d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:15.958256 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8922e0f0-f1cf-40f0-a1e5-aa67be9617d5 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:16.005258 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 902/1786] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:30:15 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:30:16.011492 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cc4202-c672-4728-9131-f890a33d0899 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:16.024990 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cc4202-c672-4728-9131-f890a33d0899 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:16.046624 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72925050-20c6-45dd-990b-1ab841be844b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:16.049427 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72925050-20c6-45dd-990b-1ab841be844b admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:16.050306 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72925050-20c6-45dd-990b-1ab841be844b admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:16.051030 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72925050-20c6-45dd-990b-1ab841be844b admin admin] PATH_INFO: `/v3/projects/c69405d89b6543a8bd708f8c1e9812b9/users/a23b9dfd2c8c4958985eaab428255ace/roles/a332ef951db949b0bad7019fbd28a1b9` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:16.091875 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72925050-20c6-45dd-990b-1ab841be844b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c69405d89b6543a8bd708f8c1e9812b9, user_id=a23b9dfd2c8c4958985eaab428255ace, role_id=a332ef951db949b0bad7019fbd28a1b9)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:16.098589 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72925050-20c6-45dd-990b-1ab841be844b admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:16.138593 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 885/1787] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:30:16 2022] PUT /identity/v3/projects/c69405d89b6543a8bd708f8c1e9812b9/users/a23b9dfd2c8c4958985eaab428255ace/roles/a332ef951db949b0bad7019fbd28a1b9 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:30:16.145308 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8922e0f0-f1cf-40f0-a1e5-aa67be9617d5 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:16.180781 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8922e0f0-f1cf-40f0-a1e5-aa67be9617d5 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:16.443164 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023a95e7-13e0-4d7b-bd2c-9a60e310c047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:16.445307 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023a95e7-13e0-4d7b-bd2c-9a60e310c047 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:16.445829 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023a95e7-13e0-4d7b-bd2c-9a60e310c047 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:16.446580 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023a95e7-13e0-4d7b-bd2c-9a60e310c047 admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:16.447935 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023a95e7-13e0-4d7b-bd2c-9a60e310c047 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:16.450275 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023a95e7-13e0-4d7b-bd2c-9a60e310c047 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:16.478096 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 903/1788] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:30:16 2022] GET /identity/v3/roles => generated 1420 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:30:16.485631 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72925050-20c6-45dd-990b-1ab841be844b admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:16.515556 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72925050-20c6-45dd-990b-1ab841be844b admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:16.527679 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b6145b-d1c0-4b43-a428-071b7546f5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:16.528871 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b6145b-d1c0-4b43-a428-071b7546f5e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:16.529620 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b6145b-d1c0-4b43-a428-071b7546f5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:16.530087 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b6145b-d1c0-4b43-a428-071b7546f5e8 admin admin] PATH_INFO: `/v3/projects/c69405d89b6543a8bd708f8c1e9812b9/users/a23b9dfd2c8c4958985eaab428255ace/roles/a332ef951db949b0bad7019fbd28a1b9` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:16.533609 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b6145b-d1c0-4b43-a428-071b7546f5e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c69405d89b6543a8bd708f8c1e9812b9, user_id=a23b9dfd2c8c4958985eaab428255ace, role_id=a332ef951db949b0bad7019fbd28a1b9)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:16.540268 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b6145b-d1c0-4b43-a428-071b7546f5e8 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:16.575465 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 886/1789] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:30:16 2022] PUT /identity/v3/projects/c69405d89b6543a8bd708f8c1e9812b9/users/a23b9dfd2c8c4958985eaab428255ace/roles/a332ef951db949b0bad7019fbd28a1b9 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:30:16.587025 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc6b962-1975-4eab-824e-69a0127929c7 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:16.591164 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc6b962-1975-4eab-824e-69a0127929c7 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:16.591164 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc6b962-1975-4eab-824e-69a0127929c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:16.632010 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:16.757183 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-8fc6b962-1975-4eab-824e-69a0127929c7 None None] MFA Rules not processed for user `a23b9dfd2c8c4958985eaab428255ace`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:30:16.760003 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-8fc6b962-1975-4eab-824e-69a0127929c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:16.879368 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b6145b-d1c0-4b43-a428-071b7546f5e8 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:16.884856 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-40b6145b-d1c0-4b43-a428-071b7546f5e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:17.065534 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 904/1790] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:30:16 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 480 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:30:17.114306 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc6b962-1975-4eab-824e-69a0127929c7 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:17.116980 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-8fc6b962-1975-4eab-824e-69a0127929c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:17.260929 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b6145b-d1c0-4b43-a428-071b7546f5e8 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:17.301937 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48154bb5-5075-43a9-8deb-a25669f81d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:17.303988 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48154bb5-5075-43a9-8deb-a25669f81d54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:17.309593 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48154bb5-5075-43a9-8deb-a25669f81d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:17.310153 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48154bb5-5075-43a9-8deb-a25669f81d54 admin admin] PATH_INFO: `/v3/users/027b7ea48e734a35a4ad2efb2cca7802` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:17.314442 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48154bb5-5075-43a9-8deb-a25669f81d54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=027b7ea48e734a35a4ad2efb2cca7802)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:17.317901 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48154bb5-5075-43a9-8deb-a25669f81d54 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:17.359649 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc6b962-1975-4eab-824e-69a0127929c7 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:17.363825 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f725261c-7fa1-44a8-b68f-e52d5ac2e87f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e79503178ac54e62ba385467d5617ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:17.365369 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f725261c-7fa1-44a8-b68f-e52d5ac2e87f service cinder] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:17.365749 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f725261c-7fa1-44a8-b68f-e52d5ac2e87f service cinder] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:17.366963 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f725261c-7fa1-44a8-b68f-e52d5ac2e87f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:17.384050 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f725261c-7fa1-44a8-b68f-e52d5ac2e87f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:17.386780 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f725261c-7fa1-44a8-b68f-e52d5ac2e87f service cinder] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:17.406313 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 905/1791] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:30:17 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:30:17.427214 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:17.456066 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-48154bb5-5075-43a9-8deb-a25669f81d54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '027b7ea48e734a35a4ad2efb2cca7802'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:17.505360 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-48154bb5-5075-43a9-8deb-a25669f81d54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '027b7ea48e734a35a4ad2efb2cca7802'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:17.507183 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-48154bb5-5075-43a9-8deb-a25669f81d54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '027b7ea48e734a35a4ad2efb2cca7802'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:17.572720 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-48154bb5-5075-43a9-8deb-a25669f81d54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '027b7ea48e734a35a4ad2efb2cca7802'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:17.574882 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-48154bb5-5075-43a9-8deb-a25669f81d54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '027b7ea48e734a35a4ad2efb2cca7802'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:17.642740 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 887/1792] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:30:16 2022] DELETE /identity/v3/users/027b7ea48e734a35a4ad2efb2cca7802 => generated 0 bytes in 760 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:30:17.645384 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48e3568-f841-48d8-b72c-7772b5a704b7 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:17.646163 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48e3568-f841-48d8-b72c-7772b5a704b7 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:17.646335 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48e3568-f841-48d8-b72c-7772b5a704b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:17.704816 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-c48e3568-f841-48d8-b72c-7772b5a704b7 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:30:17.709221 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-c48e3568-f841-48d8-b72c-7772b5a704b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:17.832088 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48154bb5-5075-43a9-8deb-a25669f81d54 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:17.834438 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-48154bb5-5075-43a9-8deb-a25669f81d54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:18.151798 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 906/1793] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:30:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 508 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:30:18.162235 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48154bb5-5075-43a9-8deb-a25669f81d54 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:18.262156 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12d3bd7-d2df-4588-8b6e-d9dab0208712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:18.267679 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d3bd7-d2df-4588-8b6e-d9dab0208712 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:18.271697 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d3bd7-d2df-4588-8b6e-d9dab0208712 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:18.276029 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d3bd7-d2df-4588-8b6e-d9dab0208712 admin admin] PATH_INFO: `/v3/projects/fb6b8f37acca4f6b829b309337a3f0e3` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:18.294733 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12d3bd7-d2df-4588-8b6e-d9dab0208712 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb6b8f37acca4f6b829b309337a3f0e3)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:18.297860 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48e3568-f841-48d8-b72c-7772b5a704b7 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:18.299877 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-c48e3568-f841-48d8-b72c-7772b5a704b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:18.303815 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12d3bd7-d2df-4588-8b6e-d9dab0208712 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:18.497516 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:18.612425 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48e3568-f841-48d8-b72c-7772b5a704b7 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:18.627564 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0425ae67-aba3-4169-80e9-6016768580a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:18.628602 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0425ae67-aba3-4169-80e9-6016768580a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:18.629073 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0425ae67-aba3-4169-80e9-6016768580a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:18.629543 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0425ae67-aba3-4169-80e9-6016768580a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:18.720399 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0425ae67-aba3-4169-80e9-6016768580a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:18.730838 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0425ae67-aba3-4169-80e9-6016768580a9 service neutron] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:18.774031 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 907/1794] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:30:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:30:18.775610 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584cbb6b-6d58-4479-a89f-5058ac1fc174 None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:18.776020 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584cbb6b-6d58-4479-a89f-5058ac1fc174 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:18.776341 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584cbb6b-6d58-4479-a89f-5058ac1fc174 None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:18.793806 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 908/1795] 10.222.0.79 () {54 vars in 921 bytes} [Wed Aug 31 12:30:18 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:30:18.840650 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-a12d3bd7-d2df-4588-8b6e-d9dab0208712 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb6b8f37acca4f6b829b309337a3f0e3', 'request_id': 'req-a12d3bd7-d2df-4588-8b6e-d9dab0208712'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:18.888685 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-a12d3bd7-d2df-4588-8b6e-d9dab0208712 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb6b8f37acca4f6b829b309337a3f0e3', 'request_id': 'req-a12d3bd7-d2df-4588-8b6e-d9dab0208712'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:18.925450 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-a12d3bd7-d2df-4588-8b6e-d9dab0208712 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb6b8f37acca4f6b829b309337a3f0e3', 'request_id': 'req-a12d3bd7-d2df-4588-8b6e-d9dab0208712'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:19.001731 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-a12d3bd7-d2df-4588-8b6e-d9dab0208712 admin admin] The token cache is being invalidate because project fb6b8f37acca4f6b829b309337a3f0e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:30:19.004683 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-a12d3bd7-d2df-4588-8b6e-d9dab0208712 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:19.009845 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-a12d3bd7-d2df-4588-8b6e-d9dab0208712 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:19.025011 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f7c81-a6dd-454e-8398-30fb0ec9be54 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:19.025716 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f7c81-a6dd-454e-8398-30fb0ec9be54 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:19.027579 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f7c81-a6dd-454e-8398-30fb0ec9be54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:19.037604 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 888/1796] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:30:17 2022] DELETE /identity/v3/projects/fb6b8f37acca4f6b829b309337a3f0e3 => generated 0 bytes in 1197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:30:19.064073 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfeda88-6ee2-4efb-ac44-ecb3c43816a5 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:19.065427 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfeda88-6ee2-4efb-ac44-ecb3c43816a5 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:19.072823 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfeda88-6ee2-4efb-ac44-ecb3c43816a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:19.105213 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-a26f7c81-a6dd-454e-8398-30fb0ec9be54 None None] MFA Rules not processed for user `62401c8e1457450590f4147e0665265a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:30:19.107462 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-a26f7c81-a6dd-454e-8398-30fb0ec9be54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:19.154156 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-5dfeda88-6ee2-4efb-ac44-ecb3c43816a5 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:30:19.157961 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-5dfeda88-6ee2-4efb-ac44-ecb3c43816a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:19.246518 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:19.290611 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 909/1797] 10.222.0.79 () {58 vars in 1018 bytes} [Wed Aug 31 12:30:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:30:19.347579 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 889/1798] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:30:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:30:19.356640 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b709b4ad-41f2-4a09-9462-1f3728c7e2b4 None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:19.356911 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9369d6a-7352-42d5-ab38-1d3f0a648a1f None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:19.357074 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9369d6a-7352-42d5-ab38-1d3f0a648a1f None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:19.357364 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9369d6a-7352-42d5-ab38-1d3f0a648a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:19.358416 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b709b4ad-41f2-4a09-9462-1f3728c7e2b4 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:19.359398 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b709b4ad-41f2-4a09-9462-1f3728c7e2b4 None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:19.363100 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 910/1799] 10.222.0.79 () {54 vars in 921 bytes} [Wed Aug 31 12:30:19 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:30:19.406661 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b709b4ad-41f2-4a09-9462-1f3728c7e2b4 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:19.410642 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-b709b4ad-41f2-4a09-9462-1f3728c7e2b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:19.439089 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-a9369d6a-7352-42d5-ab38-1d3f0a648a1f None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:30:19.440455 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-a9369d6a-7352-42d5-ab38-1d3f0a648a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:19.473040 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 890/1800] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:30:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:30:19.477972 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e7b332-7184-41b6-927b-fbeb35486ee1 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:19.478779 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e7b332-7184-41b6-927b-fbeb35486ee1 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:19.479306 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e7b332-7184-41b6-927b-fbeb35486ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:19.504582 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b709b4ad-41f2-4a09-9462-1f3728c7e2b4 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:19.530009 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3d9691-54ed-4803-b574-71877005431d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:19.536568 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d9691-54ed-4803-b574-71877005431d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:19.538093 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d9691-54ed-4803-b574-71877005431d admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:19.540571 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d9691-54ed-4803-b574-71877005431d admin admin] PATH_INFO: `/v3/users/063515e88123443788531e741d950ea2` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:19.542578 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-80e7b332-7184-41b6-927b-fbeb35486ee1 None None] MFA Rules not processed for user `62401c8e1457450590f4147e0665265a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:30:19.544699 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-80e7b332-7184-41b6-927b-fbeb35486ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:19.550826 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3d9691-54ed-4803-b574-71877005431d admin admin] RBAC: Authorizing `identity:delete_user(user_id=063515e88123443788531e741d950ea2)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:19.555768 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3d9691-54ed-4803-b574-71877005431d admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:19.577234 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 891/1801] 10.222.0.79 () {58 vars in 1018 bytes} [Wed Aug 31 12:30:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:30:19.578578 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e7b332-7184-41b6-927b-fbeb35486ee1 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:19.600428 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e7b332-7184-41b6-927b-fbeb35486ee1 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:19.608589 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed360b1-e484-434a-af07-84fd34e86835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:19.609200 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed360b1-e484-434a-af07-84fd34e86835 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:19.609555 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed360b1-e484-434a-af07-84fd34e86835 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:19.611359 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed360b1-e484-434a-af07-84fd34e86835 admin admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:19.612518 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed360b1-e484-434a-af07-84fd34e86835 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:30:19.613067 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed360b1-e484-434a-af07-84fd34e86835 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:19.616305 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed360b1-e484-434a-af07-84fd34e86835 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:19.648141 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 892/1802] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 12:30:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:30:19.654604 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed360b1-e484-434a-af07-84fd34e86835 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:19.721941 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed360b1-e484-434a-af07-84fd34e86835 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:19.734026 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc32da-4c08-48f9-b000-0b30844446b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:19.736328 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc32da-4c08-48f9-b000-0b30844446b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:19.736618 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc32da-4c08-48f9-b000-0b30844446b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:19.736894 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc32da-4c08-48f9-b000-0b30844446b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:19.740006 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefc32da-4c08-48f9-b000-0b30844446b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:19.744444 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefc32da-4c08-48f9-b000-0b30844446b1 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:19.773849 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-5f3d9691-54ed-4803-b574-71877005431d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '063515e88123443788531e741d950ea2'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:19.821359 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-5f3d9691-54ed-4803-b574-71877005431d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '063515e88123443788531e741d950ea2'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:19.844812 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 893/1803] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:30:19 2022] POST /identity/v3/projects => generated 409 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:30:19.850510 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc32da-4c08-48f9-b000-0b30844446b1 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:19.853155 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-5f3d9691-54ed-4803-b574-71877005431d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '063515e88123443788531e741d950ea2'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:19.855387 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-5f3d9691-54ed-4803-b574-71877005431d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '063515e88123443788531e741d950ea2'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:19.878761 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-5f3d9691-54ed-4803-b574-71877005431d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '063515e88123443788531e741d950ea2'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:19.899088 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 911/1804] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:30:19 2022] DELETE /identity/v3/users/063515e88123443788531e741d950ea2 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:30:19.911996 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2418f-f3db-4bbd-8dd1-b75bcc2565ff None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:19.912568 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2418f-f3db-4bbd-8dd1-b75bcc2565ff None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:19.913120 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2418f-f3db-4bbd-8dd1-b75bcc2565ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:20.011844 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-2ad2418f-f3db-4bbd-8dd1-b75bcc2565ff None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:30:20.014932 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-2ad2418f-f3db-4bbd-8dd1-b75bcc2565ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:20.143378 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:20.153795 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc32da-4c08-48f9-b000-0b30844446b1 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:20.300110 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 912/1805] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:30:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:30:20.387427 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad2418f-f3db-4bbd-8dd1-b75bcc2565ff None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:20.389996 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-2ad2418f-f3db-4bbd-8dd1-b75bcc2565ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:20.426818 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb98be-4f39-4cd6-9048-d1bbaf46f61e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:20.429606 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb98be-4f39-4cd6-9048-d1bbaf46f61e admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:20.430469 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb98be-4f39-4cd6-9048-d1bbaf46f61e admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:20.433259 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb98be-4f39-4cd6-9048-d1bbaf46f61e admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:20.436409 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcb98be-4f39-4cd6-9048-d1bbaf46f61e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:20.442126 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcb98be-4f39-4cd6-9048-d1bbaf46f61e admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:20.522351 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 894/1806] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:30:19 2022] POST /identity/v3/users => generated 305 bytes in 672 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:30:20.524174 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb98be-4f39-4cd6-9048-d1bbaf46f61e admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:20.534741 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-afcb98be-4f39-4cd6-9048-d1bbaf46f61e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:20.657689 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad2418f-f3db-4bbd-8dd1-b75bcc2565ff None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:20.696004 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:20.705137 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681be4de-0615-4233-b2ae-f6c312e8c6c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62401c8e1457450590f4147e0665265a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:20.710071 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681be4de-0615-4233-b2ae-f6c312e8c6c8 service nova] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:20.710071 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681be4de-0615-4233-b2ae-f6c312e8c6c8 service nova] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:20.710071 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681be4de-0615-4233-b2ae-f6c312e8c6c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:20.728449 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-681be4de-0615-4233-b2ae-f6c312e8c6c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:20.750522 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681be4de-0615-4233-b2ae-f6c312e8c6c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:20.753493 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681be4de-0615-4233-b2ae-f6c312e8c6c8 service nova] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:20.802320 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 913/1807] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:30:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:30:20.802320 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681be4de-0615-4233-b2ae-f6c312e8c6c8 service nova] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:20.803589 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-681be4de-0615-4233-b2ae-f6c312e8c6c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:20.825776 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681be4de-0615-4233-b2ae-f6c312e8c6c8 service nova] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:20.832763 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e4e3e-b28c-4cb2-b750-7feebf8000ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:20.833918 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e4e3e-b28c-4cb2-b750-7feebf8000ba admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:20.834381 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e4e3e-b28c-4cb2-b750-7feebf8000ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:20.834758 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e4e3e-b28c-4cb2-b750-7feebf8000ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:20.835594 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750e4e3e-b28c-4cb2-b750-7feebf8000ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:20.836407 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb98be-4f39-4cd6-9048-d1bbaf46f61e admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:20.837714 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750e4e3e-b28c-4cb2-b750-7feebf8000ba admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:20.864655 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 914/1808] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:30:20 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:30:20.865030 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5685b19b-9d87-4a49-9677-54e3ee3bf8b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:20.866263 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5685b19b-9d87-4a49-9677-54e3ee3bf8b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:20.866753 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5685b19b-9d87-4a49-9677-54e3ee3bf8b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:20.867291 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5685b19b-9d87-4a49-9677-54e3ee3bf8b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:20.879185 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e4e3e-b28c-4cb2-b750-7feebf8000ba admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:20.917339 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e4e3e-b28c-4cb2-b750-7feebf8000ba admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:20.928515 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5685b19b-9d87-4a49-9677-54e3ee3bf8b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:20.929255 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ff7038-f960-42a2-9f4e-91ac9ee60f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:20.932331 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff7038-f960-42a2-9f4e-91ac9ee60f0d admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:20.932891 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff7038-f960-42a2-9f4e-91ac9ee60f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:20.933372 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff7038-f960-42a2-9f4e-91ac9ee60f0d admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:20.937450 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ff7038-f960-42a2-9f4e-91ac9ee60f0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:20.944714 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5685b19b-9d87-4a49-9677-54e3ee3bf8b0 service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:20.953532 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ff7038-f960-42a2-9f4e-91ac9ee60f0d admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:20.993455 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 915/1809] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:30:20 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:30:20.997969 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ff7038-f960-42a2-9f4e-91ac9ee60f0d admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:21.025992 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 895/1810] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:30:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:30:21.040606 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ff7038-f960-42a2-9f4e-91ac9ee60f0d admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:21.064408 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74b8c58-ddd8-413d-87bb-5b2b7e7da93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:21.065823 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b8c58-ddd8-413d-87bb-5b2b7e7da93d admin admin] REQUEST_METHOD: `PUT` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:21.067104 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b8c58-ddd8-413d-87bb-5b2b7e7da93d admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:21.071061 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b8c58-ddd8-413d-87bb-5b2b7e7da93d admin admin] PATH_INFO: `/v3/projects/dafbcb1b8fb04dc1b50d5cd0cdaeeb99/users/f74476d3d11e48088c3de1d06b9ef682/roles/b5cfd7a855a448359e9017f51d32b6fc` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:21.122547 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74b8c58-ddd8-413d-87bb-5b2b7e7da93d admin admin] RBAC: Authorizing `identity:create_grant(project_id=dafbcb1b8fb04dc1b50d5cd0cdaeeb99, user_id=f74476d3d11e48088c3de1d06b9ef682, role_id=b5cfd7a855a448359e9017f51d32b6fc)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:21.125415 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74b8c58-ddd8-413d-87bb-5b2b7e7da93d admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:21.158182 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 916/1811] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:30:20 2022] PUT /identity/v3/projects/dafbcb1b8fb04dc1b50d5cd0cdaeeb99/users/f74476d3d11e48088c3de1d06b9ef682/roles/b5cfd7a855a448359e9017f51d32b6fc => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:30:21.172737 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c06f43a-3b6d-4317-876e-24e108074107 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:21.173171 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c06f43a-3b6d-4317-876e-24e108074107 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:21.173592 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c06f43a-3b6d-4317-876e-24e108074107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:21.233985 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74b8c58-ddd8-413d-87bb-5b2b7e7da93d admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:21.369022 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-5c06f43a-3b6d-4317-876e-24e108074107 None None] MFA Rules not processed for user `f74476d3d11e48088c3de1d06b9ef682`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:30:21.375926 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-5c06f43a-3b6d-4317-876e-24e108074107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:21.470005 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74b8c58-ddd8-413d-87bb-5b2b7e7da93d admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:21.501928 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a19017-6c8d-497e-960a-af86605fcf89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62401c8e1457450590f4147e0665265a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:21.503334 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a19017-6c8d-497e-960a-af86605fcf89 service nova] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:21.504195 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a19017-6c8d-497e-960a-af86605fcf89 service nova] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:21.504517 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a19017-6c8d-497e-960a-af86605fcf89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:21.507647 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-d5a19017-6c8d-497e-960a-af86605fcf89 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:21.526464 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a19017-6c8d-497e-960a-af86605fcf89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:21.529954 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a19017-6c8d-497e-960a-af86605fcf89 service nova] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:21.546208 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 917/1812] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:30:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:30:21.863141 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a19017-6c8d-497e-960a-af86605fcf89 service nova] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:21.867052 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 896/1813] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:30:21 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 696 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:30:21.873648 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:22.152531 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a19017-6c8d-497e-960a-af86605fcf89 service nova] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:22.172482 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6941017d-e760-44c6-9991-4f25112c15e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:22.177576 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6941017d-e760-44c6-9991-4f25112c15e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:22.178811 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6941017d-e760-44c6-9991-4f25112c15e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:22.180629 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6941017d-e760-44c6-9991-4f25112c15e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:22.183872 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6941017d-e760-44c6-9991-4f25112c15e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:22.191280 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6941017d-e760-44c6-9991-4f25112c15e4 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:22.337385 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c06f43a-3b6d-4317-876e-24e108074107 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:22.344765 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 918/1814] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:30:21 2022] POST /identity/v3/projects => generated 409 bytes in 482 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:30:22.399913 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c06f43a-3b6d-4317-876e-24e108074107 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:22.683017 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe1e20d-091e-4fcf-a070-74d79e0a35f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:22.684372 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe1e20d-091e-4fcf-a070-74d79e0a35f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:22.684879 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe1e20d-091e-4fcf-a070-74d79e0a35f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:22.685365 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe1e20d-091e-4fcf-a070-74d79e0a35f0 admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:22.686555 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe1e20d-091e-4fcf-a070-74d79e0a35f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:22.690541 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe1e20d-091e-4fcf-a070-74d79e0a35f0 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:22.752281 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 897/1815] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:30:22 2022] POST /identity/v3/users => generated 311 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:30:22.763371 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6941017d-e760-44c6-9991-4f25112c15e4 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:22.805776 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6941017d-e760-44c6-9991-4f25112c15e4 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:22.824563 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4e0209-6549-44d2-8e57-119f99fd5093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:22.825325 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e0209-6549-44d2-8e57-119f99fd5093 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:22.825659 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e0209-6549-44d2-8e57-119f99fd5093 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:22.825872 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e0209-6549-44d2-8e57-119f99fd5093 admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:22.826617 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4e0209-6549-44d2-8e57-119f99fd5093 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:22.828894 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4e0209-6549-44d2-8e57-119f99fd5093 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:22.846280 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 919/1816] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:30:22 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:30:22.854583 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe1e20d-091e-4fcf-a070-74d79e0a35f0 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:22.882517 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe1e20d-091e-4fcf-a070-74d79e0a35f0 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:22.889725 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016c8c74-7bc6-46bb-bec0-0ae07cb5818e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:22.890770 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c8c74-7bc6-46bb-bec0-0ae07cb5818e admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:22.891674 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c8c74-7bc6-46bb-bec0-0ae07cb5818e admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:22.892411 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c8c74-7bc6-46bb-bec0-0ae07cb5818e admin admin] PATH_INFO: `/v3/projects/21bc323d7c4e4a41aba9ffce0209be81/users/827595d8e69b427c8c7d6336b1bb1a38/roles/a332ef951db949b0bad7019fbd28a1b9` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:22.928589 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016c8c74-7bc6-46bb-bec0-0ae07cb5818e admin admin] RBAC: Authorizing `identity:create_grant(project_id=21bc323d7c4e4a41aba9ffce0209be81, user_id=827595d8e69b427c8c7d6336b1bb1a38, role_id=a332ef951db949b0bad7019fbd28a1b9)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:22.933324 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016c8c74-7bc6-46bb-bec0-0ae07cb5818e admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:22.950558 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4e0209-6549-44d2-8e57-119f99fd5093 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:22.954691 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-5a4e0209-6549-44d2-8e57-119f99fd5093 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:22.973957 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 898/1817] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:30:22 2022] PUT /identity/v3/projects/21bc323d7c4e4a41aba9ffce0209be81/users/827595d8e69b427c8c7d6336b1bb1a38/roles/a332ef951db949b0bad7019fbd28a1b9 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:30:22.982126 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016c8c74-7bc6-46bb-bec0-0ae07cb5818e admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:23.015143 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4e0209-6549-44d2-8e57-119f99fd5093 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:23.141913 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:23.247973 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016c8c74-7bc6-46bb-bec0-0ae07cb5818e admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:23.260178 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f6ec32-3128-418e-b5c0-5ffe8854f802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:23.262998 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f6ec32-3128-418e-b5c0-5ffe8854f802 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:23.264101 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f6ec32-3128-418e-b5c0-5ffe8854f802 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:23.265010 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f6ec32-3128-418e-b5c0-5ffe8854f802 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:23.267420 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f6ec32-3128-418e-b5c0-5ffe8854f802 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:23.278677 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f6ec32-3128-418e-b5c0-5ffe8854f802 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:23.310102 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eb1bfe-4b40-4fee-9f93-d9e5d503b696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:23.311083 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eb1bfe-4b40-4fee-9f93-d9e5d503b696 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:23.312007 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eb1bfe-4b40-4fee-9f93-d9e5d503b696 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:23.312007 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eb1bfe-4b40-4fee-9f93-d9e5d503b696 admin admin] PATH_INFO: `/v3/projects/6aeb25ef58f64bd1aa98e5ea22d5df48` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:23.313752 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eb1bfe-4b40-4fee-9f93-d9e5d503b696 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6aeb25ef58f64bd1aa98e5ea22d5df48)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:23.316553 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eb1bfe-4b40-4fee-9f93-d9e5d503b696 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:23.327250 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 899/1818] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:30:22 2022] GET /identity/v3/roles => generated 1420 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:30:23.333227 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f6ec32-3128-418e-b5c0-5ffe8854f802 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:23.361834 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f6ec32-3128-418e-b5c0-5ffe8854f802 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:23.389411 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cee575-ed10-44f6-baad-a5179831455a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:23.390616 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cee575-ed10-44f6-baad-a5179831455a admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:23.391268 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cee575-ed10-44f6-baad-a5179831455a admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:23.391775 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cee575-ed10-44f6-baad-a5179831455a admin admin] PATH_INFO: `/v3/projects/21bc323d7c4e4a41aba9ffce0209be81/users/827595d8e69b427c8c7d6336b1bb1a38/roles/a332ef951db949b0bad7019fbd28a1b9` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:23.397308 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cee575-ed10-44f6-baad-a5179831455a admin admin] RBAC: Authorizing `identity:create_grant(project_id=21bc323d7c4e4a41aba9ffce0209be81, user_id=827595d8e69b427c8c7d6336b1bb1a38, role_id=a332ef951db949b0bad7019fbd28a1b9)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:23.404573 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cee575-ed10-44f6-baad-a5179831455a admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:23.453865 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 900/1819] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:30:23 2022] PUT /identity/v3/projects/21bc323d7c4e4a41aba9ffce0209be81/users/827595d8e69b427c8c7d6336b1bb1a38/roles/a332ef951db949b0bad7019fbd28a1b9 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:30:23.471528 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-62eb1bfe-4b40-4fee-9f93-d9e5d503b696 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6aeb25ef58f64bd1aa98e5ea22d5df48', 'request_id': 'req-62eb1bfe-4b40-4fee-9f93-d9e5d503b696'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:23.474483 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e428a-60ef-4bff-b98f-a2a87df0c785 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:23.474483 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e428a-60ef-4bff-b98f-a2a87df0c785 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:23.474483 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e428a-60ef-4bff-b98f-a2a87df0c785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:23.501642 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-62eb1bfe-4b40-4fee-9f93-d9e5d503b696 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6aeb25ef58f64bd1aa98e5ea22d5df48', 'request_id': 'req-62eb1bfe-4b40-4fee-9f93-d9e5d503b696'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:23.523182 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-62eb1bfe-4b40-4fee-9f93-d9e5d503b696 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6aeb25ef58f64bd1aa98e5ea22d5df48', 'request_id': 'req-62eb1bfe-4b40-4fee-9f93-d9e5d503b696'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:23.578716 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-62eb1bfe-4b40-4fee-9f93-d9e5d503b696 admin admin] The token cache is being invalidate because project 6aeb25ef58f64bd1aa98e5ea22d5df48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:30:23.578832 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-62eb1bfe-4b40-4fee-9f93-d9e5d503b696 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:23.605964 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-62eb1bfe-4b40-4fee-9f93-d9e5d503b696 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:23.609393 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 920/1820] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:30:22 2022] DELETE /identity/v3/projects/6aeb25ef58f64bd1aa98e5ea22d5df48 => generated 0 bytes in 661 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:30:23.616339 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eb1bfe-4b40-4fee-9f93-d9e5d503b696 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:23.617954 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-401e428a-60ef-4bff-b98f-a2a87df0c785 None None] MFA Rules not processed for user `827595d8e69b427c8c7d6336b1bb1a38`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:30:23.619356 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-401e428a-60ef-4bff-b98f-a2a87df0c785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:23.624254 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-62eb1bfe-4b40-4fee-9f93-d9e5d503b696 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:23.659964 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:23.842027 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eb1bfe-4b40-4fee-9f93-d9e5d503b696 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:23.865355 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a9b6c9-ccd2-4633-b5c1-d8cbc5a1efec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:23.866303 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a9b6c9-ccd2-4633-b5c1-d8cbc5a1efec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:23.867306 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a9b6c9-ccd2-4633-b5c1-d8cbc5a1efec admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:23.875392 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a9b6c9-ccd2-4633-b5c1-d8cbc5a1efec admin admin] PATH_INFO: `/v3/users/2c7ad9de333c40a8b583afb4f0b5fef4` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:23.878988 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a9b6c9-ccd2-4633-b5c1-d8cbc5a1efec admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c7ad9de333c40a8b583afb4f0b5fef4)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:23.881478 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a9b6c9-ccd2-4633-b5c1-d8cbc5a1efec admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:24.015221 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-d2a9b6c9-ccd2-4633-b5c1-d8cbc5a1efec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c7ad9de333c40a8b583afb4f0b5fef4'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:24.057760 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 901/1821] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:30:23 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 581 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:30:24.060482 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-d2a9b6c9-ccd2-4633-b5c1-d8cbc5a1efec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c7ad9de333c40a8b583afb4f0b5fef4'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:24.072031 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-d2a9b6c9-ccd2-4633-b5c1-d8cbc5a1efec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c7ad9de333c40a8b583afb4f0b5fef4'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:24.073507 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-d2a9b6c9-ccd2-4633-b5c1-d8cbc5a1efec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c7ad9de333c40a8b583afb4f0b5fef4'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:24.086343 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401e428a-60ef-4bff-b98f-a2a87df0c785 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:24.088632 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-401e428a-60ef-4bff-b98f-a2a87df0c785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:24.116181 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-d2a9b6c9-ccd2-4633-b5c1-d8cbc5a1efec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c7ad9de333c40a8b583afb4f0b5fef4'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:24.139179 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 921/1822] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:30:23 2022] DELETE /identity/v3/users/2c7ad9de333c40a8b583afb4f0b5fef4 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:30:24.315069 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401e428a-60ef-4bff-b98f-a2a87df0c785 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:24.462808 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb866fd5-9585-4631-889c-770b75dedd0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e79503178ac54e62ba385467d5617ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:24.464065 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb866fd5-9585-4631-889c-770b75dedd0a service cinder] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:24.464065 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb866fd5-9585-4631-889c-770b75dedd0a service cinder] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:24.465698 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb866fd5-9585-4631-889c-770b75dedd0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:24.472834 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-eb866fd5-9585-4631-889c-770b75dedd0a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:24.488660 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:24.569565 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb866fd5-9585-4631-889c-770b75dedd0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:24.571160 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb866fd5-9585-4631-889c-770b75dedd0a service cinder] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:24.597370 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 902/1823] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:30:24 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:30:24.929694 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a9b6c9-ccd2-4633-b5c1-d8cbc5a1efec admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:24.931608 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-d2a9b6c9-ccd2-4633-b5c1-d8cbc5a1efec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:24.944749 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a9b6c9-ccd2-4633-b5c1-d8cbc5a1efec admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:24.950650 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c922bbf-1d70-43ea-a281-63ee74036aef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e79503178ac54e62ba385467d5617ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:24.951449 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c922bbf-1d70-43ea-a281-63ee74036aef service cinder] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:24.951972 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c922bbf-1d70-43ea-a281-63ee74036aef service cinder] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:24.952445 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c922bbf-1d70-43ea-a281-63ee74036aef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:24.954804 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-0c922bbf-1d70-43ea-a281-63ee74036aef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:25.036496 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb866fd5-9585-4631-889c-770b75dedd0a service cinder] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:25.038022 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-eb866fd5-9585-4631-889c-770b75dedd0a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:25.055788 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c922bbf-1d70-43ea-a281-63ee74036aef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:25.057475 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c922bbf-1d70-43ea-a281-63ee74036aef service cinder] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:25.070715 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 922/1824] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:30:24 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:30:25.200401 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb866fd5-9585-4631-889c-770b75dedd0a service cinder] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:25.209528 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80cf187-3a1d-489e-8464-35d038e15ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:25.210437 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80cf187-3a1d-489e-8464-35d038e15ba3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:25.211278 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80cf187-3a1d-489e-8464-35d038e15ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:25.211774 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80cf187-3a1d-489e-8464-35d038e15ba3 admin admin] PATH_INFO: `/v3/projects/0a46eb3e938c46fb97931af0ba5a465d` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:25.213302 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80cf187-3a1d-489e-8464-35d038e15ba3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a46eb3e938c46fb97931af0ba5a465d)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:25.215999 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80cf187-3a1d-489e-8464-35d038e15ba3 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:25.298049 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-b80cf187-3a1d-489e-8464-35d038e15ba3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a46eb3e938c46fb97931af0ba5a465d', 'request_id': 'req-b80cf187-3a1d-489e-8464-35d038e15ba3'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:25.303940 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c922bbf-1d70-43ea-a281-63ee74036aef service cinder] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:25.305564 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-0c922bbf-1d70-43ea-a281-63ee74036aef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:25.317657 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-b80cf187-3a1d-489e-8464-35d038e15ba3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a46eb3e938c46fb97931af0ba5a465d', 'request_id': 'req-b80cf187-3a1d-489e-8464-35d038e15ba3'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:25.332606 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-b80cf187-3a1d-489e-8464-35d038e15ba3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a46eb3e938c46fb97931af0ba5a465d', 'request_id': 'req-b80cf187-3a1d-489e-8464-35d038e15ba3'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:25.352469 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-b80cf187-3a1d-489e-8464-35d038e15ba3 admin admin] The token cache is being invalidate because project 0a46eb3e938c46fb97931af0ba5a465d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:30:25.352669 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c922bbf-1d70-43ea-a281-63ee74036aef service cinder] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:25.352955 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-b80cf187-3a1d-489e-8464-35d038e15ba3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:25.353988 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-b80cf187-3a1d-489e-8464-35d038e15ba3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:25.362989 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 903/1825] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:30:25 2022] DELETE /identity/v3/projects/0a46eb3e938c46fb97931af0ba5a465d => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:30:25.365228 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80cf187-3a1d-489e-8464-35d038e15ba3 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:25.375068 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-b80cf187-3a1d-489e-8464-35d038e15ba3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:25.400814 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:25.488574 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:25.493997 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00baf4e-9137-4f3b-aa02-723ca0e0071d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:25.496932 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00baf4e-9137-4f3b-aa02-723ca0e0071d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:25.497261 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00baf4e-9137-4f3b-aa02-723ca0e0071d admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:25.498453 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00baf4e-9137-4f3b-aa02-723ca0e0071d admin admin] PATH_INFO: `/v3/projects/cccd742c0cf549e3bfdeb569643817b9` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:25.500231 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00baf4e-9137-4f3b-aa02-723ca0e0071d admin admin] RBAC: Authorizing `identity:delete_project(project_id=cccd742c0cf549e3bfdeb569643817b9)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:25.502317 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00baf4e-9137-4f3b-aa02-723ca0e0071d admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:25.528476 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80cf187-3a1d-489e-8464-35d038e15ba3 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:25.535104 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37692ee9-f51e-4367-9606-9bfb5dfdf866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:25.535802 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37692ee9-f51e-4367-9606-9bfb5dfdf866 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:25.536079 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37692ee9-f51e-4367-9606-9bfb5dfdf866 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:25.536365 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37692ee9-f51e-4367-9606-9bfb5dfdf866 admin admin] PATH_INFO: `/v3/users/a23b9dfd2c8c4958985eaab428255ace` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:25.537758 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37692ee9-f51e-4367-9606-9bfb5dfdf866 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a23b9dfd2c8c4958985eaab428255ace)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:25.540056 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37692ee9-f51e-4367-9606-9bfb5dfdf866 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:25.595851 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-e00baf4e-9137-4f3b-aa02-723ca0e0071d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cccd742c0cf549e3bfdeb569643817b9', 'request_id': 'req-e00baf4e-9137-4f3b-aa02-723ca0e0071d'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:25.617513 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-e00baf4e-9137-4f3b-aa02-723ca0e0071d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cccd742c0cf549e3bfdeb569643817b9', 'request_id': 'req-e00baf4e-9137-4f3b-aa02-723ca0e0071d'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:25.628060 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-e00baf4e-9137-4f3b-aa02-723ca0e0071d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cccd742c0cf549e3bfdeb569643817b9', 'request_id': 'req-e00baf4e-9137-4f3b-aa02-723ca0e0071d'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:25.645447 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-37692ee9-f51e-4367-9606-9bfb5dfdf866 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a23b9dfd2c8c4958985eaab428255ace'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:25.646361 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-e00baf4e-9137-4f3b-aa02-723ca0e0071d admin admin] The token cache is being invalidate because project cccd742c0cf549e3bfdeb569643817b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:30:25.646661 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-e00baf4e-9137-4f3b-aa02-723ca0e0071d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:25.648458 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-e00baf4e-9137-4f3b-aa02-723ca0e0071d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:25.654934 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 923/1826] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:30:25 2022] DELETE /identity/v3/projects/cccd742c0cf549e3bfdeb569643817b9 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:30:25.660939 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa08118-24ac-4d8d-a8ca-8c6824964adf None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:25.661754 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa08118-24ac-4d8d-a8ca-8c6824964adf None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:25.662398 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa08118-24ac-4d8d-a8ca-8c6824964adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:25.672482 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-37692ee9-f51e-4367-9606-9bfb5dfdf866 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a23b9dfd2c8c4958985eaab428255ace'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:25.673392 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-37692ee9-f51e-4367-9606-9bfb5dfdf866 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a23b9dfd2c8c4958985eaab428255ace'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:25.684928 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-37692ee9-f51e-4367-9606-9bfb5dfdf866 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a23b9dfd2c8c4958985eaab428255ace'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:25.688994 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-37692ee9-f51e-4367-9606-9bfb5dfdf866 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a23b9dfd2c8c4958985eaab428255ace'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:25.709010 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 904/1827] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:30:25 2022] DELETE /identity/v3/users/a23b9dfd2c8c4958985eaab428255ace => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:30:25.718084 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-afa08118-24ac-4d8d-a8ca-8c6824964adf None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:30:25.719366 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-afa08118-24ac-4d8d-a8ca-8c6824964adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:25.812575 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 924/1828] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:30:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:30:25.823063 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad51b80e-68cb-44ed-bee3-efd7ab6d1ee9 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:25.825429 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad51b80e-68cb-44ed-bee3-efd7ab6d1ee9 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:25.826426 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad51b80e-68cb-44ed-bee3-efd7ab6d1ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:25.875143 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-ad51b80e-68cb-44ed-bee3-efd7ab6d1ee9 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:30:25.878175 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-ad51b80e-68cb-44ed-bee3-efd7ab6d1ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:25.906288 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 905/1829] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:30:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:30:25.912311 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa08118-24ac-4d8d-a8ca-8c6824964adf None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:25.924107 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa08118-24ac-4d8d-a8ca-8c6824964adf None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:25.955673 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e326046-4a0c-4122-aceb-0ba1770ee19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:25.956336 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e326046-4a0c-4122-aceb-0ba1770ee19f admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:25.956623 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e326046-4a0c-4122-aceb-0ba1770ee19f admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:25.956898 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e326046-4a0c-4122-aceb-0ba1770ee19f admin admin] PATH_INFO: `/v3/domains` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:25.957790 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e326046-4a0c-4122-aceb-0ba1770ee19f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:30:25.958448 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e326046-4a0c-4122-aceb-0ba1770ee19f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:25.960659 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e326046-4a0c-4122-aceb-0ba1770ee19f admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:25.983054 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 925/1830] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 12:30:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:30:25.984343 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad51b80e-68cb-44ed-bee3-efd7ab6d1ee9 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:26.003794 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad51b80e-68cb-44ed-bee3-efd7ab6d1ee9 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:26.009301 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21f8abe-ccfa-4b4b-8c95-54341617708c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:26.009942 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f8abe-ccfa-4b4b-8c95-54341617708c admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:26.010224 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f8abe-ccfa-4b4b-8c95-54341617708c admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:26.010495 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f8abe-ccfa-4b4b-8c95-54341617708c admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:26.011225 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21f8abe-ccfa-4b4b-8c95-54341617708c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:26.013959 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21f8abe-ccfa-4b4b-8c95-54341617708c admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:26.056418 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 906/1831] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:30:25 2022] POST /identity/v3/projects => generated 381 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:30:26.061454 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e326046-4a0c-4122-aceb-0ba1770ee19f admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:26.076585 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e326046-4a0c-4122-aceb-0ba1770ee19f admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:26.168056 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:26.202764 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2bd601-0227-4c29-b2f5-0c3a00054814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:26.203948 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2bd601-0227-4c29-b2f5-0c3a00054814 admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:26.204537 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2bd601-0227-4c29-b2f5-0c3a00054814 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:26.205027 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2bd601-0227-4c29-b2f5-0c3a00054814 admin admin] PATH_INFO: `/v3/users` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:26.206449 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2bd601-0227-4c29-b2f5-0c3a00054814 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:26.210345 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2bd601-0227-4c29-b2f5-0c3a00054814 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:26.257254 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 926/1832] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:30:26 2022] POST /identity/v3/users => generated 291 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:30:26.264075 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21f8abe-ccfa-4b4b-8c95-54341617708c admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:26.280166 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21f8abe-ccfa-4b4b-8c95-54341617708c admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:26.286642 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8235ee5-accc-493c-8cf0-555c7af5bc26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:26.287794 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8235ee5-accc-493c-8cf0-555c7af5bc26 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:26.289361 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8235ee5-accc-493c-8cf0-555c7af5bc26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:26.289361 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8235ee5-accc-493c-8cf0-555c7af5bc26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:26.290072 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8235ee5-accc-493c-8cf0-555c7af5bc26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:26.293224 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8235ee5-accc-493c-8cf0-555c7af5bc26 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:26.307426 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 907/1833] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:30:26 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:30:26.314306 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2bd601-0227-4c29-b2f5-0c3a00054814 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:26.337144 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2bd601-0227-4c29-b2f5-0c3a00054814 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:26.376546 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9ccb26-f28b-4cc5-9f93-7d4eb645267d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:26.377609 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ccb26-f28b-4cc5-9f93-7d4eb645267d admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:26.377889 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ccb26-f28b-4cc5-9f93-7d4eb645267d admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:26.378132 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ccb26-f28b-4cc5-9f93-7d4eb645267d admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:26.378793 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9ccb26-f28b-4cc5-9f93-7d4eb645267d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:26.385183 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9ccb26-f28b-4cc5-9f93-7d4eb645267d admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:26.432981 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 927/1834] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:30:26 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:30:26.438030 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8235ee5-accc-493c-8cf0-555c7af5bc26 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:26.446909 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-f8235ee5-accc-493c-8cf0-555c7af5bc26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:26.452080 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9ccb26-f28b-4cc5-9f93-7d4eb645267d admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:26.479239 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9ccb26-f28b-4cc5-9f93-7d4eb645267d admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:26.483432 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8235ee5-accc-493c-8cf0-555c7af5bc26 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:26.492534 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbf7202-fd66-45c5-af3c-4e6267a5f447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:26.494161 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf7202-fd66-45c5-af3c-4e6267a5f447 admin admin] REQUEST_METHOD: `PUT` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:26.494947 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf7202-fd66-45c5-af3c-4e6267a5f447 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:26.496370 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf7202-fd66-45c5-af3c-4e6267a5f447 admin admin] PATH_INFO: `/v3/projects/6435669ad1aa4542a34c2a51690d736d/users/faf4050d6e7349019247d3dacddc0c9f/roles/b5cfd7a855a448359e9017f51d32b6fc` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:26.497208 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76cda88-d6bb-49b3-af57-568345870193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:26.498561 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76cda88-d6bb-49b3-af57-568345870193 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:26.511156 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76cda88-d6bb-49b3-af57-568345870193 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:26.512547 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76cda88-d6bb-49b3-af57-568345870193 admin admin] PATH_INFO: `/v3/projects/c69405d89b6543a8bd708f8c1e9812b9` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:26.515659 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76cda88-d6bb-49b3-af57-568345870193 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c69405d89b6543a8bd708f8c1e9812b9)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:26.518975 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76cda88-d6bb-49b3-af57-568345870193 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:26.527319 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbf7202-fd66-45c5-af3c-4e6267a5f447 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6435669ad1aa4542a34c2a51690d736d, user_id=faf4050d6e7349019247d3dacddc0c9f, role_id=b5cfd7a855a448359e9017f51d32b6fc)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:26.533181 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbf7202-fd66-45c5-af3c-4e6267a5f447 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:26.563849 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 928/1835] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:30:26 2022] PUT /identity/v3/projects/6435669ad1aa4542a34c2a51690d736d/users/faf4050d6e7349019247d3dacddc0c9f/roles/b5cfd7a855a448359e9017f51d32b6fc => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:30:26.577071 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34576d55-0290-44c9-95c9-096b885b8eb8 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:26.578251 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34576d55-0290-44c9-95c9-096b885b8eb8 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:26.581474 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34576d55-0290-44c9-95c9-096b885b8eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:26.600796 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-f76cda88-d6bb-49b3-af57-568345870193 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c69405d89b6543a8bd708f8c1e9812b9', 'request_id': 'req-f76cda88-d6bb-49b3-af57-568345870193'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:26.612159 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-f76cda88-d6bb-49b3-af57-568345870193 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c69405d89b6543a8bd708f8c1e9812b9', 'request_id': 'req-f76cda88-d6bb-49b3-af57-568345870193'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:26.628015 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-f76cda88-d6bb-49b3-af57-568345870193 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c69405d89b6543a8bd708f8c1e9812b9', 'request_id': 'req-f76cda88-d6bb-49b3-af57-568345870193'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:26.650447 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:26.659518 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-34576d55-0290-44c9-95c9-096b885b8eb8 None None] MFA Rules not processed for user `faf4050d6e7349019247d3dacddc0c9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:30:26.661745 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-34576d55-0290-44c9-95c9-096b885b8eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:26.665652 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-f76cda88-d6bb-49b3-af57-568345870193 admin admin] The token cache is being invalidate because project c69405d89b6543a8bd708f8c1e9812b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:30:26.666415 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-f76cda88-d6bb-49b3-af57-568345870193 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:26.671375 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-f76cda88-d6bb-49b3-af57-568345870193 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:26.679893 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 908/1836] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:30:26 2022] DELETE /identity/v3/projects/c69405d89b6543a8bd708f8c1e9812b9 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:30:26.682084 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf20694-c97e-415a-8898-f352eeedd4f3 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:26.684177 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf20694-c97e-415a-8898-f352eeedd4f3 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:26.685785 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf20694-c97e-415a-8898-f352eeedd4f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:26.719890 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-2bf20694-c97e-415a-8898-f352eeedd4f3 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:30:26.721470 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-2bf20694-c97e-415a-8898-f352eeedd4f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:26.834822 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 929/1837] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:30:26 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:30:26.839115 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 909/1838] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:30:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:30:26.845678 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34576d55-0290-44c9-95c9-096b885b8eb8 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:26.847420 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-34576d55-0290-44c9-95c9-096b885b8eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:26.849276 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b689e6-09a5-4f6e-9f2e-027e548ebd24 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:26.849760 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b689e6-09a5-4f6e-9f2e-027e548ebd24 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:26.850364 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b689e6-09a5-4f6e-9f2e-027e548ebd24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:26.866829 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34576d55-0290-44c9-95c9-096b885b8eb8 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:26.873484 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e8066b-a617-4534-9e48-7619484a1301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:26.874141 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e8066b-a617-4534-9e48-7619484a1301 admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:26.874423 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e8066b-a617-4534-9e48-7619484a1301 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:26.874808 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e8066b-a617-4534-9e48-7619484a1301 admin admin] PATH_INFO: `/v3/projects` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:26.875544 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e8066b-a617-4534-9e48-7619484a1301 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:26.877546 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e8066b-a617-4534-9e48-7619484a1301 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:26.902706 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-41b689e6-09a5-4f6e-9f2e-027e548ebd24 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:30:26.904176 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-41b689e6-09a5-4f6e-9f2e-027e548ebd24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:26.918417 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 910/1839] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:30:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:30:26.924971 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b689e6-09a5-4f6e-9f2e-027e548ebd24 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:26.940736 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b689e6-09a5-4f6e-9f2e-027e548ebd24 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:26.940995 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 930/1840] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:30:26 2022] POST /identity/v3/projects => generated 383 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:30:26.946289 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e8066b-a617-4534-9e48-7619484a1301 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:27.100342 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e8066b-a617-4534-9e48-7619484a1301 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:27.105026 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0967afdc-4ea8-4664-ae81-70bb7cc8c435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:27.105715 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0967afdc-4ea8-4664-ae81-70bb7cc8c435 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:27.106001 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0967afdc-4ea8-4664-ae81-70bb7cc8c435 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:27.106262 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0967afdc-4ea8-4664-ae81-70bb7cc8c435 admin admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:27.109796 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0967afdc-4ea8-4664-ae81-70bb7cc8c435 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:30:27.110073 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0967afdc-4ea8-4664-ae81-70bb7cc8c435 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:27.112433 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0967afdc-4ea8-4664-ae81-70bb7cc8c435 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:27.128594 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083d4409-f5ad-4d62-bdb3-8a6ca5ccf900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:27.131145 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 911/1841] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 12:30:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:30:27.131410 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d4409-f5ad-4d62-bdb3-8a6ca5ccf900 admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:27.131410 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d4409-f5ad-4d62-bdb3-8a6ca5ccf900 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:27.131410 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d4409-f5ad-4d62-bdb3-8a6ca5ccf900 admin admin] PATH_INFO: `/v3/users` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:27.132549 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083d4409-f5ad-4d62-bdb3-8a6ca5ccf900 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:27.137093 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0967afdc-4ea8-4664-ae81-70bb7cc8c435 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:27.141844 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083d4409-f5ad-4d62-bdb3-8a6ca5ccf900 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:27.165129 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:27.188937 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0967afdc-4ea8-4664-ae81-70bb7cc8c435 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:27.200592 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58351b1c-61a6-4fff-bd30-116a77fff303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:27.202027 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58351b1c-61a6-4fff-bd30-116a77fff303 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:27.202576 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58351b1c-61a6-4fff-bd30-116a77fff303 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:27.203091 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58351b1c-61a6-4fff-bd30-116a77fff303 admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:27.204543 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58351b1c-61a6-4fff-bd30-116a77fff303 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:27.208184 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58351b1c-61a6-4fff-bd30-116a77fff303 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:27.218144 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 931/1842] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:30:26 2022] POST /identity/v3/users => generated 298 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:30:27.220867 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083d4409-f5ad-4d62-bdb3-8a6ca5ccf900 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:27.269820 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083d4409-f5ad-4d62-bdb3-8a6ca5ccf900 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:27.289035 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf514ba-d62d-482b-a02f-593b1f8da863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:27.290593 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf514ba-d62d-482b-a02f-593b1f8da863 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:27.291430 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf514ba-d62d-482b-a02f-593b1f8da863 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:27.292161 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf514ba-d62d-482b-a02f-593b1f8da863 admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:27.294058 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf514ba-d62d-482b-a02f-593b1f8da863 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:27.298386 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf514ba-d62d-482b-a02f-593b1f8da863 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:27.305737 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 912/1843] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:30:27 2022] POST /identity/v3/projects => generated 387 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:30:27.312549 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58351b1c-61a6-4fff-bd30-116a77fff303 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:27.336759 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 932/1844] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:30:27 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:30:27.341923 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf514ba-d62d-482b-a02f-593b1f8da863 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:27.401772 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf514ba-d62d-482b-a02f-593b1f8da863 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:27.490135 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58351b1c-61a6-4fff-bd30-116a77fff303 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:27.505935 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8687f515-b6da-4dd2-99d4-24a35b9fd05e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:27.505935 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8687f515-b6da-4dd2-99d4-24a35b9fd05e admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:27.505935 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8687f515-b6da-4dd2-99d4-24a35b9fd05e admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:27.505935 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8687f515-b6da-4dd2-99d4-24a35b9fd05e admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:27.507359 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8687f515-b6da-4dd2-99d4-24a35b9fd05e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:27.511077 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8687f515-b6da-4dd2-99d4-24a35b9fd05e admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:27.538828 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:27.582922 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 913/1845] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:30:27 2022] POST /identity/v3/users => generated 294 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:30:27.592043 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8687f515-b6da-4dd2-99d4-24a35b9fd05e admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:27.625583 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8687f515-b6da-4dd2-99d4-24a35b9fd05e admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:27.633894 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3cd7b7-9857-406a-944f-805fba564203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:27.635193 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3cd7b7-9857-406a-944f-805fba564203 admin admin] REQUEST_METHOD: `PUT` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:27.636292 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3cd7b7-9857-406a-944f-805fba564203 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:27.636499 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3cd7b7-9857-406a-944f-805fba564203 admin admin] PATH_INFO: `/v3/projects/6a2aa4b15a774f6bbb2361ddf1970b6a/users/1d768c257b1b417185082fb5946ed455/roles/a332ef951db949b0bad7019fbd28a1b9` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:27.637507 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a1b5f-15bb-4e53-a583-f78a90dd1004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:27.638691 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a1b5f-15bb-4e53-a583-f78a90dd1004 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:27.639253 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a1b5f-15bb-4e53-a583-f78a90dd1004 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:27.639770 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a1b5f-15bb-4e53-a583-f78a90dd1004 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:27.641260 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3a1b5f-15bb-4e53-a583-f78a90dd1004 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:27.644298 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3a1b5f-15bb-4e53-a583-f78a90dd1004 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:27.673248 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3cd7b7-9857-406a-944f-805fba564203 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a2aa4b15a774f6bbb2361ddf1970b6a, user_id=1d768c257b1b417185082fb5946ed455, role_id=a332ef951db949b0bad7019fbd28a1b9)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:27.679831 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3cd7b7-9857-406a-944f-805fba564203 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:27.691674 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 914/1846] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:30:27 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:30:27.693875 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a1b5f-15bb-4e53-a583-f78a90dd1004 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:27.712636 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a1b5f-15bb-4e53-a583-f78a90dd1004 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:27.714703 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 933/1847] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:30:27 2022] PUT /identity/v3/projects/6a2aa4b15a774f6bbb2361ddf1970b6a/users/1d768c257b1b417185082fb5946ed455/roles/a332ef951db949b0bad7019fbd28a1b9 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:30:27.719249 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3cd7b7-9857-406a-944f-805fba564203 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:27.886016 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d236627-5ede-43e4-a672-9851f4d97143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:27.890479 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d236627-5ede-43e4-a672-9851f4d97143 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:27.890479 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d236627-5ede-43e4-a672-9851f4d97143 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:27.890479 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d236627-5ede-43e4-a672-9851f4d97143 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:27.891170 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d236627-5ede-43e4-a672-9851f4d97143 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:27.893163 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d236627-5ede-43e4-a672-9851f4d97143 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:27.912659 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 915/1848] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:30:27 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 12:30:27.913984 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d236627-5ede-43e4-a672-9851f4d97143 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:27.941676 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d236627-5ede-43e4-a672-9851f4d97143 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:27.990740 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40d6879-330f-47a8-9003-6fe12b2b1d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:27.994016 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d6879-330f-47a8-9003-6fe12b2b1d92 admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:28.002645 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d6879-330f-47a8-9003-6fe12b2b1d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:28.003306 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d6879-330f-47a8-9003-6fe12b2b1d92 admin admin] PATH_INFO: `/v3/projects/f5a5bf9154b947c0b28d63bdb87093bb/users/9cde4d05a84b4b0cb6d998db66c14c21/roles/b5cfd7a855a448359e9017f51d32b6fc` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:28.045705 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3cd7b7-9857-406a-944f-805fba564203 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:28.054888 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e708649d-e4f2-45ac-87f6-3141985eb99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:28.055791 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e708649d-e4f2-45ac-87f6-3141985eb99d admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:28.056505 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e708649d-e4f2-45ac-87f6-3141985eb99d admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:28.057409 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e708649d-e4f2-45ac-87f6-3141985eb99d admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:28.058935 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e708649d-e4f2-45ac-87f6-3141985eb99d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:28.062150 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e708649d-e4f2-45ac-87f6-3141985eb99d admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:28.098169 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40d6879-330f-47a8-9003-6fe12b2b1d92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5a5bf9154b947c0b28d63bdb87093bb, user_id=9cde4d05a84b4b0cb6d998db66c14c21, role_id=b5cfd7a855a448359e9017f51d32b6fc)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:28.103801 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40d6879-330f-47a8-9003-6fe12b2b1d92 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:28.113749 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 934/1849] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:30:27 2022] GET /identity/v3/roles => generated 1420 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 12:30:28.118325 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e708649d-e4f2-45ac-87f6-3141985eb99d admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:28.157310 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 916/1850] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:30:27 2022] PUT /identity/v3/projects/f5a5bf9154b947c0b28d63bdb87093bb/users/9cde4d05a84b4b0cb6d998db66c14c21/roles/b5cfd7a855a448359e9017f51d32b6fc => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:30:28.168251 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38431e1a-1223-4eae-ad6e-95e7305d5e29 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:28.169343 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38431e1a-1223-4eae-ad6e-95e7305d5e29 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:28.169774 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38431e1a-1223-4eae-ad6e-95e7305d5e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:28.197526 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e708649d-e4f2-45ac-87f6-3141985eb99d admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:28.250517 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-38431e1a-1223-4eae-ad6e-95e7305d5e29 None None] MFA Rules not processed for user `9cde4d05a84b4b0cb6d998db66c14c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:30:28.257330 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-38431e1a-1223-4eae-ad6e-95e7305d5e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:28.548201 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed348277-3d6e-4a08-90a2-15d44ffbe140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:28.548201 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed348277-3d6e-4a08-90a2-15d44ffbe140 admin admin] REQUEST_METHOD: `PUT` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:28.548201 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed348277-3d6e-4a08-90a2-15d44ffbe140 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:28.548201 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed348277-3d6e-4a08-90a2-15d44ffbe140 admin admin] PATH_INFO: `/v3/projects/6a2aa4b15a774f6bbb2361ddf1970b6a/users/1d768c257b1b417185082fb5946ed455/roles/a332ef951db949b0bad7019fbd28a1b9` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:28.550248 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed348277-3d6e-4a08-90a2-15d44ffbe140 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a2aa4b15a774f6bbb2361ddf1970b6a, user_id=1d768c257b1b417185082fb5946ed455, role_id=a332ef951db949b0bad7019fbd28a1b9)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:28.557717 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed348277-3d6e-4a08-90a2-15d44ffbe140 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:28.578778 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:28.601736 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 935/1851] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:30:28 2022] PUT /identity/v3/projects/6a2aa4b15a774f6bbb2361ddf1970b6a/users/1d768c257b1b417185082fb5946ed455/roles/a332ef951db949b0bad7019fbd28a1b9 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:30:28.616141 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 917/1852] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:30:28 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 449 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:30:28.620437 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed348277-3d6e-4a08-90a2-15d44ffbe140 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:28.626639 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b2f96-01e9-427f-88de-4e45aa50378f None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:28.626945 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b2f96-01e9-427f-88de-4e45aa50378f None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:28.627397 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b2f96-01e9-427f-88de-4e45aa50378f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:28.703518 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-646b2f96-01e9-427f-88de-4e45aa50378f None None] MFA Rules not processed for user `1d768c257b1b417185082fb5946ed455`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:30:28.703518 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-646b2f96-01e9-427f-88de-4e45aa50378f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:28.786911 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed348277-3d6e-4a08-90a2-15d44ffbe140 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:28.800014 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802cc2c0-afa4-4b7e-8c01-c8811705528f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:28.802701 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802cc2c0-afa4-4b7e-8c01-c8811705528f admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:28.803262 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802cc2c0-afa4-4b7e-8c01-c8811705528f admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:28.803723 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802cc2c0-afa4-4b7e-8c01-c8811705528f admin admin] PATH_INFO: `/v3/projects` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:28.805003 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802cc2c0-afa4-4b7e-8c01-c8811705528f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:28.809553 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802cc2c0-afa4-4b7e-8c01-c8811705528f admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:28.816316 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:28.866080 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 936/1853] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:30:28 2022] POST /identity/v3/projects => generated 387 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:30:28.867195 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802cc2c0-afa4-4b7e-8c01-c8811705528f admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:28.903258 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 918/1854] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:30:28 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:30:28.924003 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646b2f96-01e9-427f-88de-4e45aa50378f None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:28.926075 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-646b2f96-01e9-427f-88de-4e45aa50378f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:28.965147 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802cc2c0-afa4-4b7e-8c01-c8811705528f admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:28.972914 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37badac3-032c-408d-8240-db7e8af774e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:28.973935 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37badac3-032c-408d-8240-db7e8af774e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:28.974393 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37badac3-032c-408d-8240-db7e8af774e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:28.974884 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37badac3-032c-408d-8240-db7e8af774e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:28.976284 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37badac3-032c-408d-8240-db7e8af774e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:28.980491 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37badac3-032c-408d-8240-db7e8af774e1 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:29.009089 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646b2f96-01e9-427f-88de-4e45aa50378f None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:29.012678 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 937/1855] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:30:28 2022] POST /identity/v3/users => generated 294 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:30:29.016990 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37badac3-032c-408d-8240-db7e8af774e1 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:29.031924 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37badac3-032c-408d-8240-db7e8af774e1 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:29.037735 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb3a2fd-46b2-4fb4-91df-bacd8f3d7783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:29.038609 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb3a2fd-46b2-4fb4-91df-bacd8f3d7783 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:29.038960 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb3a2fd-46b2-4fb4-91df-bacd8f3d7783 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:29.039242 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb3a2fd-46b2-4fb4-91df-bacd8f3d7783 admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:29.039917 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb3a2fd-46b2-4fb4-91df-bacd8f3d7783 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:29.041668 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb3a2fd-46b2-4fb4-91df-bacd8f3d7783 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:29.056247 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 938/1856] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:30:29 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 12:30:29.061746 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb3a2fd-46b2-4fb4-91df-bacd8f3d7783 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:29.074631 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb3a2fd-46b2-4fb4-91df-bacd8f3d7783 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:29.081572 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efacd26-2a54-4b31-82d1-0cc79e593525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:29.082139 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efacd26-2a54-4b31-82d1-0cc79e593525 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:29.082431 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efacd26-2a54-4b31-82d1-0cc79e593525 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:29.082704 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efacd26-2a54-4b31-82d1-0cc79e593525 admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:29.083455 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efacd26-2a54-4b31-82d1-0cc79e593525 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:29.085148 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efacd26-2a54-4b31-82d1-0cc79e593525 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:29.096103 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c2cc23-e5eb-497f-81d0-df4de9108b29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e79503178ac54e62ba385467d5617ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:29.096103 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2cc23-e5eb-497f-81d0-df4de9108b29 service cinder] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:29.096103 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2cc23-e5eb-497f-81d0-df4de9108b29 service cinder] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:29.096604 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2cc23-e5eb-497f-81d0-df4de9108b29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:29.100692 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 939/1857] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:30:29 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 12:30:29.102475 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efacd26-2a54-4b31-82d1-0cc79e593525 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:29.121924 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efacd26-2a54-4b31-82d1-0cc79e593525 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:29.127828 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2228f19b-6c54-4301-975e-6891d61ab618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:29.128539 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2228f19b-6c54-4301-975e-6891d61ab618 admin admin] REQUEST_METHOD: `PUT` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:29.128824 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2228f19b-6c54-4301-975e-6891d61ab618 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:29.129104 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2228f19b-6c54-4301-975e-6891d61ab618 admin admin] PATH_INFO: `/v3/projects/8597493605fa404eac8383bdd9a7bc31/users/15054f48ba1246e79fb0d5a342d808d2/roles/b5cfd7a855a448359e9017f51d32b6fc` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:29.153618 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2228f19b-6c54-4301-975e-6891d61ab618 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8597493605fa404eac8383bdd9a7bc31, user_id=15054f48ba1246e79fb0d5a342d808d2, role_id=b5cfd7a855a448359e9017f51d32b6fc)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:29.157577 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2228f19b-6c54-4301-975e-6891d61ab618 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:29.176267 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 940/1858] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:30:29 2022] PUT /identity/v3/projects/8597493605fa404eac8383bdd9a7bc31/users/15054f48ba1246e79fb0d5a342d808d2/roles/b5cfd7a855a448359e9017f51d32b6fc => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:30:29.191320 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe98ce5-f73b-4075-abde-a188a6ce9b95 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:29.191897 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe98ce5-f73b-4075-abde-a188a6ce9b95 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:29.192225 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe98ce5-f73b-4075-abde-a188a6ce9b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:29.198420 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c2cc23-e5eb-497f-81d0-df4de9108b29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:29.200905 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c2cc23-e5eb-497f-81d0-df4de9108b29 service cinder] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:29.217335 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 919/1859] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:30:28 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:30:29.230698 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-cbe98ce5-f73b-4075-abde-a188a6ce9b95 None None] MFA Rules not processed for user `15054f48ba1246e79fb0d5a342d808d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:30:29.232913 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-cbe98ce5-f73b-4075-abde-a188a6ce9b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:29.270520 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:29.386218 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c2cc23-e5eb-497f-81d0-df4de9108b29 service cinder] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:29.405875 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c2cc23-e5eb-497f-81d0-df4de9108b29 service cinder] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:29.467227 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 941/1860] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:30:29 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:30:29.473031 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe98ce5-f73b-4075-abde-a188a6ce9b95 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:29.493997 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:29.526709 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91108fc-92cf-4350-8fad-157b9180890a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e79503178ac54e62ba385467d5617ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:29.528489 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91108fc-92cf-4350-8fad-157b9180890a service cinder] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:29.528988 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91108fc-92cf-4350-8fad-157b9180890a service cinder] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:29.529641 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91108fc-92cf-4350-8fad-157b9180890a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:29.581697 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe98ce5-f73b-4075-abde-a188a6ce9b95 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:29.587526 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ae6493-82a1-49d9-a54b-c381d26c74dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:29.588570 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae6493-82a1-49d9-a54b-c381d26c74dc admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:29.588925 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae6493-82a1-49d9-a54b-c381d26c74dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:29.589430 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae6493-82a1-49d9-a54b-c381d26c74dc admin admin] PATH_INFO: `/v3/projects` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:29.590183 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ae6493-82a1-49d9-a54b-c381d26c74dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:29.592346 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ae6493-82a1-49d9-a54b-c381d26c74dc admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:29.633850 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 942/1861] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:30:29 2022] POST /identity/v3/projects => generated 383 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:30:29.639498 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ae6493-82a1-49d9-a54b-c381d26c74dc admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:29.649591 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91108fc-92cf-4350-8fad-157b9180890a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:29.652506 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91108fc-92cf-4350-8fad-157b9180890a service cinder] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:29.663350 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 920/1862] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:30:29 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:30:29.760755 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ae6493-82a1-49d9-a54b-c381d26c74dc admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:29.766740 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa534fa-e513-44e6-9dc3-cb1215fc7ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:29.767461 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa534fa-e513-44e6-9dc3-cb1215fc7ba7 admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:29.767760 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa534fa-e513-44e6-9dc3-cb1215fc7ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:29.768026 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa534fa-e513-44e6-9dc3-cb1215fc7ba7 admin admin] PATH_INFO: `/v3/users` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:29.768691 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa534fa-e513-44e6-9dc3-cb1215fc7ba7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:29.772613 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa534fa-e513-44e6-9dc3-cb1215fc7ba7 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:29.836979 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 943/1863] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:30:29 2022] POST /identity/v3/users => generated 298 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:30:29.840929 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91108fc-92cf-4350-8fad-157b9180890a service cinder] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:29.854461 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91108fc-92cf-4350-8fad-157b9180890a service cinder] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:29.867018 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b703481-e635-4bb2-9419-3937875a28bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:29.867748 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b703481-e635-4bb2-9419-3937875a28bc admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:29.868034 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b703481-e635-4bb2-9419-3937875a28bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:29.868313 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b703481-e635-4bb2-9419-3937875a28bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:29.869130 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b703481-e635-4bb2-9419-3937875a28bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:29.871550 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b703481-e635-4bb2-9419-3937875a28bc admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:29.893331 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 921/1864] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:30:29 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 12:30:29.898412 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa534fa-e513-44e6-9dc3-cb1215fc7ba7 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:29.945397 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa534fa-e513-44e6-9dc3-cb1215fc7ba7 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:29.972951 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32f8754-8cb4-497d-9e38-fa1495efea21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:29.974267 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f8754-8cb4-497d-9e38-fa1495efea21 admin admin] REQUEST_METHOD: `PUT` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:29.974728 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f8754-8cb4-497d-9e38-fa1495efea21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:29.975487 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f8754-8cb4-497d-9e38-fa1495efea21 admin admin] PATH_INFO: `/v3/projects/eefe0c0e61ef42bfa950d22722632c1d/users/a311fd530ac44713a48adc89eed2e602/roles/a332ef951db949b0bad7019fbd28a1b9` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:30.022390 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32f8754-8cb4-497d-9e38-fa1495efea21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eefe0c0e61ef42bfa950d22722632c1d, user_id=a311fd530ac44713a48adc89eed2e602, role_id=a332ef951db949b0bad7019fbd28a1b9)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:30.027827 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32f8754-8cb4-497d-9e38-fa1495efea21 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:30.085641 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 944/1865] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:30:29 2022] PUT /identity/v3/projects/eefe0c0e61ef42bfa950d22722632c1d/users/a311fd530ac44713a48adc89eed2e602/roles/a332ef951db949b0bad7019fbd28a1b9 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:30:30.099951 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b703481-e635-4bb2-9419-3937875a28bc admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:30.126823 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b703481-e635-4bb2-9419-3937875a28bc admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:30.249430 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8bf619-445d-4b09-99a3-d2bdf59a28e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:30.250189 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8bf619-445d-4b09-99a3-d2bdf59a28e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:30.250471 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8bf619-445d-4b09-99a3-d2bdf59a28e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:30.250741 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8bf619-445d-4b09-99a3-d2bdf59a28e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:30.251570 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8bf619-445d-4b09-99a3-d2bdf59a28e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:30.253988 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8bf619-445d-4b09-99a3-d2bdf59a28e8 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:30.270585 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 922/1866] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:30:30 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:30:30.271644 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32f8754-8cb4-497d-9e38-fa1495efea21 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:30.283924 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32f8754-8cb4-497d-9e38-fa1495efea21 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:30.291419 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f23f2f5-7913-4714-a9ea-a74a88ee1af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:30.292576 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23f2f5-7913-4714-a9ea-a74a88ee1af9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:30.293385 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23f2f5-7913-4714-a9ea-a74a88ee1af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:30.293699 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23f2f5-7913-4714-a9ea-a74a88ee1af9 admin admin] PATH_INFO: `/v3/projects/eefe0c0e61ef42bfa950d22722632c1d/users/a311fd530ac44713a48adc89eed2e602/roles/a332ef951db949b0bad7019fbd28a1b9` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:30.295934 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f23f2f5-7913-4714-a9ea-a74a88ee1af9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eefe0c0e61ef42bfa950d22722632c1d, user_id=a311fd530ac44713a48adc89eed2e602, role_id=a332ef951db949b0bad7019fbd28a1b9)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:30.298813 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f23f2f5-7913-4714-a9ea-a74a88ee1af9 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:30.301631 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:30.323051 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 945/1867] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:30:30 2022] PUT /identity/v3/projects/eefe0c0e61ef42bfa950d22722632c1d/users/a311fd530ac44713a48adc89eed2e602/roles/a332ef951db949b0bad7019fbd28a1b9 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:30:30.331737 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0345ec63-2607-4b12-95c2-8127019e5dc4 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:30.332031 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0345ec63-2607-4b12-95c2-8127019e5dc4 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:30.332354 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0345ec63-2607-4b12-95c2-8127019e5dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:30.367422 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f23f2f5-7913-4714-a9ea-a74a88ee1af9 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:30.372715 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-0345ec63-2607-4b12-95c2-8127019e5dc4 None None] MFA Rules not processed for user `a311fd530ac44713a48adc89eed2e602`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:30:30.374154 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-0345ec63-2607-4b12-95c2-8127019e5dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:30.499215 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f23f2f5-7913-4714-a9ea-a74a88ee1af9 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:30.500660 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 923/1868] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:30:30 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:30:30.522204 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0345ec63-2607-4b12-95c2-8127019e5dc4 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:30.528084 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687adcc6-6874-4c20-9e1a-093a9ef9d1a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:30.529317 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:30.530134 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687adcc6-6874-4c20-9e1a-093a9ef9d1a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:30.530579 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687adcc6-6874-4c20-9e1a-093a9ef9d1a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:30.531070 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687adcc6-6874-4c20-9e1a-093a9ef9d1a6 admin admin] PATH_INFO: `/v3/users/faf4050d6e7349019247d3dacddc0c9f` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:30.532774 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687adcc6-6874-4c20-9e1a-093a9ef9d1a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=faf4050d6e7349019247d3dacddc0c9f)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:30.535489 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687adcc6-6874-4c20-9e1a-093a9ef9d1a6 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:30.657052 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-687adcc6-6874-4c20-9e1a-093a9ef9d1a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'faf4050d6e7349019247d3dacddc0c9f'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:30.668767 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0345ec63-2607-4b12-95c2-8127019e5dc4 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:30.682245 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3a32b5-4945-4b69-b78e-d25a97d64efe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e79503178ac54e62ba385467d5617ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:30.685268 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3a32b5-4945-4b69-b78e-d25a97d64efe service cinder] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:30.686049 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3a32b5-4945-4b69-b78e-d25a97d64efe service cinder] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:30.686338 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3a32b5-4945-4b69-b78e-d25a97d64efe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:30.689474 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-687adcc6-6874-4c20-9e1a-093a9ef9d1a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'faf4050d6e7349019247d3dacddc0c9f'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:30.702577 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3a32b5-4945-4b69-b78e-d25a97d64efe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:30.704359 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3a32b5-4945-4b69-b78e-d25a97d64efe service cinder] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:30.721107 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 924/1869] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:30:30 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:30:30.735147 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-687adcc6-6874-4c20-9e1a-093a9ef9d1a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'faf4050d6e7349019247d3dacddc0c9f'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:30.741240 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-687adcc6-6874-4c20-9e1a-093a9ef9d1a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'faf4050d6e7349019247d3dacddc0c9f'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:30.759085 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-687adcc6-6874-4c20-9e1a-093a9ef9d1a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'faf4050d6e7349019247d3dacddc0c9f'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:30.778957 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 946/1870] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:30:30 2022] DELETE /identity/v3/users/faf4050d6e7349019247d3dacddc0c9f => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:30:30.786108 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfacdbd2-a108-4d4a-9a27-137aacdbb062 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:30.786445 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfacdbd2-a108-4d4a-9a27-137aacdbb062 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:30.786666 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfacdbd2-a108-4d4a-9a27-137aacdbb062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:30.824417 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-cfacdbd2-a108-4d4a-9a27-137aacdbb062 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:30:30.825318 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-cfacdbd2-a108-4d4a-9a27-137aacdbb062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:30.928812 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 925/1871] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:30:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:30:30.939470 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687adcc6-6874-4c20-9e1a-093a9ef9d1a6 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:30.941434 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-687adcc6-6874-4c20-9e1a-093a9ef9d1a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:31.040981 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687adcc6-6874-4c20-9e1a-093a9ef9d1a6 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:31.052143 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe04112-b645-44b6-b055-f5257720f5b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:31.053010 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe04112-b645-44b6-b055-f5257720f5b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:31.053394 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe04112-b645-44b6-b055-f5257720f5b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:31.053773 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe04112-b645-44b6-b055-f5257720f5b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:31.067438 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe04112-b645-44b6-b055-f5257720f5b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:31.069031 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe04112-b645-44b6-b055-f5257720f5b8 service neutron] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:31.086399 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 947/1872] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:30:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:30:31.877561 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfacdbd2-a108-4d4a-9a27-137aacdbb062 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:31.888981 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-cfacdbd2-a108-4d4a-9a27-137aacdbb062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:32.010660 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfacdbd2-a108-4d4a-9a27-137aacdbb062 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:32.031586 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74191609-b327-487b-ad47-1f57a08da5e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e79503178ac54e62ba385467d5617ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:32.032247 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74191609-b327-487b-ad47-1f57a08da5e6 service cinder] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:32.032531 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74191609-b327-487b-ad47-1f57a08da5e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:32.032860 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74191609-b327-487b-ad47-1f57a08da5e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:32.039863 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-74191609-b327-487b-ad47-1f57a08da5e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:32.163232 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74191609-b327-487b-ad47-1f57a08da5e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:32.168955 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74191609-b327-487b-ad47-1f57a08da5e6 service cinder] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:32.182381 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:32.197035 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 926/1873] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:30:31 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:30:32.233508 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe04112-b645-44b6-b055-f5257720f5b8 service neutron] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:32.235803 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-dbe04112-b645-44b6-b055-f5257720f5b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:32.292004 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe04112-b645-44b6-b055-f5257720f5b8 service neutron] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:32.325755 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852cab44-db6e-4088-ad8f-9b541097333e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:32.328166 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852cab44-db6e-4088-ad8f-9b541097333e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:32.329600 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852cab44-db6e-4088-ad8f-9b541097333e admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:32.330294 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852cab44-db6e-4088-ad8f-9b541097333e admin admin] PATH_INFO: `/v3/projects/6435669ad1aa4542a34c2a51690d736d` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:32.336199 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852cab44-db6e-4088-ad8f-9b541097333e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6435669ad1aa4542a34c2a51690d736d)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:32.349486 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852cab44-db6e-4088-ad8f-9b541097333e admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:32.471045 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:32.721347 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-852cab44-db6e-4088-ad8f-9b541097333e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6435669ad1aa4542a34c2a51690d736d', 'request_id': 'req-852cab44-db6e-4088-ad8f-9b541097333e'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:32.750097 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-852cab44-db6e-4088-ad8f-9b541097333e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6435669ad1aa4542a34c2a51690d736d', 'request_id': 'req-852cab44-db6e-4088-ad8f-9b541097333e'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:32.780855 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-852cab44-db6e-4088-ad8f-9b541097333e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6435669ad1aa4542a34c2a51690d736d', 'request_id': 'req-852cab44-db6e-4088-ad8f-9b541097333e'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:32.856931 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-852cab44-db6e-4088-ad8f-9b541097333e admin admin] The token cache is being invalidate because project 6435669ad1aa4542a34c2a51690d736d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:30:32.860432 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-852cab44-db6e-4088-ad8f-9b541097333e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:32.865575 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-852cab44-db6e-4088-ad8f-9b541097333e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:32.875065 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 948/1874] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:30:32 2022] DELETE /identity/v3/projects/6435669ad1aa4542a34c2a51690d736d => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:30:32.877441 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74191609-b327-487b-ad47-1f57a08da5e6 service cinder] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:32.899525 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74191609-b327-487b-ad47-1f57a08da5e6 service cinder] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:33.155808 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a5fea0-39a7-4665-81de-b64b82694bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:33.156910 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5fea0-39a7-4665-81de-b64b82694bce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:33.159643 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5fea0-39a7-4665-81de-b64b82694bce admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:33.162263 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5fea0-39a7-4665-81de-b64b82694bce admin admin] PATH_INFO: `/v3/users/1d768c257b1b417185082fb5946ed455` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:33.163726 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a5fea0-39a7-4665-81de-b64b82694bce admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d768c257b1b417185082fb5946ed455)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:33.176949 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a5fea0-39a7-4665-81de-b64b82694bce admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:33.422242 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-25a5fea0-39a7-4665-81de-b64b82694bce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d768c257b1b417185082fb5946ed455'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:33.517897 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-25a5fea0-39a7-4665-81de-b64b82694bce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d768c257b1b417185082fb5946ed455'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:33.520428 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-25a5fea0-39a7-4665-81de-b64b82694bce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d768c257b1b417185082fb5946ed455'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:33.613120 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-25a5fea0-39a7-4665-81de-b64b82694bce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d768c257b1b417185082fb5946ed455'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:33.614602 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-25a5fea0-39a7-4665-81de-b64b82694bce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d768c257b1b417185082fb5946ed455'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:33.708233 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 927/1875] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:30:32 2022] DELETE /identity/v3/users/1d768c257b1b417185082fb5946ed455 => generated 0 bytes in 831 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:30:34.446198 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852cab44-db6e-4088-ad8f-9b541097333e admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:34.447770 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-852cab44-db6e-4088-ad8f-9b541097333e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:34.475836 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852cab44-db6e-4088-ad8f-9b541097333e admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:34.632805 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c48865-251d-49df-83a4-793c7b7360da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:34.633877 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c48865-251d-49df-83a4-793c7b7360da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:34.634317 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c48865-251d-49df-83a4-793c7b7360da admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:34.634745 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c48865-251d-49df-83a4-793c7b7360da admin admin] PATH_INFO: `/v3/users/246a71f2d8954164a90a63a3471e2179` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:34.639292 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c48865-251d-49df-83a4-793c7b7360da admin admin] RBAC: Authorizing `identity:delete_user(user_id=246a71f2d8954164a90a63a3471e2179)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:34.641643 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c48865-251d-49df-83a4-793c7b7360da admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:34.770411 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-54c48865-251d-49df-83a4-793c7b7360da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '246a71f2d8954164a90a63a3471e2179'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:34.838760 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-54c48865-251d-49df-83a4-793c7b7360da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '246a71f2d8954164a90a63a3471e2179'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:34.871581 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-54c48865-251d-49df-83a4-793c7b7360da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '246a71f2d8954164a90a63a3471e2179'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:34.874546 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-54c48865-251d-49df-83a4-793c7b7360da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '246a71f2d8954164a90a63a3471e2179'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:34.891947 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-54c48865-251d-49df-83a4-793c7b7360da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '246a71f2d8954164a90a63a3471e2179'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:34.902987 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 949/1876] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:30:34 2022] DELETE /identity/v3/users/246a71f2d8954164a90a63a3471e2179 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:30:34.908216 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2cb501-3fc2-4215-b848-b7fcc0a59663 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:34.909189 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2cb501-3fc2-4215-b848-b7fcc0a59663 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:34.909634 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2cb501-3fc2-4215-b848-b7fcc0a59663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:34.956338 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-9e2cb501-3fc2-4215-b848-b7fcc0a59663 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:30:34.957896 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-9e2cb501-3fc2-4215-b848-b7fcc0a59663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:35.137302 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 928/1877] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:30:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:30:35.158664 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c48865-251d-49df-83a4-793c7b7360da admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:35.160899 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-54c48865-251d-49df-83a4-793c7b7360da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:35.245744 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:35.377500 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c48865-251d-49df-83a4-793c7b7360da admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:35.390998 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0263b750-93c9-4883-b2b0-9e1822745f20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:35.390998 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0263b750-93c9-4883-b2b0-9e1822745f20 service neutron] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:35.390998 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0263b750-93c9-4883-b2b0-9e1822745f20 service neutron] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:35.390998 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0263b750-93c9-4883-b2b0-9e1822745f20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:35.406012 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0263b750-93c9-4883-b2b0-9e1822745f20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:35.407324 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0263b750-93c9-4883-b2b0-9e1822745f20 service neutron] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:35.424797 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 950/1878] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:30:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:30:35.439818 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2cb501-3fc2-4215-b848-b7fcc0a59663 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:35.441854 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-9e2cb501-3fc2-4215-b848-b7fcc0a59663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:35.466080 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2cb501-3fc2-4215-b848-b7fcc0a59663 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:35.476093 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839741be-aa95-461c-888f-3ec775d57c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:35.477148 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839741be-aa95-461c-888f-3ec775d57c0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:35.479591 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839741be-aa95-461c-888f-3ec775d57c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:35.481031 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839741be-aa95-461c-888f-3ec775d57c0e admin admin] PATH_INFO: `/v3/users/f74476d3d11e48088c3de1d06b9ef682` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:35.482651 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839741be-aa95-461c-888f-3ec775d57c0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f74476d3d11e48088c3de1d06b9ef682)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:35.485810 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839741be-aa95-461c-888f-3ec775d57c0e admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:35.525344 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:35.626033 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-839741be-aa95-461c-888f-3ec775d57c0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f74476d3d11e48088c3de1d06b9ef682'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:35.679869 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-839741be-aa95-461c-888f-3ec775d57c0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f74476d3d11e48088c3de1d06b9ef682'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:35.686685 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-839741be-aa95-461c-888f-3ec775d57c0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f74476d3d11e48088c3de1d06b9ef682'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:35.709265 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-839741be-aa95-461c-888f-3ec775d57c0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f74476d3d11e48088c3de1d06b9ef682'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:35.712291 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-839741be-aa95-461c-888f-3ec775d57c0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f74476d3d11e48088c3de1d06b9ef682'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:35.754659 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 929/1879] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:30:35 2022] DELETE /identity/v3/users/f74476d3d11e48088c3de1d06b9ef682 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:30:35.762904 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91cac6a-b517-4825-b61d-3f2081a36352 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:35.762904 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91cac6a-b517-4825-b61d-3f2081a36352 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:35.762904 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91cac6a-b517-4825-b61d-3f2081a36352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:35.817614 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-c91cac6a-b517-4825-b61d-3f2081a36352 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:30:35.817614 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-c91cac6a-b517-4825-b61d-3f2081a36352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:35.901289 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839741be-aa95-461c-888f-3ec775d57c0e admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:35.902890 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-839741be-aa95-461c-888f-3ec775d57c0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:36.097224 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 951/1880] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:30:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:30:36.138719 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91cac6a-b517-4825-b61d-3f2081a36352 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:36.139220 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839741be-aa95-461c-888f-3ec775d57c0e admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:36.143934 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-c91cac6a-b517-4825-b61d-3f2081a36352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:36.162794 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced4ae4c-f4cf-45d0-aa93-e439a7c68ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:36.163506 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced4ae4c-f4cf-45d0-aa93-e439a7c68ee1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:36.163870 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced4ae4c-f4cf-45d0-aa93-e439a7c68ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:36.164197 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced4ae4c-f4cf-45d0-aa93-e439a7c68ee1 admin admin] PATH_INFO: `/v3/projects/6a2aa4b15a774f6bbb2361ddf1970b6a` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:36.171698 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced4ae4c-f4cf-45d0-aa93-e439a7c68ee1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a2aa4b15a774f6bbb2361ddf1970b6a)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:36.178718 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced4ae4c-f4cf-45d0-aa93-e439a7c68ee1 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:36.296766 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-ced4ae4c-f4cf-45d0-aa93-e439a7c68ee1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a2aa4b15a774f6bbb2361ddf1970b6a', 'request_id': 'req-ced4ae4c-f4cf-45d0-aa93-e439a7c68ee1'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:36.332122 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-ced4ae4c-f4cf-45d0-aa93-e439a7c68ee1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a2aa4b15a774f6bbb2361ddf1970b6a', 'request_id': 'req-ced4ae4c-f4cf-45d0-aa93-e439a7c68ee1'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:36.369759 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-ced4ae4c-f4cf-45d0-aa93-e439a7c68ee1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a2aa4b15a774f6bbb2361ddf1970b6a', 'request_id': 'req-ced4ae4c-f4cf-45d0-aa93-e439a7c68ee1'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:36.424390 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-ced4ae4c-f4cf-45d0-aa93-e439a7c68ee1 admin admin] The token cache is being invalidate because project 6a2aa4b15a774f6bbb2361ddf1970b6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:30:36.428438 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-ced4ae4c-f4cf-45d0-aa93-e439a7c68ee1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:36.430508 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-ced4ae4c-f4cf-45d0-aa93-e439a7c68ee1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:36.432464 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91cac6a-b517-4825-b61d-3f2081a36352 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:36.436405 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 930/1881] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:30:35 2022] DELETE /identity/v3/projects/6a2aa4b15a774f6bbb2361ddf1970b6a => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:30:36.448051 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d4d69-854a-4446-86c9-fea09442ee81 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:36.448337 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d4d69-854a-4446-86c9-fea09442ee81 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:36.448695 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d4d69-854a-4446-86c9-fea09442ee81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:36.482499 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-997d4d69-854a-4446-86c9-fea09442ee81 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:30:36.484037 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-997d4d69-854a-4446-86c9-fea09442ee81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:36.536116 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:36.572912 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612b7657-6bf2-4cbd-8ddc-2b40dd54e28e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:36.574711 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b7657-6bf2-4cbd-8ddc-2b40dd54e28e service neutron] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:36.575403 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b7657-6bf2-4cbd-8ddc-2b40dd54e28e service neutron] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:36.575801 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b7657-6bf2-4cbd-8ddc-2b40dd54e28e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:36.579116 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-612b7657-6bf2-4cbd-8ddc-2b40dd54e28e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:36.630746 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 931/1882] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:30:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:30:36.640379 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b1e95-f511-466b-87fb-4d2e00f71833 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:36.642732 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b1e95-f511-466b-87fb-4d2e00f71833 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:36.645792 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b1e95-f511-466b-87fb-4d2e00f71833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:36.669438 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:36.763829 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-e86b1e95-f511-466b-87fb-4d2e00f71833 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:30:36.765744 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-e86b1e95-f511-466b-87fb-4d2e00f71833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:36.772942 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612b7657-6bf2-4cbd-8ddc-2b40dd54e28e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:36.777369 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612b7657-6bf2-4cbd-8ddc-2b40dd54e28e service neutron] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:36.805434 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 932/1883] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:30:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:30:36.805434 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738baea4-9829-4b6f-a0f8-32c1a15fb115 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:36.805434 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738baea4-9829-4b6f-a0f8-32c1a15fb115 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:36.805434 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738baea4-9829-4b6f-a0f8-32c1a15fb115 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:36.809165 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 933/1884] 10.222.0.79 () {54 vars in 921 bytes} [Wed Aug 31 12:30:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:30:36.815234 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738baea4-9829-4b6f-a0f8-32c1a15fb115 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:36.823272 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 952/1885] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:30:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 684 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:30:36.862711 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738baea4-9829-4b6f-a0f8-32c1a15fb115 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:36.887037 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88eaa7a-f4d6-4010-94ec-bf7fa1b7090d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:36.887397 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88eaa7a-f4d6-4010-94ec-bf7fa1b7090d admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:36.887619 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88eaa7a-f4d6-4010-94ec-bf7fa1b7090d admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:36.887899 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88eaa7a-f4d6-4010-94ec-bf7fa1b7090d admin admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:36.892493 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88eaa7a-f4d6-4010-94ec-bf7fa1b7090d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:30:36.892938 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88eaa7a-f4d6-4010-94ec-bf7fa1b7090d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:36.897049 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88eaa7a-f4d6-4010-94ec-bf7fa1b7090d admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:36.930277 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 934/1886] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 12:30:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:30:36.935243 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612b7657-6bf2-4cbd-8ddc-2b40dd54e28e service neutron] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:36.954390 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612b7657-6bf2-4cbd-8ddc-2b40dd54e28e service neutron] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:36.971078 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfe88bd-c2df-4f01-b70d-aa7186383342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:36.971078 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe88bd-c2df-4f01-b70d-aa7186383342 admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:36.971966 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe88bd-c2df-4f01-b70d-aa7186383342 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:36.974308 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe88bd-c2df-4f01-b70d-aa7186383342 admin admin] PATH_INFO: `/v3/projects` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:36.975363 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfe88bd-c2df-4f01-b70d-aa7186383342 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:36.977640 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfe88bd-c2df-4f01-b70d-aa7186383342 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:37.057397 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 953/1887] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:30:36 2022] POST /identity/v3/projects => generated 371 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:30:37.058670 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88eaa7a-f4d6-4010-94ec-bf7fa1b7090d admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:37.096163 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88eaa7a-f4d6-4010-94ec-bf7fa1b7090d admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:37.305503 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3945cb97-2b87-4b1d-ba98-ce7520fb1b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:37.306144 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3945cb97-2b87-4b1d-ba98-ce7520fb1b73 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:37.306996 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3945cb97-2b87-4b1d-ba98-ce7520fb1b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:37.306996 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3945cb97-2b87-4b1d-ba98-ce7520fb1b73 admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:37.307584 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3945cb97-2b87-4b1d-ba98-ce7520fb1b73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:37.313163 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3945cb97-2b87-4b1d-ba98-ce7520fb1b73 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:37.324912 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f5a2de-2e5b-49fe-8ffe-3fa819045839 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:37.326907 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f5a2de-2e5b-49fe-8ffe-3fa819045839 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:37.326907 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f5a2de-2e5b-49fe-8ffe-3fa819045839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:37.389838 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-a4f5a2de-2e5b-49fe-8ffe-3fa819045839 None None] MFA Rules not processed for user `62401c8e1457450590f4147e0665265a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:30:37.391497 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-a4f5a2de-2e5b-49fe-8ffe-3fa819045839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:37.401213 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 935/1888] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:30:37 2022] POST /identity/v3/users => generated 286 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:30:37.406605 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3945cb97-2b87-4b1d-ba98-ce7520fb1b73 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:37.448471 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3945cb97-2b87-4b1d-ba98-ce7520fb1b73 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:37.478328 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e60533-1fba-46a8-a4ad-b72fda06db4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:37.481737 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e60533-1fba-46a8-a4ad-b72fda06db4f admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:37.485981 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e60533-1fba-46a8-a4ad-b72fda06db4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:37.486321 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e60533-1fba-46a8-a4ad-b72fda06db4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:37.487027 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e60533-1fba-46a8-a4ad-b72fda06db4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:37.493196 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e60533-1fba-46a8-a4ad-b72fda06db4f admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:37.519012 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 936/1889] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:30:37 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:30:37.522842 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e60533-1fba-46a8-a4ad-b72fda06db4f admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:37.528312 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-c4e60533-1fba-46a8-a4ad-b72fda06db4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:37.564617 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e60533-1fba-46a8-a4ad-b72fda06db4f admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:37.578413 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046773c4-d284-45e4-b4ac-a8ba7216afcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:37.579122 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046773c4-d284-45e4-b4ac-a8ba7216afcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:37.579410 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046773c4-d284-45e4-b4ac-a8ba7216afcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:37.579686 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046773c4-d284-45e4-b4ac-a8ba7216afcb admin admin] PATH_INFO: `/v3/projects/9fad051760724160ac85a4ea032387cc` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:37.581717 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046773c4-d284-45e4-b4ac-a8ba7216afcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fad051760724160ac85a4ea032387cc)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:37.587601 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046773c4-d284-45e4-b4ac-a8ba7216afcb admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:37.700186 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 954/1890] 10.222.0.79 () {58 vars in 1018 bytes} [Wed Aug 31 12:30:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:30:37.703623 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f5a2de-2e5b-49fe-8ffe-3fa819045839 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:37.743165 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f5a2de-2e5b-49fe-8ffe-3fa819045839 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:37.743809 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-046773c4-d284-45e4-b4ac-a8ba7216afcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fad051760724160ac85a4ea032387cc', 'request_id': 'req-046773c4-d284-45e4-b4ac-a8ba7216afcb'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:37.755158 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-046773c4-d284-45e4-b4ac-a8ba7216afcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fad051760724160ac85a4ea032387cc', 'request_id': 'req-046773c4-d284-45e4-b4ac-a8ba7216afcb'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:37.766799 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-046773c4-d284-45e4-b4ac-a8ba7216afcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fad051760724160ac85a4ea032387cc', 'request_id': 'req-046773c4-d284-45e4-b4ac-a8ba7216afcb'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:37.791393 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-046773c4-d284-45e4-b4ac-a8ba7216afcb admin admin] The token cache is being invalidate because project 9fad051760724160ac85a4ea032387cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:30:37.792004 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-046773c4-d284-45e4-b4ac-a8ba7216afcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:37.796473 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-046773c4-d284-45e4-b4ac-a8ba7216afcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:37.798455 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 937/1891] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:30:37 2022] DELETE /identity/v3/projects/9fad051760724160ac85a4ea032387cc => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:30:37.803828 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046773c4-d284-45e4-b4ac-a8ba7216afcb admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:37.811799 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-046773c4-d284-45e4-b4ac-a8ba7216afcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:37.822965 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:37.992553 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85e9b67-9038-496d-93eb-ab85291f7c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:37.993303 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e9b67-9038-496d-93eb-ab85291f7c5f admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:37.996557 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e9b67-9038-496d-93eb-ab85291f7c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:37.997153 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e9b67-9038-496d-93eb-ab85291f7c5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:37.997616 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85e9b67-9038-496d-93eb-ab85291f7c5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:38.001788 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85e9b67-9038-496d-93eb-ab85291f7c5f admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:38.028325 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046773c4-d284-45e4-b4ac-a8ba7216afcb admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:38.039157 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 955/1892] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:30:37 2022] GET /identity/v3/roles => generated 1420 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:30:38.040541 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85e9b67-9038-496d-93eb-ab85291f7c5f admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:38.043882 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-f85e9b67-9038-496d-93eb-ab85291f7c5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:38.055241 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cece2d-1b61-455d-9e26-3bf0503a0152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:38.056194 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cece2d-1b61-455d-9e26-3bf0503a0152 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:38.056672 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cece2d-1b61-455d-9e26-3bf0503a0152 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:38.057904 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cece2d-1b61-455d-9e26-3bf0503a0152 admin admin] PATH_INFO: `/v3/users/73b09e94a50a40f3b4fac20f7283a77a` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:38.062995 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cece2d-1b61-455d-9e26-3bf0503a0152 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73b09e94a50a40f3b4fac20f7283a77a)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:38.065326 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cece2d-1b61-455d-9e26-3bf0503a0152 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:38.081345 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85e9b67-9038-496d-93eb-ab85291f7c5f admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:38.096698 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9921e880-1920-4668-bd0f-8a1f7492b577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:38.097441 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9921e880-1920-4668-bd0f-8a1f7492b577 admin admin] REQUEST_METHOD: `PUT` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:38.097811 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9921e880-1920-4668-bd0f-8a1f7492b577 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:38.098132 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9921e880-1920-4668-bd0f-8a1f7492b577 admin admin] PATH_INFO: `/v3/projects/a9d6bc13e35947889ceb9ebdce0c7d06/users/656050c312a541a6a27a2225c0d78eac/roles/b5cfd7a855a448359e9017f51d32b6fc` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:38.141166 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9921e880-1920-4668-bd0f-8a1f7492b577 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9d6bc13e35947889ceb9ebdce0c7d06, user_id=656050c312a541a6a27a2225c0d78eac, role_id=b5cfd7a855a448359e9017f51d32b6fc)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:38.144478 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9921e880-1920-4668-bd0f-8a1f7492b577 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:38.179649 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 956/1893] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:30:38 2022] PUT /identity/v3/projects/a9d6bc13e35947889ceb9ebdce0c7d06/users/656050c312a541a6a27a2225c0d78eac/roles/b5cfd7a855a448359e9017f51d32b6fc => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:30:38.189528 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9921e880-1920-4668-bd0f-8a1f7492b577 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:38.191955 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-9921e880-1920-4668-bd0f-8a1f7492b577 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:38.237401 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-e5cece2d-1b61-455d-9e26-3bf0503a0152 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73b09e94a50a40f3b4fac20f7283a77a'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:38.258488 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:38.303927 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-e5cece2d-1b61-455d-9e26-3bf0503a0152 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73b09e94a50a40f3b4fac20f7283a77a'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:38.315235 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-e5cece2d-1b61-455d-9e26-3bf0503a0152 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73b09e94a50a40f3b4fac20f7283a77a'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:38.333381 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-e5cece2d-1b61-455d-9e26-3bf0503a0152 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73b09e94a50a40f3b4fac20f7283a77a'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:38.336523 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-e5cece2d-1b61-455d-9e26-3bf0503a0152 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73b09e94a50a40f3b4fac20f7283a77a'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:38.376630 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 938/1894] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:30:37 2022] DELETE /identity/v3/users/73b09e94a50a40f3b4fac20f7283a77a => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:30:38.377580 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12f536b-54da-4fdd-9c11-cf4b5230d20e None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:38.380010 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12f536b-54da-4fdd-9c11-cf4b5230d20e None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:38.380563 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12f536b-54da-4fdd-9c11-cf4b5230d20e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:38.451863 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-a12f536b-54da-4fdd-9c11-cf4b5230d20e None None] MFA Rules not processed for user `656050c312a541a6a27a2225c0d78eac`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:30:38.453241 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-a12f536b-54da-4fdd-9c11-cf4b5230d20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:38.571557 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9921e880-1920-4668-bd0f-8a1f7492b577 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:38.660052 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 939/1895] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:30:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:30:38.661579 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12f536b-54da-4fdd-9c11-cf4b5230d20e None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:38.665028 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-a12f536b-54da-4fdd-9c11-cf4b5230d20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:38.725364 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:38.817676 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778c8a90-4c3f-4f31-9183-79506ea76241 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62401c8e1457450590f4147e0665265a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:38.818337 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c8a90-4c3f-4f31-9183-79506ea76241 service nova] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:38.818643 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c8a90-4c3f-4f31-9183-79506ea76241 service nova] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:38.820066 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c8a90-4c3f-4f31-9183-79506ea76241 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:38.823461 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-778c8a90-4c3f-4f31-9183-79506ea76241 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:38.841808 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778c8a90-4c3f-4f31-9183-79506ea76241 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:38.843799 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778c8a90-4c3f-4f31-9183-79506ea76241 service nova] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:38.859114 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 957/1896] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:30:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 679 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:30:38.860736 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778c8a90-4c3f-4f31-9183-79506ea76241 service nova] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:38.862312 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-778c8a90-4c3f-4f31-9183-79506ea76241 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:39.035705 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12f536b-54da-4fdd-9c11-cf4b5230d20e None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:39.056474 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778c8a90-4c3f-4f31-9183-79506ea76241 service nova] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:39.061779 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6a500b-1050-45d0-b6db-3a3a592144e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:39.066647 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a500b-1050-45d0-b6db-3a3a592144e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:39.067351 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a500b-1050-45d0-b6db-3a3a592144e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:39.067977 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a500b-1050-45d0-b6db-3a3a592144e9 admin admin] PATH_INFO: `/v3/projects/dafbcb1b8fb04dc1b50d5cd0cdaeeb99` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:39.070100 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec806894-0460-46ab-957e-07aa3105fe86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e79503178ac54e62ba385467d5617ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:39.071031 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec806894-0460-46ab-957e-07aa3105fe86 service cinder] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:39.071318 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec806894-0460-46ab-957e-07aa3105fe86 service cinder] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:39.071592 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec806894-0460-46ab-957e-07aa3105fe86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:39.075893 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6a500b-1050-45d0-b6db-3a3a592144e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dafbcb1b8fb04dc1b50d5cd0cdaeeb99)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:39.083091 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6a500b-1050-45d0-b6db-3a3a592144e9 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:39.097464 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec806894-0460-46ab-957e-07aa3105fe86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:39.103703 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec806894-0460-46ab-957e-07aa3105fe86 service cinder] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:39.145137 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 958/1897] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:30:38 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:30:39.163198 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec806894-0460-46ab-957e-07aa3105fe86 service cinder] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:39.170469 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-ec806894-0460-46ab-957e-07aa3105fe86 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:39.217616 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec806894-0460-46ab-957e-07aa3105fe86 service cinder] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:39.234702 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff0c4ef-3a05-4039-bc9d-ec12255f82b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e79503178ac54e62ba385467d5617ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:39.235859 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff0c4ef-3a05-4039-bc9d-ec12255f82b1 service cinder] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:39.236356 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff0c4ef-3a05-4039-bc9d-ec12255f82b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:39.236855 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff0c4ef-3a05-4039-bc9d-ec12255f82b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:39.244873 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-cff0c4ef-3a05-4039-bc9d-ec12255f82b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:39.310801 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-8d6a500b-1050-45d0-b6db-3a3a592144e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dafbcb1b8fb04dc1b50d5cd0cdaeeb99', 'request_id': 'req-8d6a500b-1050-45d0-b6db-3a3a592144e9'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:39.343489 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-8d6a500b-1050-45d0-b6db-3a3a592144e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dafbcb1b8fb04dc1b50d5cd0cdaeeb99', 'request_id': 'req-8d6a500b-1050-45d0-b6db-3a3a592144e9'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:39.363801 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-8d6a500b-1050-45d0-b6db-3a3a592144e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dafbcb1b8fb04dc1b50d5cd0cdaeeb99', 'request_id': 'req-8d6a500b-1050-45d0-b6db-3a3a592144e9'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:39.380632 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-8d6a500b-1050-45d0-b6db-3a3a592144e9 admin admin] The token cache is being invalidate because project dafbcb1b8fb04dc1b50d5cd0cdaeeb99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:30:39.381073 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-8d6a500b-1050-45d0-b6db-3a3a592144e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:39.381964 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-8d6a500b-1050-45d0-b6db-3a3a592144e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:39.384147 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 940/1898] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:30:38 2022] DELETE /identity/v3/projects/dafbcb1b8fb04dc1b50d5cd0cdaeeb99 => generated 0 bytes in 724 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:30:39.385322 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6a500b-1050-45d0-b6db-3a3a592144e9 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:39.388894 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-8d6a500b-1050-45d0-b6db-3a3a592144e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:39.405387 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:39.502323 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6a500b-1050-45d0-b6db-3a3a592144e9 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:39.511302 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe6d1a8-8afe-402f-9564-9574be20009c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:39.513470 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe6d1a8-8afe-402f-9564-9574be20009c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:39.513470 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe6d1a8-8afe-402f-9564-9574be20009c admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:39.513470 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe6d1a8-8afe-402f-9564-9574be20009c admin admin] PATH_INFO: `/v3/users/656050c312a541a6a27a2225c0d78eac` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:39.526605 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe6d1a8-8afe-402f-9564-9574be20009c admin admin] RBAC: Authorizing `identity:delete_user(user_id=656050c312a541a6a27a2225c0d78eac)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:39.533240 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe6d1a8-8afe-402f-9564-9574be20009c admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:39.556660 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff0c4ef-3a05-4039-bc9d-ec12255f82b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:39.561874 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff0c4ef-3a05-4039-bc9d-ec12255f82b1 service cinder] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:39.591487 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 959/1899] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:30:39 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:30:39.592559 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff0c4ef-3a05-4039-bc9d-ec12255f82b1 service cinder] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:39.607711 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff0c4ef-3a05-4039-bc9d-ec12255f82b1 service cinder] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:39.614884 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3df441-02ab-4fb6-a90b-f3e8b245e290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:39.615942 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3df441-02ab-4fb6-a90b-f3e8b245e290 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:39.616253 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3df441-02ab-4fb6-a90b-f3e8b245e290 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:39.616972 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3df441-02ab-4fb6-a90b-f3e8b245e290 admin admin] PATH_INFO: `/v3/users/827595d8e69b427c8c7d6336b1bb1a38` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:39.619341 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3df441-02ab-4fb6-a90b-f3e8b245e290 admin admin] RBAC: Authorizing `identity:delete_user(user_id=827595d8e69b427c8c7d6336b1bb1a38)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:39.621991 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3df441-02ab-4fb6-a90b-f3e8b245e290 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:39.649441 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:39.655431 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-ffe6d1a8-8afe-402f-9564-9574be20009c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '656050c312a541a6a27a2225c0d78eac'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:39.717668 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-bd3df441-02ab-4fb6-a90b-f3e8b245e290 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '827595d8e69b427c8c7d6336b1bb1a38'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:39.735786 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-ffe6d1a8-8afe-402f-9564-9574be20009c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '656050c312a541a6a27a2225c0d78eac'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:39.737545 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-ffe6d1a8-8afe-402f-9564-9574be20009c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '656050c312a541a6a27a2225c0d78eac'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:39.760375 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-bd3df441-02ab-4fb6-a90b-f3e8b245e290 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '827595d8e69b427c8c7d6336b1bb1a38'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:39.768097 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-ffe6d1a8-8afe-402f-9564-9574be20009c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '656050c312a541a6a27a2225c0d78eac'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:39.775865 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-bd3df441-02ab-4fb6-a90b-f3e8b245e290 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '827595d8e69b427c8c7d6336b1bb1a38'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:39.778226 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-ffe6d1a8-8afe-402f-9564-9574be20009c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '656050c312a541a6a27a2225c0d78eac'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:39.779993 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-bd3df441-02ab-4fb6-a90b-f3e8b245e290 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '827595d8e69b427c8c7d6336b1bb1a38'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:39.799448 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-bd3df441-02ab-4fb6-a90b-f3e8b245e290 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '827595d8e69b427c8c7d6336b1bb1a38'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:39.810994 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 960/1900] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:30:39 2022] DELETE /identity/v3/users/827595d8e69b427c8c7d6336b1bb1a38 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:30:39.812294 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3df441-02ab-4fb6-a90b-f3e8b245e290 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:39.820277 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 941/1901] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:30:39 2022] DELETE /identity/v3/users/656050c312a541a6a27a2225c0d78eac => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:30:39.825511 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-bd3df441-02ab-4fb6-a90b-f3e8b245e290 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:39.836294 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec8201-3306-47e1-b07d-9b280bd3ddd3 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:39.837658 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec8201-3306-47e1-b07d-9b280bd3ddd3 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:39.840552 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec8201-3306-47e1-b07d-9b280bd3ddd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:39.936725 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-3cec8201-3306-47e1-b07d-9b280bd3ddd3 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:30:39.941096 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-3cec8201-3306-47e1-b07d-9b280bd3ddd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:40.032237 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3df441-02ab-4fb6-a90b-f3e8b245e290 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:40.093235 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 942/1902] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:30:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:30:40.111269 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cec8201-3306-47e1-b07d-9b280bd3ddd3 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:40.113887 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-3cec8201-3306-47e1-b07d-9b280bd3ddd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:40.207109 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:40.251039 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17891f0-3af7-486d-8d48-852b6298be0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:40.251653 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17891f0-3af7-486d-8d48-852b6298be0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:40.251932 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17891f0-3af7-486d-8d48-852b6298be0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:40.252204 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17891f0-3af7-486d-8d48-852b6298be0e admin admin] PATH_INFO: `/v3/projects/99a73559b52542798716692aed3c3af2` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:40.258835 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17891f0-3af7-486d-8d48-852b6298be0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=99a73559b52542798716692aed3c3af2)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:40.266293 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17891f0-3af7-486d-8d48-852b6298be0e admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:40.351323 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cec8201-3306-47e1-b07d-9b280bd3ddd3 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:40.377798 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625125c8-028f-4805-9c9b-8c7715ddff0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:40.381539 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625125c8-028f-4805-9c9b-8c7715ddff0c service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:40.382177 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625125c8-028f-4805-9c9b-8c7715ddff0c service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:40.382907 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625125c8-028f-4805-9c9b-8c7715ddff0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:40.451143 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625125c8-028f-4805-9c9b-8c7715ddff0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:40.462018 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625125c8-028f-4805-9c9b-8c7715ddff0c service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:40.486975 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-b17891f0-3af7-486d-8d48-852b6298be0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99a73559b52542798716692aed3c3af2', 'request_id': 'req-b17891f0-3af7-486d-8d48-852b6298be0e'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:40.508832 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-b17891f0-3af7-486d-8d48-852b6298be0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99a73559b52542798716692aed3c3af2', 'request_id': 'req-b17891f0-3af7-486d-8d48-852b6298be0e'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:40.528178 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 943/1903] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:30:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:30:40.538040 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-b17891f0-3af7-486d-8d48-852b6298be0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99a73559b52542798716692aed3c3af2', 'request_id': 'req-b17891f0-3af7-486d-8d48-852b6298be0e'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:40.581968 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-b17891f0-3af7-486d-8d48-852b6298be0e admin admin] The token cache is being invalidate because project 99a73559b52542798716692aed3c3af2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:30:40.582437 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-b17891f0-3af7-486d-8d48-852b6298be0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:40.588542 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-b17891f0-3af7-486d-8d48-852b6298be0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:40.600027 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 961/1904] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:30:39 2022] DELETE /identity/v3/projects/99a73559b52542798716692aed3c3af2 => generated 0 bytes in 781 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:30:40.601701 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3858805-fa3f-4e61-9122-cf95c64ea76c None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:40.602340 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3858805-fa3f-4e61-9122-cf95c64ea76c None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:40.603130 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3858805-fa3f-4e61-9122-cf95c64ea76c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:40.681010 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-b3858805-fa3f-4e61-9122-cf95c64ea76c None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:30:40.685265 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-b3858805-fa3f-4e61-9122-cf95c64ea76c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:40.923072 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 944/1905] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:30:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:30:40.938508 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e97130-33cb-41dd-b158-36db6eee96eb None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:40.939070 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e97130-33cb-41dd-b158-36db6eee96eb None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:40.939569 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e97130-33cb-41dd-b158-36db6eee96eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:41.012080 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-33e97130-33cb-41dd-b158-36db6eee96eb None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:30:41.014536 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-33e97130-33cb-41dd-b158-36db6eee96eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:41.059521 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 962/1906] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:30:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:30:41.060309 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3858805-fa3f-4e61-9122-cf95c64ea76c None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:41.084697 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3858805-fa3f-4e61-9122-cf95c64ea76c None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:41.099036 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3269b22-8120-475e-bd58-6c0c18cac46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:41.099992 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3269b22-8120-475e-bd58-6c0c18cac46a admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:41.101048 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3269b22-8120-475e-bd58-6c0c18cac46a admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:41.111220 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3269b22-8120-475e-bd58-6c0c18cac46a admin admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:41.113600 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3269b22-8120-475e-bd58-6c0c18cac46a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:30:41.118255 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3269b22-8120-475e-bd58-6c0c18cac46a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:41.120379 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3269b22-8120-475e-bd58-6c0c18cac46a admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:41.131685 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:41.233690 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 945/1907] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 12:30:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:30:41.236258 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e97130-33cb-41dd-b158-36db6eee96eb None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:41.278518 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e97130-33cb-41dd-b158-36db6eee96eb None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:41.310705 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b30354d-c337-4cb2-9b78-30156e09ea1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:41.311812 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30354d-c337-4cb2-9b78-30156e09ea1d admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:41.312289 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30354d-c337-4cb2-9b78-30156e09ea1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:41.312766 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30354d-c337-4cb2-9b78-30156e09ea1d admin admin] PATH_INFO: `/v3/projects` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:41.313928 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b30354d-c337-4cb2-9b78-30156e09ea1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:41.321672 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b30354d-c337-4cb2-9b78-30156e09ea1d admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:41.380281 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3269b22-8120-475e-bd58-6c0c18cac46a admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:41.386733 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-a3269b22-8120-475e-bd58-6c0c18cac46a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:41.432806 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3269b22-8120-475e-bd58-6c0c18cac46a admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:41.458585 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479a259c-718e-44ab-9e5e-e9650f4ce60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:41.459411 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a259c-718e-44ab-9e5e-e9650f4ce60a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:41.459694 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a259c-718e-44ab-9e5e-e9650f4ce60a admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:41.460499 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a259c-718e-44ab-9e5e-e9650f4ce60a admin admin] PATH_INFO: `/v3/projects/21bc323d7c4e4a41aba9ffce0209be81` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:41.463992 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479a259c-718e-44ab-9e5e-e9650f4ce60a admin admin] RBAC: Authorizing `identity:delete_project(project_id=21bc323d7c4e4a41aba9ffce0209be81)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:41.466666 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479a259c-718e-44ab-9e5e-e9650f4ce60a admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:41.493690 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 963/1908] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:30:41 2022] POST /identity/v3/projects => generated 385 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:30:41.496962 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b30354d-c337-4cb2-9b78-30156e09ea1d admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:41.630454 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-479a259c-718e-44ab-9e5e-e9650f4ce60a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21bc323d7c4e4a41aba9ffce0209be81', 'request_id': 'req-479a259c-718e-44ab-9e5e-e9650f4ce60a'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:41.674296 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-479a259c-718e-44ab-9e5e-e9650f4ce60a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21bc323d7c4e4a41aba9ffce0209be81', 'request_id': 'req-479a259c-718e-44ab-9e5e-e9650f4ce60a'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:41.735748 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-479a259c-718e-44ab-9e5e-e9650f4ce60a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21bc323d7c4e4a41aba9ffce0209be81', 'request_id': 'req-479a259c-718e-44ab-9e5e-e9650f4ce60a'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:41.760333 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-479a259c-718e-44ab-9e5e-e9650f4ce60a admin admin] The token cache is being invalidate because project 21bc323d7c4e4a41aba9ffce0209be81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:30:41.760934 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-479a259c-718e-44ab-9e5e-e9650f4ce60a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:41.762988 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-479a259c-718e-44ab-9e5e-e9650f4ce60a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:41.770286 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 946/1909] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:30:41 2022] DELETE /identity/v3/projects/21bc323d7c4e4a41aba9ffce0209be81 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:30:41.770286 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479a259c-718e-44ab-9e5e-e9650f4ce60a admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:41.774398 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-479a259c-718e-44ab-9e5e-e9650f4ce60a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:41.958381 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b30354d-c337-4cb2-9b78-30156e09ea1d admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:42.137757 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479a259c-718e-44ab-9e5e-e9650f4ce60a admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:42.165314 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebba455e-d518-4bb1-aa57-5ed473c6d20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:42.168029 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba455e-d518-4bb1-aa57-5ed473c6d20e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:42.180109 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba455e-d518-4bb1-aa57-5ed473c6d20e admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:42.180428 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba455e-d518-4bb1-aa57-5ed473c6d20e admin admin] PATH_INFO: `/v3/projects/a9d6bc13e35947889ceb9ebdce0c7d06` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:42.190680 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebba455e-d518-4bb1-aa57-5ed473c6d20e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9d6bc13e35947889ceb9ebdce0c7d06)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:42.209154 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebba455e-d518-4bb1-aa57-5ed473c6d20e admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:42.246824 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9419ecf1-4e24-4d81-95a8-c4175b9fbff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:42.247922 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9419ecf1-4e24-4d81-95a8-c4175b9fbff2 admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:42.248394 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9419ecf1-4e24-4d81-95a8-c4175b9fbff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:42.248878 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9419ecf1-4e24-4d81-95a8-c4175b9fbff2 admin admin] PATH_INFO: `/v3/users` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:42.250097 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9419ecf1-4e24-4d81-95a8-c4175b9fbff2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:42.256223 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9419ecf1-4e24-4d81-95a8-c4175b9fbff2 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:42.280340 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:42.312511 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 964/1910] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:30:41 2022] POST /identity/v3/users => generated 293 bytes in 817 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:30:42.314386 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030db31-40a9-4d35-ba35-aa9a7722f4de None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:42.315456 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030db31-40a9-4d35-ba35-aa9a7722f4de None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:42.315456 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030db31-40a9-4d35-ba35-aa9a7722f4de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:42.338514 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-ebba455e-d518-4bb1-aa57-5ed473c6d20e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9d6bc13e35947889ceb9ebdce0c7d06', 'request_id': 'req-ebba455e-d518-4bb1-aa57-5ed473c6d20e'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:42.355000 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-f030db31-40a9-4d35-ba35-aa9a7722f4de None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:30:42.355000 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-f030db31-40a9-4d35-ba35-aa9a7722f4de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:42.364639 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-ebba455e-d518-4bb1-aa57-5ed473c6d20e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9d6bc13e35947889ceb9ebdce0c7d06', 'request_id': 'req-ebba455e-d518-4bb1-aa57-5ed473c6d20e'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:42.395703 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-ebba455e-d518-4bb1-aa57-5ed473c6d20e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9d6bc13e35947889ceb9ebdce0c7d06', 'request_id': 'req-ebba455e-d518-4bb1-aa57-5ed473c6d20e'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:42.409766 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-ebba455e-d518-4bb1-aa57-5ed473c6d20e admin admin] The token cache is being invalidate because project a9d6bc13e35947889ceb9ebdce0c7d06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:30:42.411064 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-ebba455e-d518-4bb1-aa57-5ed473c6d20e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:42.415140 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-ebba455e-d518-4bb1-aa57-5ed473c6d20e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:42.421176 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 947/1911] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:30:41 2022] DELETE /identity/v3/projects/a9d6bc13e35947889ceb9ebdce0c7d06 => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:30:42.422036 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebba455e-d518-4bb1-aa57-5ed473c6d20e admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:42.428016 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-ebba455e-d518-4bb1-aa57-5ed473c6d20e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:42.450687 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:42.487549 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 965/1912] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:30:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:30:42.489865 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9768ce4-8426-4e3b-83cb-cdd7e1d9f234 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:42.490341 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9768ce4-8426-4e3b-83cb-cdd7e1d9f234 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:42.490774 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9768ce4-8426-4e3b-83cb-cdd7e1d9f234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:42.538555 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebba455e-d518-4bb1-aa57-5ed473c6d20e admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:42.546230 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf762a61-8da2-45d3-88f2-4265264ec6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:42.546932 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-e9768ce4-8426-4e3b-83cb-cdd7e1d9f234 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:30:42.548769 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf762a61-8da2-45d3-88f2-4265264ec6ea admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:42.549392 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf762a61-8da2-45d3-88f2-4265264ec6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:42.550132 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf762a61-8da2-45d3-88f2-4265264ec6ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:42.551124 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-e9768ce4-8426-4e3b-83cb-cdd7e1d9f234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:42.551888 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf762a61-8da2-45d3-88f2-4265264ec6ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:42.554359 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf762a61-8da2-45d3-88f2-4265264ec6ea admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:42.578312 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 966/1913] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:30:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:30:42.578312 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc9c70d-16e2-40d4-a8df-8df28177d767 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:42.578312 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc9c70d-16e2-40d4-a8df-8df28177d767 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:42.578312 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc9c70d-16e2-40d4-a8df-8df28177d767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:42.586256 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 948/1914] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:30:42.588306 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6808198a-9b98-47af-b440-f0632ae73261 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:42.588854 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6808198a-9b98-47af-b440-f0632ae73261 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:42.589540 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6808198a-9b98-47af-b440-f0632ae73261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:42.618166 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-6808198a-9b98-47af-b440-f0632ae73261 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:30:42.622140 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-6808198a-9b98-47af-b440-f0632ae73261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:42.640475 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 949/1915] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:30:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:30:42.643329 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6808198a-9b98-47af-b440-f0632ae73261 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:42.669729 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6808198a-9b98-47af-b440-f0632ae73261 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:42.694197 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba5ce89-12ea-47af-8833-ca345ad4f766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:42.694934 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba5ce89-12ea-47af-8833-ca345ad4f766 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:42.695221 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba5ce89-12ea-47af-8833-ca345ad4f766 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:42.695927 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba5ce89-12ea-47af-8833-ca345ad4f766 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:42.697052 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba5ce89-12ea-47af-8833-ca345ad4f766 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:42.705913 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-fcc9c70d-16e2-40d4-a8df-8df28177d767 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:30:42.716596 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba5ce89-12ea-47af-8833-ca345ad4f766 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:42.751479 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 950/1916] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:30:42.754733 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba5ce89-12ea-47af-8833-ca345ad4f766 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:42.773128 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-fcc9c70d-16e2-40d4-a8df-8df28177d767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:42.790366 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba5ce89-12ea-47af-8833-ca345ad4f766 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:42.807038 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faf3041-3f68-4b7d-a09b-7ef9b4ee04dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:42.808669 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf3041-3f68-4b7d-a09b-7ef9b4ee04dc admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:42.808975 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf3041-3f68-4b7d-a09b-7ef9b4ee04dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:42.809252 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf3041-3f68-4b7d-a09b-7ef9b4ee04dc admin admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:42.809950 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faf3041-3f68-4b7d-a09b-7ef9b4ee04dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:30:42.810360 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faf3041-3f68-4b7d-a09b-7ef9b4ee04dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:42.812611 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faf3041-3f68-4b7d-a09b-7ef9b4ee04dc admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:42.820982 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 967/1917] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:30:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:30:42.822594 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc9c70d-16e2-40d4-a8df-8df28177d767 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:42.853510 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 951/1918] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 12:30:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:30:42.853510 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faf3041-3f68-4b7d-a09b-7ef9b4ee04dc admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:42.872221 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc9c70d-16e2-40d4-a8df-8df28177d767 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:42.876881 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faf3041-3f68-4b7d-a09b-7ef9b4ee04dc admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:42.880622 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb7bc7e-3ad2-4e30-afb9-738d54ea8cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:42.881851 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7bc7e-3ad2-4e30-afb9-738d54ea8cc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:42.882388 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7bc7e-3ad2-4e30-afb9-738d54ea8cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:42.882961 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7bc7e-3ad2-4e30-afb9-738d54ea8cc8 admin admin] PATH_INFO: `/v3/projects/1b6e14f7b6bc4a7f8ffa16b675559cee/users/3037a9ff8c46499797cc5f2a27553b63/roles/b5cfd7a855a448359e9017f51d32b6fc` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:42.893598 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4931313c-032f-4b9b-8025-90fb1137eeb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:42.894607 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4931313c-032f-4b9b-8025-90fb1137eeb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:42.895063 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4931313c-032f-4b9b-8025-90fb1137eeb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:42.895477 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4931313c-032f-4b9b-8025-90fb1137eeb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:42.896472 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4931313c-032f-4b9b-8025-90fb1137eeb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:30:42.896899 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4931313c-032f-4b9b-8025-90fb1137eeb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:42.901396 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4931313c-032f-4b9b-8025-90fb1137eeb7 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:42.914440 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb7bc7e-3ad2-4e30-afb9-738d54ea8cc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b6e14f7b6bc4a7f8ffa16b675559cee, user_id=3037a9ff8c46499797cc5f2a27553b63, role_id=b5cfd7a855a448359e9017f51d32b6fc)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:42.919161 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb7bc7e-3ad2-4e30-afb9-738d54ea8cc8 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:42.944215 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 968/1919] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:30:42 2022] PUT /identity/v3/projects/1b6e14f7b6bc4a7f8ffa16b675559cee/users/3037a9ff8c46499797cc5f2a27553b63/roles/b5cfd7a855a448359e9017f51d32b6fc => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:30:42.946260 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb7bc7e-3ad2-4e30-afb9-738d54ea8cc8 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:42.977852 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 952/1920] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 12:30:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:30:42.982804 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f7eaf5-c757-48aa-9332-4054f78b93eb None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:42.983196 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f7eaf5-c757-48aa-9332-4054f78b93eb None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:42.996398 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f7eaf5-c757-48aa-9332-4054f78b93eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:43.091320 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-29f7eaf5-c757-48aa-9332-4054f78b93eb None None] MFA Rules not processed for user `3037a9ff8c46499797cc5f2a27553b63`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:30:43.099576 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-29f7eaf5-c757-48aa-9332-4054f78b93eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:43.163935 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb7bc7e-3ad2-4e30-afb9-738d54ea8cc8 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:43.185621 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aced52-4f62-41b0-a663-fe6d27a8ee38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:43.186487 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aced52-4f62-41b0-a663-fe6d27a8ee38 admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:43.187762 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aced52-4f62-41b0-a663-fe6d27a8ee38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:43.188192 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aced52-4f62-41b0-a663-fe6d27a8ee38 admin admin] PATH_INFO: `/v3/projects` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:43.189000 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aced52-4f62-41b0-a663-fe6d27a8ee38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:43.192648 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aced52-4f62-41b0-a663-fe6d27a8ee38 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:43.278425 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 969/1921] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:30:42 2022] POST /identity/v3/projects => generated 369 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:30:43.280154 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aced52-4f62-41b0-a663-fe6d27a8ee38 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:43.387264 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:43.398166 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 953/1922] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:30:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 418 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:30:43.398166 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f7eaf5-c757-48aa-9332-4054f78b93eb None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:43.433759 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aced52-4f62-41b0-a663-fe6d27a8ee38 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:43.446882 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f7eaf5-c757-48aa-9332-4054f78b93eb None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:43.447124 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e555530-040a-4a16-b126-35b964a91b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:43.447481 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e555530-040a-4a16-b126-35b964a91b94 admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:43.450127 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e555530-040a-4a16-b126-35b964a91b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:43.451079 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e555530-040a-4a16-b126-35b964a91b94 admin admin] PATH_INFO: `/v3/projects` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:43.454950 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d31fdd-749a-4705-b29b-4c09b8e4e204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:43.456166 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d31fdd-749a-4705-b29b-4c09b8e4e204 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:43.457847 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d31fdd-749a-4705-b29b-4c09b8e4e204 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:43.458362 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d31fdd-749a-4705-b29b-4c09b8e4e204 admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:43.458528 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e555530-040a-4a16-b126-35b964a91b94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:43.461676 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d31fdd-749a-4705-b29b-4c09b8e4e204 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:43.465139 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d31fdd-749a-4705-b29b-4c09b8e4e204 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:43.473225 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e555530-040a-4a16-b126-35b964a91b94 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:43.541533 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 954/1923] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:30:43 2022] POST /identity/v3/users => generated 285 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:30:43.542314 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d31fdd-749a-4705-b29b-4c09b8e4e204 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:43.561552 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 970/1924] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:30:43 2022] POST /identity/v3/projects => generated 381 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:30:43.561552 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e555530-040a-4a16-b126-35b964a91b94 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:43.574613 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d31fdd-749a-4705-b29b-4c09b8e4e204 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:43.661012 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:43.717721 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e555530-040a-4a16-b126-35b964a91b94 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:43.721617 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae4d16a-dc1e-4b55-807f-8f9477c15b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:43.723201 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae4d16a-dc1e-4b55-807f-8f9477c15b8e admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:43.723494 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae4d16a-dc1e-4b55-807f-8f9477c15b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:43.723773 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae4d16a-dc1e-4b55-807f-8f9477c15b8e admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:43.724776 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae4d16a-dc1e-4b55-807f-8f9477c15b8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:43.727004 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae4d16a-dc1e-4b55-807f-8f9477c15b8e admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:43.733369 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e94ada-a4d2-479e-a611-484ecf0348f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:43.734153 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e94ada-a4d2-479e-a611-484ecf0348f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:43.734433 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e94ada-a4d2-479e-a611-484ecf0348f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:43.734706 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e94ada-a4d2-479e-a611-484ecf0348f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:43.736530 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e94ada-a4d2-479e-a611-484ecf0348f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:43.740745 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e94ada-a4d2-479e-a611-484ecf0348f1 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:43.765213 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 971/1925] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:30:43 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:30:43.769728 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e94ada-a4d2-479e-a611-484ecf0348f1 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:43.788504 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 955/1926] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:30:43 2022] POST /identity/v3/projects => generated 387 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:30:43.788504 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae4d16a-dc1e-4b55-807f-8f9477c15b8e admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:43.791489 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e94ada-a4d2-479e-a611-484ecf0348f1 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:43.917205 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae4d16a-dc1e-4b55-807f-8f9477c15b8e admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:43.923725 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39376bf-b9ef-46b3-b729-fc9e3f4253aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:43.924467 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39376bf-b9ef-46b3-b729-fc9e3f4253aa admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:43.924646 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ee3c8e-fb5d-4f8b-ac77-a99196bbd57c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:43.924837 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39376bf-b9ef-46b3-b729-fc9e3f4253aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:43.925099 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39376bf-b9ef-46b3-b729-fc9e3f4253aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:43.925468 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee3c8e-fb5d-4f8b-ac77-a99196bbd57c admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:43.925709 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39376bf-b9ef-46b3-b729-fc9e3f4253aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:43.925861 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee3c8e-fb5d-4f8b-ac77-a99196bbd57c admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:43.926303 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee3c8e-fb5d-4f8b-ac77-a99196bbd57c admin admin] PATH_INFO: `/v3/users` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:43.927377 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ee3c8e-fb5d-4f8b-ac77-a99196bbd57c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:43.927558 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39376bf-b9ef-46b3-b729-fc9e3f4253aa admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:43.930081 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ee3c8e-fb5d-4f8b-ac77-a99196bbd57c admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:43.944560 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 956/1927] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:30:43 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:30:43.948014 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39376bf-b9ef-46b3-b729-fc9e3f4253aa admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:43.962029 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39376bf-b9ef-46b3-b729-fc9e3f4253aa admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:43.971280 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 972/1928] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:30:43 2022] POST /identity/v3/users => generated 291 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:30:43.971280 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ee3c8e-fb5d-4f8b-ac77-a99196bbd57c admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:43.976314 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67256121-cc9f-4666-93f1-aa93654a999f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:43.977494 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67256121-cc9f-4666-93f1-aa93654a999f admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:43.977950 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67256121-cc9f-4666-93f1-aa93654a999f admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:43.978386 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67256121-cc9f-4666-93f1-aa93654a999f admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:43.980706 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67256121-cc9f-4666-93f1-aa93654a999f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:43.983303 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67256121-cc9f-4666-93f1-aa93654a999f admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:43.987113 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ee3c8e-fb5d-4f8b-ac77-a99196bbd57c admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:43.998579 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87f19fd-e26d-4fe3-8db5-0e1bed40ea7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:43.999787 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f19fd-e26d-4fe3-8db5-0e1bed40ea7a admin admin] REQUEST_METHOD: `PUT` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:44.000307 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f19fd-e26d-4fe3-8db5-0e1bed40ea7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:44.001189 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f19fd-e26d-4fe3-8db5-0e1bed40ea7a admin admin] PATH_INFO: `/v3/projects/ede2f6ce771948fe901ab4bd9bbbd2f9/users/ad745262b78346b5846a3505c3da9f0c/roles/b5cfd7a855a448359e9017f51d32b6fc` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:44.028475 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 957/1929] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:30:43 2022] POST /identity/v3/users => generated 300 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:30:44.031620 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67256121-cc9f-4666-93f1-aa93654a999f admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:44.032231 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87f19fd-e26d-4fe3-8db5-0e1bed40ea7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ede2f6ce771948fe901ab4bd9bbbd2f9, user_id=ad745262b78346b5846a3505c3da9f0c, role_id=b5cfd7a855a448359e9017f51d32b6fc)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:44.037875 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87f19fd-e26d-4fe3-8db5-0e1bed40ea7a admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:44.050642 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67256121-cc9f-4666-93f1-aa93654a999f admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:44.059411 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 973/1930] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:30:43 2022] PUT /identity/v3/projects/ede2f6ce771948fe901ab4bd9bbbd2f9/users/ad745262b78346b5846a3505c3da9f0c/roles/b5cfd7a855a448359e9017f51d32b6fc => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:30:44.060874 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87f19fd-e26d-4fe3-8db5-0e1bed40ea7a admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:44.111001 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:44.159859 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc685a2-e2d7-4cad-a83b-195b7b5605fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:44.161271 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc685a2-e2d7-4cad-a83b-195b7b5605fc admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:44.161624 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc685a2-e2d7-4cad-a83b-195b7b5605fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:44.161874 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc685a2-e2d7-4cad-a83b-195b7b5605fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:44.162920 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc685a2-e2d7-4cad-a83b-195b7b5605fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:44.164735 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc685a2-e2d7-4cad-a83b-195b7b5605fc admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:44.179356 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87f19fd-e26d-4fe3-8db5-0e1bed40ea7a admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:44.179659 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 958/1931] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:30:44 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:30:44.180345 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc685a2-e2d7-4cad-a83b-195b7b5605fc admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:44.182308 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-efc685a2-e2d7-4cad-a83b-195b7b5605fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:44.189517 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd6505f-0da3-48c9-be43-159f607d3af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:44.190567 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd6505f-0da3-48c9-be43-159f607d3af2 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:44.191840 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd6505f-0da3-48c9-be43-159f607d3af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:44.191840 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd6505f-0da3-48c9-be43-159f607d3af2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:44.192666 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd6505f-0da3-48c9-be43-159f607d3af2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:44.195617 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd6505f-0da3-48c9-be43-159f607d3af2 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:44.199724 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc685a2-e2d7-4cad-a83b-195b7b5605fc admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:44.210912 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 974/1932] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:30:44 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:30:44.214228 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f769dd3b-d881-4f23-a6bc-8ef74dc6615e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:44.216061 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f769dd3b-d881-4f23-a6bc-8ef74dc6615e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:44.216483 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f769dd3b-d881-4f23-a6bc-8ef74dc6615e admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:44.216786 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f769dd3b-d881-4f23-a6bc-8ef74dc6615e admin admin] PATH_INFO: `/v3/users/9cde4d05a84b4b0cb6d998db66c14c21` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:44.218193 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f769dd3b-d881-4f23-a6bc-8ef74dc6615e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cde4d05a84b4b0cb6d998db66c14c21)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:44.220329 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffdcf07-514b-478a-930a-943d3a91dee8 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:44.220620 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f769dd3b-d881-4f23-a6bc-8ef74dc6615e admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:44.220884 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffdcf07-514b-478a-930a-943d3a91dee8 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:44.221391 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffdcf07-514b-478a-930a-943d3a91dee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:44.263191 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:44.280548 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-5ffdcf07-514b-478a-930a-943d3a91dee8 None None] MFA Rules not processed for user `ad745262b78346b5846a3505c3da9f0c`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:30:44.283809 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-5ffdcf07-514b-478a-930a-943d3a91dee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:44.299350 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-f769dd3b-d881-4f23-a6bc-8ef74dc6615e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cde4d05a84b4b0cb6d998db66c14c21'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:44.320982 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-f769dd3b-d881-4f23-a6bc-8ef74dc6615e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cde4d05a84b4b0cb6d998db66c14c21'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:44.321841 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-f769dd3b-d881-4f23-a6bc-8ef74dc6615e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cde4d05a84b4b0cb6d998db66c14c21'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:44.333969 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-f769dd3b-d881-4f23-a6bc-8ef74dc6615e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cde4d05a84b4b0cb6d998db66c14c21'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:44.336040 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-f769dd3b-d881-4f23-a6bc-8ef74dc6615e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cde4d05a84b4b0cb6d998db66c14c21'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:44.375349 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 959/1933] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:30:44 2022] DELETE /identity/v3/users/9cde4d05a84b4b0cb6d998db66c14c21 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:30:44.378246 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f769dd3b-d881-4f23-a6bc-8ef74dc6615e admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:44.381321 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-f769dd3b-d881-4f23-a6bc-8ef74dc6615e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:44.418624 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 975/1934] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:30:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:30:44.418624 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffdcf07-514b-478a-930a-943d3a91dee8 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:44.418624 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-5ffdcf07-514b-478a-930a-943d3a91dee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:44.432859 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffdcf07-514b-478a-930a-943d3a91dee8 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:44.513097 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f769dd3b-d881-4f23-a6bc-8ef74dc6615e admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:44.521544 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3327767-9982-4bfb-9070-104095f4b3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:44.521964 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47350876-7b40-480a-a258-08791ce82552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:44.522420 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3327767-9982-4bfb-9070-104095f4b3ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:44.522788 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3327767-9982-4bfb-9070-104095f4b3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:44.523139 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47350876-7b40-480a-a258-08791ce82552 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:44.523354 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3327767-9982-4bfb-9070-104095f4b3ff admin admin] PATH_INFO: `/v3/projects/6c582f888f0f4e06a5397785b16a6e1c/users/6b2f55894dc5432f9ec3c52132b0510b/roles/a332ef951db949b0bad7019fbd28a1b9` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:44.523607 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47350876-7b40-480a-a258-08791ce82552 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:44.524063 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47350876-7b40-480a-a258-08791ce82552 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:44.525227 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47350876-7b40-480a-a258-08791ce82552 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:44.528975 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47350876-7b40-480a-a258-08791ce82552 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:44.553146 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 960/1935] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:30:44 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:30:44.555711 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2713b638-7f00-4bd2-b1f2-21aa4f93b8dd None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:44.556171 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2713b638-7f00-4bd2-b1f2-21aa4f93b8dd None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:44.556615 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2713b638-7f00-4bd2-b1f2-21aa4f93b8dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:44.574465 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3327767-9982-4bfb-9070-104095f4b3ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c582f888f0f4e06a5397785b16a6e1c, user_id=6b2f55894dc5432f9ec3c52132b0510b, role_id=a332ef951db949b0bad7019fbd28a1b9)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:44.583867 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3327767-9982-4bfb-9070-104095f4b3ff admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:44.596316 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-2713b638-7f00-4bd2-b1f2-21aa4f93b8dd None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:30:44.598418 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-2713b638-7f00-4bd2-b1f2-21aa4f93b8dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:44.604870 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 976/1936] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:30:44 2022] PUT /identity/v3/projects/6c582f888f0f4e06a5397785b16a6e1c/users/6b2f55894dc5432f9ec3c52132b0510b/roles/a332ef951db949b0bad7019fbd28a1b9 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:30:44.607502 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3327767-9982-4bfb-9070-104095f4b3ff admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:44.609628 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-a3327767-9982-4bfb-9070-104095f4b3ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:44.682689 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:44.818246 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 961/1937] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:30:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:30:44.818793 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3327767-9982-4bfb-9070-104095f4b3ff admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:44.820377 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2713b638-7f00-4bd2-b1f2-21aa4f93b8dd None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:44.827973 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a754ea-3079-4825-a819-b6d9339a1536 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8b3bb8f689b45b99ed43f672264a26d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:44.828428 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a754ea-3079-4825-a819-b6d9339a1536 service glance] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:44.828790 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a754ea-3079-4825-a819-b6d9339a1536 service glance] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:44.829689 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a754ea-3079-4825-a819-b6d9339a1536 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:44.859034 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2713b638-7f00-4bd2-b1f2-21aa4f93b8dd None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:44.886000 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0081497b-6946-4d0f-83e7-6e4dc2eed26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:44.887753 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0081497b-6946-4d0f-83e7-6e4dc2eed26d admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:44.888371 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0081497b-6946-4d0f-83e7-6e4dc2eed26d admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:44.888725 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0081497b-6946-4d0f-83e7-6e4dc2eed26d admin admin] PATH_INFO: `/v3/projects/292e3f5d869f4526ac66564c8c7e0366/users/a2faf871704c46808c185d1bd1c67165/roles/b5cfd7a855a448359e9017f51d32b6fc` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:44.979382 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0081497b-6946-4d0f-83e7-6e4dc2eed26d admin admin] RBAC: Authorizing `identity:create_grant(project_id=292e3f5d869f4526ac66564c8c7e0366, user_id=a2faf871704c46808c185d1bd1c67165, role_id=b5cfd7a855a448359e9017f51d32b6fc)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:44.997638 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0081497b-6946-4d0f-83e7-6e4dc2eed26d admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:45.091211 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a754ea-3079-4825-a819-b6d9339a1536 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:45.091485 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 962/1938] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:30:44 2022] PUT /identity/v3/projects/292e3f5d869f4526ac66564c8c7e0366/users/a2faf871704c46808c185d1bd1c67165/roles/b5cfd7a855a448359e9017f51d32b6fc => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:30:45.091485 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0081497b-6946-4d0f-83e7-6e4dc2eed26d admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:45.101964 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a754ea-3079-4825-a819-b6d9339a1536 service glance] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:45.132914 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 977/1939] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:30:44 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:30:45.143740 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a754ea-3079-4825-a819-b6d9339a1536 service glance] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:45.146885 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-99a754ea-3079-4825-a819-b6d9339a1536 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:45.162525 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:45.365459 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a754ea-3079-4825-a819-b6d9339a1536 service glance] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:45.377249 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0081497b-6946-4d0f-83e7-6e4dc2eed26d admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:45.415281 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7148cf8d-5d36-46d0-ad0f-127305a3be3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:45.416338 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7148cf8d-5d36-46d0-ad0f-127305a3be3c admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:45.416786 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7148cf8d-5d36-46d0-ad0f-127305a3be3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:45.417246 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7148cf8d-5d36-46d0-ad0f-127305a3be3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:45.429506 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7148cf8d-5d36-46d0-ad0f-127305a3be3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:45.446553 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7148cf8d-5d36-46d0-ad0f-127305a3be3c admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:45.475298 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39de2893-6535-4a95-8281-16ce135b969f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:45.476477 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de2893-6535-4a95-8281-16ce135b969f service neutron] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:45.476887 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de2893-6535-4a95-8281-16ce135b969f service neutron] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:45.477278 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de2893-6535-4a95-8281-16ce135b969f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:45.486011 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 963/1940] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:30:45 2022] GET /identity/v3/roles => generated 1420 bytes in 398 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:30:45.488393 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8f087-eea7-42d6-bb3f-e587432a5012 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:45.488879 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8f087-eea7-42d6-bb3f-e587432a5012 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:45.489662 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8f087-eea7-42d6-bb3f-e587432a5012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:45.500512 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39de2893-6535-4a95-8281-16ce135b969f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:45.503134 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39de2893-6535-4a95-8281-16ce135b969f service neutron] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:45.524619 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 978/1941] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:30:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:30:45.526275 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39de2893-6535-4a95-8281-16ce135b969f service neutron] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:45.546933 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39de2893-6535-4a95-8281-16ce135b969f service neutron] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:45.561699 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50866d9-f650-445c-afc4-1539075c3711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:45.562804 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50866d9-f650-445c-afc4-1539075c3711 admin admin] REQUEST_METHOD: `PUT` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:45.563689 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50866d9-f650-445c-afc4-1539075c3711 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:45.564223 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50866d9-f650-445c-afc4-1539075c3711 admin admin] PATH_INFO: `/v3/projects/6c582f888f0f4e06a5397785b16a6e1c/users/6b2f55894dc5432f9ec3c52132b0510b/roles/a332ef951db949b0bad7019fbd28a1b9` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:45.567909 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50866d9-f650-445c-afc4-1539075c3711 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c582f888f0f4e06a5397785b16a6e1c, user_id=6b2f55894dc5432f9ec3c52132b0510b, role_id=a332ef951db949b0bad7019fbd28a1b9)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:45.574462 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50866d9-f650-445c-afc4-1539075c3711 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:45.599369 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 979/1942] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:30:45 2022] PUT /identity/v3/projects/6c582f888f0f4e06a5397785b16a6e1c/users/6b2f55894dc5432f9ec3c52132b0510b/roles/a332ef951db949b0bad7019fbd28a1b9 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:30:45.614675 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-a3b8f087-eea7-42d6-bb3f-e587432a5012 None None] MFA Rules not processed for user `a2faf871704c46808c185d1bd1c67165`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:30:45.624446 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-a3b8f087-eea7-42d6-bb3f-e587432a5012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:45.625971 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b06d9-7b30-488f-a736-3144ad7d6234 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:45.626537 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b06d9-7b30-488f-a736-3144ad7d6234 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:45.627048 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b06d9-7b30-488f-a736-3144ad7d6234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:45.699643 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-012b06d9-7b30-488f-a736-3144ad7d6234 None None] MFA Rules not processed for user `6b2f55894dc5432f9ec3c52132b0510b`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:30:45.701919 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-012b06d9-7b30-488f-a736-3144ad7d6234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:45.711120 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:45.907055 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 964/1943] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:30:45 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 420 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:30:45.910397 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b8f087-eea7-42d6-bb3f-e587432a5012 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:45.911183 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 980/1944] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:30:45 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:30:45.929697 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012b06d9-7b30-488f-a736-3144ad7d6234 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:45.932682 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-012b06d9-7b30-488f-a736-3144ad7d6234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:46.094781 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012b06d9-7b30-488f-a736-3144ad7d6234 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:46.099923 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b8f087-eea7-42d6-bb3f-e587432a5012 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:46.100286 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd143b-3533-4fd2-9294-8790c00e6017 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e79503178ac54e62ba385467d5617ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:46.100946 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd143b-3533-4fd2-9294-8790c00e6017 service cinder] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:46.101402 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd143b-3533-4fd2-9294-8790c00e6017 service cinder] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:46.101571 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd143b-3533-4fd2-9294-8790c00e6017 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:46.117919 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcd143b-3533-4fd2-9294-8790c00e6017 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:46.118936 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcd143b-3533-4fd2-9294-8790c00e6017 service cinder] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:46.121785 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ebe49-0b0e-4898-afe2-9f9d86c60fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:46.122733 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ebe49-0b0e-4898-afe2-9f9d86c60fa2 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:46.123333 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ebe49-0b0e-4898-afe2-9f9d86c60fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:46.123749 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ebe49-0b0e-4898-afe2-9f9d86c60fa2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:46.125209 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96ebe49-0b0e-4898-afe2-9f9d86c60fa2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:46.128350 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96ebe49-0b0e-4898-afe2-9f9d86c60fa2 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:46.146377 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 981/1945] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:30:45 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:30:46.147569 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd143b-3533-4fd2-9294-8790c00e6017 service cinder] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:46.149266 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-efcd143b-3533-4fd2-9294-8790c00e6017 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:46.165991 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd143b-3533-4fd2-9294-8790c00e6017 service cinder] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:46.172258 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8333dd2f-c8d8-4041-9f67-0434acb681ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:46.173070 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8333dd2f-c8d8-4041-9f67-0434acb681ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:46.173274 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8333dd2f-c8d8-4041-9f67-0434acb681ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:46.173522 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8333dd2f-c8d8-4041-9f67-0434acb681ac admin admin] PATH_INFO: `/v3/projects/f5a5bf9154b947c0b28d63bdb87093bb` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:46.175993 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8333dd2f-c8d8-4041-9f67-0434acb681ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5a5bf9154b947c0b28d63bdb87093bb)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:46.178649 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8333dd2f-c8d8-4041-9f67-0434acb681ac admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:46.185692 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 965/1946] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:30:45 2022] POST /identity/v3/projects => generated 381 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:30:46.192206 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ebe49-0b0e-4898-afe2-9f9d86c60fa2 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:46.249456 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:46.302824 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-8333dd2f-c8d8-4041-9f67-0434acb681ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5a5bf9154b947c0b28d63bdb87093bb', 'request_id': 'req-8333dd2f-c8d8-4041-9f67-0434acb681ac'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:46.303140 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ebe49-0b0e-4898-afe2-9f9d86c60fa2 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:46.312937 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-8333dd2f-c8d8-4041-9f67-0434acb681ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5a5bf9154b947c0b28d63bdb87093bb', 'request_id': 'req-8333dd2f-c8d8-4041-9f67-0434acb681ac'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:46.321664 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-8333dd2f-c8d8-4041-9f67-0434acb681ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5a5bf9154b947c0b28d63bdb87093bb', 'request_id': 'req-8333dd2f-c8d8-4041-9f67-0434acb681ac'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:46.341728 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-8333dd2f-c8d8-4041-9f67-0434acb681ac admin admin] The token cache is being invalidate because project f5a5bf9154b947c0b28d63bdb87093bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:30:46.342004 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-8333dd2f-c8d8-4041-9f67-0434acb681ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:46.343267 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-8333dd2f-c8d8-4041-9f67-0434acb681ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:46.345587 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 982/1947] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:30:46 2022] DELETE /identity/v3/projects/f5a5bf9154b947c0b28d63bdb87093bb => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:30:46.347349 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8333dd2f-c8d8-4041-9f67-0434acb681ac admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:46.348853 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-8333dd2f-c8d8-4041-9f67-0434acb681ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:46.401209 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:46.500857 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8333dd2f-c8d8-4041-9f67-0434acb681ac admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:46.514892 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5688b92-dc3f-48a5-8542-8e23a5640d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:46.515705 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5688b92-dc3f-48a5-8542-8e23a5640d78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:46.516519 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5688b92-dc3f-48a5-8542-8e23a5640d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:46.516519 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5688b92-dc3f-48a5-8542-8e23a5640d78 admin admin] PATH_INFO: `/v3/users/3037a9ff8c46499797cc5f2a27553b63` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:46.517766 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5688b92-dc3f-48a5-8542-8e23a5640d78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3037a9ff8c46499797cc5f2a27553b63)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:46.520206 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5688b92-dc3f-48a5-8542-8e23a5640d78 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:46.540134 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c3b944-1006-4e8b-a856-afea5a77b182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:46.540329 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c3b944-1006-4e8b-a856-afea5a77b182 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:46.540717 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c3b944-1006-4e8b-a856-afea5a77b182 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:46.541020 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c3b944-1006-4e8b-a856-afea5a77b182 admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:46.541840 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c3b944-1006-4e8b-a856-afea5a77b182 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:46.565333 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c3b944-1006-4e8b-a856-afea5a77b182 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:46.595973 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-a5688b92-dc3f-48a5-8542-8e23a5640d78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3037a9ff8c46499797cc5f2a27553b63'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:46.608825 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 966/1948] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:30:46 2022] POST /identity/v3/users => generated 297 bytes in 413 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:30:46.608825 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c3b944-1006-4e8b-a856-afea5a77b182 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:46.610629 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-46c3b944-1006-4e8b-a856-afea5a77b182 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:46.615214 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-a5688b92-dc3f-48a5-8542-8e23a5640d78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3037a9ff8c46499797cc5f2a27553b63'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:46.627370 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-a5688b92-dc3f-48a5-8542-8e23a5640d78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3037a9ff8c46499797cc5f2a27553b63'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:46.628218 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-a5688b92-dc3f-48a5-8542-8e23a5640d78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3037a9ff8c46499797cc5f2a27553b63'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:46.639226 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-a5688b92-dc3f-48a5-8542-8e23a5640d78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3037a9ff8c46499797cc5f2a27553b63'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:46.650188 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 983/1949] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:30:46 2022] DELETE /identity/v3/users/3037a9ff8c46499797cc5f2a27553b63 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:30:46.650573 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c3b944-1006-4e8b-a856-afea5a77b182 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:46.651123 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5688b92-dc3f-48a5-8542-8e23a5640d78 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:46.653539 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-a5688b92-dc3f-48a5-8542-8e23a5640d78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:46.762648 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5688b92-dc3f-48a5-8542-8e23a5640d78 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:46.769697 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0557312-8fce-40f1-948a-7b8ddfcd3261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:46.770728 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0557312-8fce-40f1-948a-7b8ddfcd3261 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:46.771233 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0557312-8fce-40f1-948a-7b8ddfcd3261 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:46.771687 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0557312-8fce-40f1-948a-7b8ddfcd3261 admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:46.772848 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0557312-8fce-40f1-948a-7b8ddfcd3261 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:46.775802 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0557312-8fce-40f1-948a-7b8ddfcd3261 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:46.811975 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 984/1950] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:30:46 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:30:46.814684 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e31b71-b60a-4248-8974-b761a1ef3969 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:46.817837 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e31b71-b60a-4248-8974-b761a1ef3969 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:46.818174 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e31b71-b60a-4248-8974-b761a1ef3969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:46.831210 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dc3e85-b720-4e8c-bd18-424d85cf02d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:46.832018 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc3e85-b720-4e8c-bd18-424d85cf02d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:46.832353 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc3e85-b720-4e8c-bd18-424d85cf02d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:46.832698 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc3e85-b720-4e8c-bd18-424d85cf02d7 admin admin] PATH_INFO: `/v3/users/15054f48ba1246e79fb0d5a342d808d2` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:46.834566 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dc3e85-b720-4e8c-bd18-424d85cf02d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15054f48ba1246e79fb0d5a342d808d2)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:46.836759 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dc3e85-b720-4e8c-bd18-424d85cf02d7 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:46.871260 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-e0e31b71-b60a-4248-8974-b761a1ef3969 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:30:46.873907 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-e0e31b71-b60a-4248-8974-b761a1ef3969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:46.894208 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 985/1951] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:30:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:30:46.917256 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e31b71-b60a-4248-8974-b761a1ef3969 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:46.919942 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-27dc3e85-b720-4e8c-bd18-424d85cf02d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15054f48ba1246e79fb0d5a342d808d2'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:46.937865 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e31b71-b60a-4248-8974-b761a1ef3969 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:46.943920 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-27dc3e85-b720-4e8c-bd18-424d85cf02d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15054f48ba1246e79fb0d5a342d808d2'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:46.945945 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-27dc3e85-b720-4e8c-bd18-424d85cf02d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15054f48ba1246e79fb0d5a342d808d2'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:46.946690 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:46.956883 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-27dc3e85-b720-4e8c-bd18-424d85cf02d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15054f48ba1246e79fb0d5a342d808d2'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:46.958392 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-27dc3e85-b720-4e8c-bd18-424d85cf02d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15054f48ba1246e79fb0d5a342d808d2'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:46.972169 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b1efe9-c04e-4d52-b1a4-daa780477d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:46.975340 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1efe9-c04e-4d52-b1a4-daa780477d62 admin admin] REQUEST_METHOD: `PUT` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:46.975847 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1efe9-c04e-4d52-b1a4-daa780477d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:46.976351 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1efe9-c04e-4d52-b1a4-daa780477d62 admin admin] PATH_INFO: `/v3/projects/92b45d2909a44897a41134e6d9026dc9/users/8debfb184e9344c7a0da5c638a00fcd4/roles/a332ef951db949b0bad7019fbd28a1b9` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:46.983776 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 967/1952] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:30:46 2022] DELETE /identity/v3/users/15054f48ba1246e79fb0d5a342d808d2 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:30:46.985106 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dc3e85-b720-4e8c-bd18-424d85cf02d7 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:46.988647 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-27dc3e85-b720-4e8c-bd18-424d85cf02d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:47.034581 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b1efe9-c04e-4d52-b1a4-daa780477d62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92b45d2909a44897a41134e6d9026dc9, user_id=8debfb184e9344c7a0da5c638a00fcd4, role_id=a332ef951db949b0bad7019fbd28a1b9)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:47.040326 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b1efe9-c04e-4d52-b1a4-daa780477d62 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:47.087034 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 986/1953] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:30:46 2022] PUT /identity/v3/projects/92b45d2909a44897a41134e6d9026dc9/users/8debfb184e9344c7a0da5c638a00fcd4/roles/a332ef951db949b0bad7019fbd28a1b9 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:30:47.100861 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b1efe9-c04e-4d52-b1a4-daa780477d62 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:47.109076 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-34b1efe9-c04e-4d52-b1a4-daa780477d62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:47.141857 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dc3e85-b720-4e8c-bd18-424d85cf02d7 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:47.146790 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:47.249268 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b1efe9-c04e-4d52-b1a4-daa780477d62 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:47.255639 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b40e7c-d159-470d-9163-bce9f1a3fe9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:47.256873 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b40e7c-d159-470d-9163-bce9f1a3fe9c admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:47.257183 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b40e7c-d159-470d-9163-bce9f1a3fe9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:47.257460 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b40e7c-d159-470d-9163-bce9f1a3fe9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:47.258128 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b40e7c-d159-470d-9163-bce9f1a3fe9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:47.260109 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b40e7c-d159-470d-9163-bce9f1a3fe9c admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:47.279830 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 987/1954] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:30:47 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:30:47.281108 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b40e7c-d159-470d-9163-bce9f1a3fe9c admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:47.294113 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b40e7c-d159-470d-9163-bce9f1a3fe9c admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:47.305382 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2774a3c8-b7d7-4bd0-9df8-a96cac09ed7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:47.306024 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774a3c8-b7d7-4bd0-9df8-a96cac09ed7c admin admin] REQUEST_METHOD: `PUT` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:47.306310 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774a3c8-b7d7-4bd0-9df8-a96cac09ed7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:47.309040 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774a3c8-b7d7-4bd0-9df8-a96cac09ed7c admin admin] PATH_INFO: `/v3/projects/92b45d2909a44897a41134e6d9026dc9/users/8debfb184e9344c7a0da5c638a00fcd4/roles/a332ef951db949b0bad7019fbd28a1b9` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:47.313485 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2774a3c8-b7d7-4bd0-9df8-a96cac09ed7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=92b45d2909a44897a41134e6d9026dc9, user_id=8debfb184e9344c7a0da5c638a00fcd4, role_id=a332ef951db949b0bad7019fbd28a1b9)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:47.316822 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2774a3c8-b7d7-4bd0-9df8-a96cac09ed7c admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:47.318476 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d43a8ef-a891-4c23-9d80-03fcab699983 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:47.319056 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d43a8ef-a891-4c23-9d80-03fcab699983 service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:47.319330 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d43a8ef-a891-4c23-9d80-03fcab699983 service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:47.319683 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d43a8ef-a891-4c23-9d80-03fcab699983 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:47.321874 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-5d43a8ef-a891-4c23-9d80-03fcab699983 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:47.334092 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 988/1955] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:30:47 2022] PUT /identity/v3/projects/92b45d2909a44897a41134e6d9026dc9/users/8debfb184e9344c7a0da5c638a00fcd4/roles/a332ef951db949b0bad7019fbd28a1b9 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:30:47.347802 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a70ad09-6b05-4832-9695-896520d29ab3 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:47.348251 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a70ad09-6b05-4832-9695-896520d29ab3 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:47.348565 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a70ad09-6b05-4832-9695-896520d29ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:47.368643 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d43a8ef-a891-4c23-9d80-03fcab699983 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:47.372521 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d43a8ef-a891-4c23-9d80-03fcab699983 service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:47.409822 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 968/1956] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:30:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:30:47.438045 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-4a70ad09-6b05-4832-9695-896520d29ab3 None None] MFA Rules not processed for user `8debfb184e9344c7a0da5c638a00fcd4`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:30:47.440771 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-4a70ad09-6b05-4832-9695-896520d29ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:47.632291 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 989/1957] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:30:47 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:30:47.696041 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d43a8ef-a891-4c23-9d80-03fcab699983 service neutron] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:47.701656 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-5d43a8ef-a891-4c23-9d80-03fcab699983 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:47.989642 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d43a8ef-a891-4c23-9d80-03fcab699983 service neutron] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:48.170046 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008033e4-a2cb-429a-b241-ba08fa91c34d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e79503178ac54e62ba385467d5617ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:48.170728 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008033e4-a2cb-429a-b241-ba08fa91c34d service cinder] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:48.171050 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008033e4-a2cb-429a-b241-ba08fa91c34d service cinder] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:48.171343 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008033e4-a2cb-429a-b241-ba08fa91c34d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:48.190232 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008033e4-a2cb-429a-b241-ba08fa91c34d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:48.206461 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008033e4-a2cb-429a-b241-ba08fa91c34d service cinder] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:48.226045 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:48.254149 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 969/1958] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:30:47 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 559 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:30:48.491252 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a70ad09-6b05-4832-9695-896520d29ab3 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:48.494903 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-4a70ad09-6b05-4832-9695-896520d29ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:48.581024 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008033e4-a2cb-429a-b241-ba08fa91c34d service cinder] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:48.582755 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-008033e4-a2cb-429a-b241-ba08fa91c34d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:48.771930 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008033e4-a2cb-429a-b241-ba08fa91c34d service cinder] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:48.777827 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a70ad09-6b05-4832-9695-896520d29ab3 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:48.783387 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7642194e-bf9d-40d0-9f71-f68c5985c58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:48.786411 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7642194e-bf9d-40d0-9f71-f68c5985c58a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:48.786781 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7642194e-bf9d-40d0-9f71-f68c5985c58a admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:48.789593 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7642194e-bf9d-40d0-9f71-f68c5985c58a admin admin] PATH_INFO: `/v3/projects/1b6e14f7b6bc4a7f8ffa16b675559cee` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:48.793532 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456df93e-f963-4228-bf0b-5d0d65a21308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:48.793989 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7642194e-bf9d-40d0-9f71-f68c5985c58a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b6e14f7b6bc4a7f8ffa16b675559cee)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:48.795262 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456df93e-f963-4228-bf0b-5d0d65a21308 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:48.796147 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456df93e-f963-4228-bf0b-5d0d65a21308 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:48.797273 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456df93e-f963-4228-bf0b-5d0d65a21308 admin admin] PATH_INFO: `/v3/projects/8597493605fa404eac8383bdd9a7bc31` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:48.800179 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456df93e-f963-4228-bf0b-5d0d65a21308 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8597493605fa404eac8383bdd9a7bc31)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:48.802657 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456df93e-f963-4228-bf0b-5d0d65a21308 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:48.804138 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7642194e-bf9d-40d0-9f71-f68c5985c58a admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:48.863790 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:48.923361 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-456df93e-f963-4228-bf0b-5d0d65a21308 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8597493605fa404eac8383bdd9a7bc31', 'request_id': 'req-456df93e-f963-4228-bf0b-5d0d65a21308'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:48.935781 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-456df93e-f963-4228-bf0b-5d0d65a21308 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8597493605fa404eac8383bdd9a7bc31', 'request_id': 'req-456df93e-f963-4228-bf0b-5d0d65a21308'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:48.937519 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-7642194e-bf9d-40d0-9f71-f68c5985c58a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b6e14f7b6bc4a7f8ffa16b675559cee', 'request_id': 'req-7642194e-bf9d-40d0-9f71-f68c5985c58a'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:48.952121 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-456df93e-f963-4228-bf0b-5d0d65a21308 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8597493605fa404eac8383bdd9a7bc31', 'request_id': 'req-456df93e-f963-4228-bf0b-5d0d65a21308'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:48.957145 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-7642194e-bf9d-40d0-9f71-f68c5985c58a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b6e14f7b6bc4a7f8ffa16b675559cee', 'request_id': 'req-7642194e-bf9d-40d0-9f71-f68c5985c58a'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:48.973900 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-7642194e-bf9d-40d0-9f71-f68c5985c58a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b6e14f7b6bc4a7f8ffa16b675559cee', 'request_id': 'req-7642194e-bf9d-40d0-9f71-f68c5985c58a'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:48.983975 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-456df93e-f963-4228-bf0b-5d0d65a21308 admin admin] The token cache is being invalidate because project 8597493605fa404eac8383bdd9a7bc31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:30:48.984934 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-456df93e-f963-4228-bf0b-5d0d65a21308 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:48.987844 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-456df93e-f963-4228-bf0b-5d0d65a21308 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:48.992825 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 990/1959] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:30:48 2022] DELETE /identity/v3/projects/8597493605fa404eac8383bdd9a7bc31 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:30:48.999058 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456df93e-f963-4228-bf0b-5d0d65a21308 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:49.002205 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-456df93e-f963-4228-bf0b-5d0d65a21308 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:49.006516 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-7642194e-bf9d-40d0-9f71-f68c5985c58a admin admin] The token cache is being invalidate because project 1b6e14f7b6bc4a7f8ffa16b675559cee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:30:49.008707 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-7642194e-bf9d-40d0-9f71-f68c5985c58a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:49.013887 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-7642194e-bf9d-40d0-9f71-f68c5985c58a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:49.021560 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 970/1960] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:30:48 2022] DELETE /identity/v3/projects/1b6e14f7b6bc4a7f8ffa16b675559cee => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:30:49.023303 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7642194e-bf9d-40d0-9f71-f68c5985c58a admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:49.030770 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-7642194e-bf9d-40d0-9f71-f68c5985c58a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:49.134152 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456df93e-f963-4228-bf0b-5d0d65a21308 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:49.177008 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7642194e-bf9d-40d0-9f71-f68c5985c58a admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:49.184115 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e58c6a9-5d90-49a4-8457-428526ef734c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:49.185117 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e58c6a9-5d90-49a4-8457-428526ef734c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:49.185757 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e58c6a9-5d90-49a4-8457-428526ef734c admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:49.186191 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e58c6a9-5d90-49a4-8457-428526ef734c admin admin] PATH_INFO: `/v3/users/6b2f55894dc5432f9ec3c52132b0510b` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:49.187824 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e58c6a9-5d90-49a4-8457-428526ef734c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b2f55894dc5432f9ec3c52132b0510b)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:49.190962 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e58c6a9-5d90-49a4-8457-428526ef734c admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:49.251269 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:49.281997 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-9e58c6a9-5d90-49a4-8457-428526ef734c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b2f55894dc5432f9ec3c52132b0510b'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:49.305552 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-9e58c6a9-5d90-49a4-8457-428526ef734c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b2f55894dc5432f9ec3c52132b0510b'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:49.306495 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-9e58c6a9-5d90-49a4-8457-428526ef734c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b2f55894dc5432f9ec3c52132b0510b'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:49.309322 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1549c47e-a71b-4942-96ae-0fdb5c6e582f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:49.310169 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1549c47e-a71b-4942-96ae-0fdb5c6e582f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:49.310458 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1549c47e-a71b-4942-96ae-0fdb5c6e582f admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:49.310741 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1549c47e-a71b-4942-96ae-0fdb5c6e582f admin admin] PATH_INFO: `/v3/users/a311fd530ac44713a48adc89eed2e602` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:49.314385 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1549c47e-a71b-4942-96ae-0fdb5c6e582f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a311fd530ac44713a48adc89eed2e602)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:49.316625 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1549c47e-a71b-4942-96ae-0fdb5c6e582f admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:49.321606 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-9e58c6a9-5d90-49a4-8457-428526ef734c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b2f55894dc5432f9ec3c52132b0510b'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:49.322736 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-9e58c6a9-5d90-49a4-8457-428526ef734c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b2f55894dc5432f9ec3c52132b0510b'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:49.349895 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 971/1961] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:30:49 2022] DELETE /identity/v3/users/6b2f55894dc5432f9ec3c52132b0510b => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:30:49.351147 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e58c6a9-5d90-49a4-8457-428526ef734c admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:49.360261 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-9e58c6a9-5d90-49a4-8457-428526ef734c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:49.484537 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-1549c47e-a71b-4942-96ae-0fdb5c6e582f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a311fd530ac44713a48adc89eed2e602'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:49.508639 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:49.528499 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-1549c47e-a71b-4942-96ae-0fdb5c6e582f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a311fd530ac44713a48adc89eed2e602'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:49.547607 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-1549c47e-a71b-4942-96ae-0fdb5c6e582f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a311fd530ac44713a48adc89eed2e602'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:49.551684 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-1549c47e-a71b-4942-96ae-0fdb5c6e582f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a311fd530ac44713a48adc89eed2e602'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:49.571988 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-1549c47e-a71b-4942-96ae-0fdb5c6e582f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a311fd530ac44713a48adc89eed2e602'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:49.589573 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 991/1962] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:30:48 2022] DELETE /identity/v3/users/a311fd530ac44713a48adc89eed2e602 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:30:49.664906 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e58c6a9-5d90-49a4-8457-428526ef734c admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:49.851270 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02217d64-2dcc-42ad-9a1e-ac7b5aaa748b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:49.858094 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02217d64-2dcc-42ad-9a1e-ac7b5aaa748b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:49.862572 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02217d64-2dcc-42ad-9a1e-ac7b5aaa748b admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:49.864492 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02217d64-2dcc-42ad-9a1e-ac7b5aaa748b admin admin] PATH_INFO: `/v3/users/a2faf871704c46808c185d1bd1c67165` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:49.881463 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02217d64-2dcc-42ad-9a1e-ac7b5aaa748b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2faf871704c46808c185d1bd1c67165)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:49.891115 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02217d64-2dcc-42ad-9a1e-ac7b5aaa748b admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:50.027937 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-02217d64-2dcc-42ad-9a1e-ac7b5aaa748b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2faf871704c46808c185d1bd1c67165'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:50.040885 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:50.047788 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-02217d64-2dcc-42ad-9a1e-ac7b5aaa748b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2faf871704c46808c185d1bd1c67165'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:50.050734 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-02217d64-2dcc-42ad-9a1e-ac7b5aaa748b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2faf871704c46808c185d1bd1c67165'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:50.063774 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-02217d64-2dcc-42ad-9a1e-ac7b5aaa748b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2faf871704c46808c185d1bd1c67165'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:50.064219 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-02217d64-2dcc-42ad-9a1e-ac7b5aaa748b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2faf871704c46808c185d1bd1c67165'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:50.092096 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 972/1963] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:30:49 2022] DELETE /identity/v3/users/a2faf871704c46808c185d1bd1c67165 => generated 0 bytes in 745 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:30:50.099310 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf98c05-d800-4127-9dd6-61e7fcc39170 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:50.099841 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf98c05-d800-4127-9dd6-61e7fcc39170 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:50.100248 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf98c05-d800-4127-9dd6-61e7fcc39170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:50.165195 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-7cf98c05-d800-4127-9dd6-61e7fcc39170 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:30:50.169474 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-7cf98c05-d800-4127-9dd6-61e7fcc39170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:50.387076 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 992/1964] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:30:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:30:50.489392 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02217d64-2dcc-42ad-9a1e-ac7b5aaa748b admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:50.491056 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-02217d64-2dcc-42ad-9a1e-ac7b5aaa748b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:50.647993 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02217d64-2dcc-42ad-9a1e-ac7b5aaa748b admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:50.663869 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0e8240-cfb0-4e37-96a8-43d8e6ecfb38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:50.664961 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e8240-cfb0-4e37-96a8-43d8e6ecfb38 service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:50.665479 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e8240-cfb0-4e37-96a8-43d8e6ecfb38 service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:50.665986 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e8240-cfb0-4e37-96a8-43d8e6ecfb38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:50.692460 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0e8240-cfb0-4e37-96a8-43d8e6ecfb38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:50.698316 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0e8240-cfb0-4e37-96a8-43d8e6ecfb38 service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:50.735458 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 973/1965] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:30:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:30:50.956902 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf98c05-d800-4127-9dd6-61e7fcc39170 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:50.961082 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-7cf98c05-d800-4127-9dd6-61e7fcc39170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:51.026922 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf98c05-d800-4127-9dd6-61e7fcc39170 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:51.047007 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b742b94-cb41-484e-83d7-d9cf50d50728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:51.047710 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b742b94-cb41-484e-83d7-d9cf50d50728 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:51.048016 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b742b94-cb41-484e-83d7-d9cf50d50728 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:51.048321 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b742b94-cb41-484e-83d7-d9cf50d50728 admin admin] PATH_INFO: `/v3/projects/eefe0c0e61ef42bfa950d22722632c1d` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:51.049702 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b742b94-cb41-484e-83d7-d9cf50d50728 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eefe0c0e61ef42bfa950d22722632c1d)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:51.053623 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b742b94-cb41-484e-83d7-d9cf50d50728 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:51.127531 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0e8240-cfb0-4e37-96a8-43d8e6ecfb38 service neutron] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:51.132899 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-aa0e8240-cfb0-4e37-96a8-43d8e6ecfb38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:51.185620 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-1b742b94-cb41-484e-83d7-d9cf50d50728 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eefe0c0e61ef42bfa950d22722632c1d', 'request_id': 'req-1b742b94-cb41-484e-83d7-d9cf50d50728'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:51.204030 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-1b742b94-cb41-484e-83d7-d9cf50d50728 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eefe0c0e61ef42bfa950d22722632c1d', 'request_id': 'req-1b742b94-cb41-484e-83d7-d9cf50d50728'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:51.222420 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0e8240-cfb0-4e37-96a8-43d8e6ecfb38 service neutron] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:51.230566 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-1b742b94-cb41-484e-83d7-d9cf50d50728 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eefe0c0e61ef42bfa950d22722632c1d', 'request_id': 'req-1b742b94-cb41-484e-83d7-d9cf50d50728'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:51.253918 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-1b742b94-cb41-484e-83d7-d9cf50d50728 admin admin] The token cache is being invalidate because project eefe0c0e61ef42bfa950d22722632c1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:30:51.254225 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-1b742b94-cb41-484e-83d7-d9cf50d50728 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:51.261248 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-1b742b94-cb41-484e-83d7-d9cf50d50728 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:51.270076 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 993/1966] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:30:50 2022] DELETE /identity/v3/projects/eefe0c0e61ef42bfa950d22722632c1d => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:30:51.283747 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165cd51f-5e84-404c-ac61-78f9e2ae9756 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:51.284038 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165cd51f-5e84-404c-ac61-78f9e2ae9756 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:51.284323 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165cd51f-5e84-404c-ac61-78f9e2ae9756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:51.343643 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-165cd51f-5e84-404c-ac61-78f9e2ae9756 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:30:51.345180 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-165cd51f-5e84-404c-ac61-78f9e2ae9756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:51.417201 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadd51e6-69e9-47d0-aad9-a70b9feee959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:51.422784 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd51e6-69e9-47d0-aad9-a70b9feee959 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:51.423599 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd51e6-69e9-47d0-aad9-a70b9feee959 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:51.424350 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd51e6-69e9-47d0-aad9-a70b9feee959 admin admin] PATH_INFO: `/v3/projects/6c582f888f0f4e06a5397785b16a6e1c` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:51.427220 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadd51e6-69e9-47d0-aad9-a70b9feee959 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c582f888f0f4e06a5397785b16a6e1c)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:51.435100 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadd51e6-69e9-47d0-aad9-a70b9feee959 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:51.487030 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:51.518081 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 994/1967] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:30:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:30:51.536324 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e348c298-732e-4e7a-9bcb-1633578d95a9 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:51.536612 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e348c298-732e-4e7a-9bcb-1633578d95a9 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:51.536895 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e348c298-732e-4e7a-9bcb-1633578d95a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:51.594382 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-e348c298-732e-4e7a-9bcb-1633578d95a9 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:30:51.596556 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-e348c298-732e-4e7a-9bcb-1633578d95a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:51.601926 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-cadd51e6-69e9-47d0-aad9-a70b9feee959 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c582f888f0f4e06a5397785b16a6e1c', 'request_id': 'req-cadd51e6-69e9-47d0-aad9-a70b9feee959'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:51.621274 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-cadd51e6-69e9-47d0-aad9-a70b9feee959 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c582f888f0f4e06a5397785b16a6e1c', 'request_id': 'req-cadd51e6-69e9-47d0-aad9-a70b9feee959'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:51.632994 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-cadd51e6-69e9-47d0-aad9-a70b9feee959 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c582f888f0f4e06a5397785b16a6e1c', 'request_id': 'req-cadd51e6-69e9-47d0-aad9-a70b9feee959'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:51.658393 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-cadd51e6-69e9-47d0-aad9-a70b9feee959 admin admin] The token cache is being invalidate because project 6c582f888f0f4e06a5397785b16a6e1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:30:51.658700 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-cadd51e6-69e9-47d0-aad9-a70b9feee959 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:51.660216 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-cadd51e6-69e9-47d0-aad9-a70b9feee959 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:51.662270 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 974/1968] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:30:51 2022] DELETE /identity/v3/projects/6c582f888f0f4e06a5397785b16a6e1c => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:30:51.670585 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b032db35-92ac-41c2-b1e6-8f01eedf3bdc None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:51.670746 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b032db35-92ac-41c2-b1e6-8f01eedf3bdc None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:51.676665 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b032db35-92ac-41c2-b1e6-8f01eedf3bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:51.727532 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-b032db35-92ac-41c2-b1e6-8f01eedf3bdc None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:30:51.733738 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-b032db35-92ac-41c2-b1e6-8f01eedf3bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:51.753883 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:51.791924 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 995/1969] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:30:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:30:51.797710 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e348c298-732e-4e7a-9bcb-1633578d95a9 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:51.828759 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e348c298-732e-4e7a-9bcb-1633578d95a9 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:51.839932 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2616036c-b6f4-4237-9f92-05467a192252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:51.853768 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2616036c-b6f4-4237-9f92-05467a192252 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:51.854316 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2616036c-b6f4-4237-9f92-05467a192252 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:51.856087 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2616036c-b6f4-4237-9f92-05467a192252 admin admin] PATH_INFO: `/v3/domains` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:51.856651 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2616036c-b6f4-4237-9f92-05467a192252 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:30:51.857227 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2616036c-b6f4-4237-9f92-05467a192252 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:51.860837 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2616036c-b6f4-4237-9f92-05467a192252 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:51.890914 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 996/1970] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 12:30:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:30:51.897425 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2616036c-b6f4-4237-9f92-05467a192252 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:51.909477 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 975/1971] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:30:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:30:51.936615 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf08125-d96c-4321-bd6a-d880837ef013 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:51.936892 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf08125-d96c-4321-bd6a-d880837ef013 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:51.937046 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf08125-d96c-4321-bd6a-d880837ef013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:51.941902 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2616036c-b6f4-4237-9f92-05467a192252 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:51.960160 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8900f1-6e07-45c6-a0bc-9098e2c89dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:51.961222 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8900f1-6e07-45c6-a0bc-9098e2c89dcf admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:51.961222 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8900f1-6e07-45c6-a0bc-9098e2c89dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:51.961524 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8900f1-6e07-45c6-a0bc-9098e2c89dcf admin admin] PATH_INFO: `/v3/projects` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:51.962309 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8900f1-6e07-45c6-a0bc-9098e2c89dcf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:51.964176 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8900f1-6e07-45c6-a0bc-9098e2c89dcf admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:51.996741 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-6bf08125-d96c-4321-bd6a-d880837ef013 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:30:51.999886 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-6bf08125-d96c-4321-bd6a-d880837ef013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:52.018907 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 997/1972] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:30:51 2022] POST /identity/v3/projects => generated 371 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:30:52.019331 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 976/1973] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:30:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:30:52.024646 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8900f1-6e07-45c6-a0bc-9098e2c89dcf admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:52.030521 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf08125-d96c-4321-bd6a-d880837ef013 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:52.041786 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf08125-d96c-4321-bd6a-d880837ef013 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:52.157099 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8900f1-6e07-45c6-a0bc-9098e2c89dcf admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:52.165282 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3aaecb-a7b9-4092-9e88-50871450e691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:52.166022 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3aaecb-a7b9-4092-9e88-50871450e691 admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:52.166326 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3aaecb-a7b9-4092-9e88-50871450e691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:52.166677 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3aaecb-a7b9-4092-9e88-50871450e691 admin admin] PATH_INFO: `/v3/users` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:52.167679 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3aaecb-a7b9-4092-9e88-50871450e691 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:52.170388 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3aaecb-a7b9-4092-9e88-50871450e691 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:52.181169 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338ac0ad-7fb9-47cc-9704-a95d089afb8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:52.182007 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ac0ad-7fb9-47cc-9704-a95d089afb8d admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:52.182425 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ac0ad-7fb9-47cc-9704-a95d089afb8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:52.183502 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ac0ad-7fb9-47cc-9704-a95d089afb8d admin admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:52.184744 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338ac0ad-7fb9-47cc-9704-a95d089afb8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:30:52.185326 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338ac0ad-7fb9-47cc-9704-a95d089afb8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:52.188755 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338ac0ad-7fb9-47cc-9704-a95d089afb8d admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:52.208542 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 998/1974] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:30:52 2022] POST /identity/v3/users => generated 286 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:30:52.213879 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3aaecb-a7b9-4092-9e88-50871450e691 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:52.226685 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 977/1975] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 12:30:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:30:52.234794 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338ac0ad-7fb9-47cc-9704-a95d089afb8d admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:52.247518 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3aaecb-a7b9-4092-9e88-50871450e691 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:52.258141 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bfdfe7-782e-4273-a010-47b5b9823d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:52.258428 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338ac0ad-7fb9-47cc-9704-a95d089afb8d admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:52.262287 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bfdfe7-782e-4273-a010-47b5b9823d6a admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:52.263414 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bfdfe7-782e-4273-a010-47b5b9823d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:52.264378 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bfdfe7-782e-4273-a010-47b5b9823d6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:52.266568 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bfdfe7-782e-4273-a010-47b5b9823d6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:52.267679 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134897a6-d608-4de5-99f6-f86b6fbff7c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:52.268689 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134897a6-d608-4de5-99f6-f86b6fbff7c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:52.269184 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134897a6-d608-4de5-99f6-f86b6fbff7c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:52.269640 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134897a6-d608-4de5-99f6-f86b6fbff7c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:52.270844 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134897a6-d608-4de5-99f6-f86b6fbff7c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:52.274722 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134897a6-d608-4de5-99f6-f86b6fbff7c7 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:52.281297 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bfdfe7-782e-4273-a010-47b5b9823d6a admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:52.320296 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 999/1976] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:30:52 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:30:52.322636 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bfdfe7-782e-4273-a010-47b5b9823d6a admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:52.354556 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bfdfe7-782e-4273-a010-47b5b9823d6a admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:52.366145 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 978/1977] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:30:52 2022] POST /identity/v3/projects => generated 401 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:30:52.368923 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134897a6-d608-4de5-99f6-f86b6fbff7c7 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:52.380786 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-134897a6-d608-4de5-99f6-f86b6fbff7c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:52.402431 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c099da-50c2-4e51-9aae-de094ef4dcbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:52.406595 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c099da-50c2-4e51-9aae-de094ef4dcbe admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:52.410488 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c099da-50c2-4e51-9aae-de094ef4dcbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:52.415578 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c099da-50c2-4e51-9aae-de094ef4dcbe admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:52.416903 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c099da-50c2-4e51-9aae-de094ef4dcbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:52.428441 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c099da-50c2-4e51-9aae-de094ef4dcbe admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:52.454100 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1000/1978] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:30:52 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:30:52.456985 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c099da-50c2-4e51-9aae-de094ef4dcbe admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:52.484389 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c099da-50c2-4e51-9aae-de094ef4dcbe admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:52.535920 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134897a6-d608-4de5-99f6-f86b6fbff7c7 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:52.540976 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:52.546198 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df980b6-2f2d-4043-861c-e56a276ac51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:52.547592 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df980b6-2f2d-4043-861c-e56a276ac51c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:52.547997 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df980b6-2f2d-4043-861c-e56a276ac51c admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:52.548371 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df980b6-2f2d-4043-861c-e56a276ac51c admin admin] PATH_INFO: `/v3/projects/292e3f5d869f4526ac66564c8c7e0366` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:52.549856 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df980b6-2f2d-4043-861c-e56a276ac51c admin admin] RBAC: Authorizing `identity:delete_project(project_id=292e3f5d869f4526ac66564c8c7e0366)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:52.552096 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df980b6-2f2d-4043-861c-e56a276ac51c admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:52.581935 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:52.615339 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4a33ad-94d0-4839-9f94-7d96ddc99f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:52.616553 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a33ad-94d0-4839-9f94-7d96ddc99f00 admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:52.617021 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a33ad-94d0-4839-9f94-7d96ddc99f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:52.618104 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a33ad-94d0-4839-9f94-7d96ddc99f00 admin admin] PATH_INFO: `/v3/users` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:52.619687 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4a33ad-94d0-4839-9f94-7d96ddc99f00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:52.627067 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4a33ad-94d0-4839-9f94-7d96ddc99f00 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:52.641601 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-6df980b6-2f2d-4043-861c-e56a276ac51c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '292e3f5d869f4526ac66564c8c7e0366', 'request_id': 'req-6df980b6-2f2d-4043-861c-e56a276ac51c'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:52.654370 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-6df980b6-2f2d-4043-861c-e56a276ac51c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '292e3f5d869f4526ac66564c8c7e0366', 'request_id': 'req-6df980b6-2f2d-4043-861c-e56a276ac51c'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:52.664048 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-6df980b6-2f2d-4043-861c-e56a276ac51c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '292e3f5d869f4526ac66564c8c7e0366', 'request_id': 'req-6df980b6-2f2d-4043-861c-e56a276ac51c'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:52.669815 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1001/1979] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:30:52 2022] POST /identity/v3/users => generated 301 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:30:52.670568 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4a33ad-94d0-4839-9f94-7d96ddc99f00 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:52.687225 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4a33ad-94d0-4839-9f94-7d96ddc99f00 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:52.689337 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-6df980b6-2f2d-4043-861c-e56a276ac51c admin admin] The token cache is being invalidate because project 292e3f5d869f4526ac66564c8c7e0366 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:30:52.689716 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-6df980b6-2f2d-4043-861c-e56a276ac51c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:52.690539 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-6df980b6-2f2d-4043-861c-e56a276ac51c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:52.692571 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 979/1980] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:30:52 2022] DELETE /identity/v3/projects/292e3f5d869f4526ac66564c8c7e0366 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:30:52.693776 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df980b6-2f2d-4043-861c-e56a276ac51c admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:52.705557 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-6df980b6-2f2d-4043-861c-e56a276ac51c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:52.829609 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dbe3a4-8099-49f9-981d-5bfcdc602070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:52.830328 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dbe3a4-8099-49f9-981d-5bfcdc602070 admin admin] REQUEST_METHOD: `PUT` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:52.830689 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dbe3a4-8099-49f9-981d-5bfcdc602070 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:52.830979 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dbe3a4-8099-49f9-981d-5bfcdc602070 admin admin] PATH_INFO: `/v3/projects/1bf89e9ca27940b8be7aaf4faf5d9919/users/575e4af8587c4c61a3178f5eeef0b729/roles/b5cfd7a855a448359e9017f51d32b6fc` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:52.831133 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df980b6-2f2d-4043-861c-e56a276ac51c admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:52.838005 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77111eae-1deb-4ac6-be4a-e852f9a79ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:52.838777 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77111eae-1deb-4ac6-be4a-e852f9a79ee0 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:52.839307 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77111eae-1deb-4ac6-be4a-e852f9a79ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:52.839781 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77111eae-1deb-4ac6-be4a-e852f9a79ee0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:52.840919 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77111eae-1deb-4ac6-be4a-e852f9a79ee0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:52.842752 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77111eae-1deb-4ac6-be4a-e852f9a79ee0 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:52.861834 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dbe3a4-8099-49f9-981d-5bfcdc602070 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bf89e9ca27940b8be7aaf4faf5d9919, user_id=575e4af8587c4c61a3178f5eeef0b729, role_id=b5cfd7a855a448359e9017f51d32b6fc)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:52.864445 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 980/1981] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:30:52 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:30:52.866088 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77111eae-1deb-4ac6-be4a-e852f9a79ee0 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:52.869186 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-77111eae-1deb-4ac6-be4a-e852f9a79ee0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:52.873122 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dbe3a4-8099-49f9-981d-5bfcdc602070 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:52.894783 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77111eae-1deb-4ac6-be4a-e852f9a79ee0 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:52.901648 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1002/1982] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:30:52 2022] PUT /identity/v3/projects/1bf89e9ca27940b8be7aaf4faf5d9919/users/575e4af8587c4c61a3178f5eeef0b729/roles/b5cfd7a855a448359e9017f51d32b6fc => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:30:52.906555 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dbe3a4-8099-49f9-981d-5bfcdc602070 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:53.019380 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a57ab58-b006-478a-884e-22f69c6ec25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:53.020470 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a57ab58-b006-478a-884e-22f69c6ec25b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:53.020998 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a57ab58-b006-478a-884e-22f69c6ec25b admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:53.021484 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a57ab58-b006-478a-884e-22f69c6ec25b admin admin] PATH_INFO: `/v3/users/8debfb184e9344c7a0da5c638a00fcd4` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:53.023926 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a57ab58-b006-478a-884e-22f69c6ec25b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8debfb184e9344c7a0da5c638a00fcd4)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:53.028933 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a57ab58-b006-478a-884e-22f69c6ec25b admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:53.042576 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dbe3a4-8099-49f9-981d-5bfcdc602070 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:53.049202 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528458e2-0f67-4b6f-acf5-c26cedd247e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:53.050269 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528458e2-0f67-4b6f-acf5-c26cedd247e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:53.050738 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528458e2-0f67-4b6f-acf5-c26cedd247e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:53.051053 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528458e2-0f67-4b6f-acf5-c26cedd247e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:53.051923 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528458e2-0f67-4b6f-acf5-c26cedd247e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:53.053614 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528458e2-0f67-4b6f-acf5-c26cedd247e2 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:53.066691 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1003/1983] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:30:52 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:30:53.068066 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e0f55-5d44-4d43-b0af-00bf3f563361 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:53.068362 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e0f55-5d44-4d43-b0af-00bf3f563361 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:53.068640 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e0f55-5d44-4d43-b0af-00bf3f563361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:53.098505 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-067e0f55-5d44-4d43-b0af-00bf3f563361 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:30:53.099902 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-067e0f55-5d44-4d43-b0af-00bf3f563361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:53.114939 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1004/1984] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:30:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:30:53.116455 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067e0f55-5d44-4d43-b0af-00bf3f563361 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:53.135300 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:53.139589 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067e0f55-5d44-4d43-b0af-00bf3f563361 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:53.143457 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-7a57ab58-b006-478a-884e-22f69c6ec25b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8debfb184e9344c7a0da5c638a00fcd4'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:53.159712 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa2f7ef-ed55-431c-b308-6c40bd0f5aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:53.160887 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa2f7ef-ed55-431c-b308-6c40bd0f5aa8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:53.161378 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa2f7ef-ed55-431c-b308-6c40bd0f5aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:53.161858 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa2f7ef-ed55-431c-b308-6c40bd0f5aa8 admin admin] PATH_INFO: `/v3/projects/973565e0837b4e16bbd5bfc8967b1706/users/e4415718ec5f45e99b59944c07d122f5/roles/b5cfd7a855a448359e9017f51d32b6fc` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:53.180755 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-7a57ab58-b006-478a-884e-22f69c6ec25b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8debfb184e9344c7a0da5c638a00fcd4'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:53.182927 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-7a57ab58-b006-478a-884e-22f69c6ec25b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8debfb184e9344c7a0da5c638a00fcd4'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:53.195964 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa2f7ef-ed55-431c-b308-6c40bd0f5aa8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=973565e0837b4e16bbd5bfc8967b1706, user_id=e4415718ec5f45e99b59944c07d122f5, role_id=b5cfd7a855a448359e9017f51d32b6fc)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:53.200509 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-7a57ab58-b006-478a-884e-22f69c6ec25b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8debfb184e9344c7a0da5c638a00fcd4'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:53.202158 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-7a57ab58-b006-478a-884e-22f69c6ec25b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8debfb184e9344c7a0da5c638a00fcd4'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:53.202301 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa2f7ef-ed55-431c-b308-6c40bd0f5aa8 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:53.250969 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 981/1986] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:30:52 2022] DELETE /identity/v3/users/8debfb184e9344c7a0da5c638a00fcd4 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:30:53.253020 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a57ab58-b006-478a-884e-22f69c6ec25b admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:53.257582 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-7a57ab58-b006-478a-884e-22f69c6ec25b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:53.259239 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1005/1986] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:30:53 2022] PUT /identity/v3/projects/973565e0837b4e16bbd5bfc8967b1706/users/e4415718ec5f45e99b59944c07d122f5/roles/b5cfd7a855a448359e9017f51d32b6fc => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:30:53.269493 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec647f92-6deb-45d3-a1b4-e3c577bf3da3 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:53.269700 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec647f92-6deb-45d3-a1b4-e3c577bf3da3 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:53.269970 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec647f92-6deb-45d3-a1b4-e3c577bf3da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:53.319106 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:53.371148 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-ec647f92-6deb-45d3-a1b4-e3c577bf3da3 None None] MFA Rules not processed for user `e4415718ec5f45e99b59944c07d122f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:30:53.375475 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-ec647f92-6deb-45d3-a1b4-e3c577bf3da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:53.476124 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a57ab58-b006-478a-884e-22f69c6ec25b admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:53.484577 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49264815-0a93-41f8-b8ee-0cde29873d76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:53.485707 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49264815-0a93-41f8-b8ee-0cde29873d76 service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:53.486236 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49264815-0a93-41f8-b8ee-0cde29873d76 service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:53.486612 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49264815-0a93-41f8-b8ee-0cde29873d76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:53.490223 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-49264815-0a93-41f8-b8ee-0cde29873d76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:53.634558 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1006/1987] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:30:53 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:30:53.639893 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49264815-0a93-41f8-b8ee-0cde29873d76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:53.641969 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49264815-0a93-41f8-b8ee-0cde29873d76 service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:53.650076 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec647f92-6deb-45d3-a1b4-e3c577bf3da3 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:53.654354 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-ec647f92-6deb-45d3-a1b4-e3c577bf3da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:53.660089 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 982/1988] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:30:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:30:53.683442 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec647f92-6deb-45d3-a1b4-e3c577bf3da3 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:53.691851 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7a87fb-ede0-4ad9-9542-42c014ddc896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:53.692508 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a87fb-ede0-4ad9-9542-42c014ddc896 admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:53.692795 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a87fb-ede0-4ad9-9542-42c014ddc896 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:53.693072 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a87fb-ede0-4ad9-9542-42c014ddc896 admin admin] PATH_INFO: `/v3/projects` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:53.693768 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7a87fb-ede0-4ad9-9542-42c014ddc896 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:53.695855 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7a87fb-ede0-4ad9-9542-42c014ddc896 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:53.754920 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1007/1989] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:30:53 2022] POST /identity/v3/projects => generated 399 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:30:53.758228 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49264815-0a93-41f8-b8ee-0cde29873d76 service neutron] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:53.779087 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49264815-0a93-41f8-b8ee-0cde29873d76 service neutron] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:53.882542 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae54d3c-05f7-4aa3-859b-24da9b3e0d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:53.883657 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae54d3c-05f7-4aa3-859b-24da9b3e0d1f admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:53.884423 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae54d3c-05f7-4aa3-859b-24da9b3e0d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:53.884887 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae54d3c-05f7-4aa3-859b-24da9b3e0d1f admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:53.885572 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae54d3c-05f7-4aa3-859b-24da9b3e0d1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:53.889381 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae54d3c-05f7-4aa3-859b-24da9b3e0d1f admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:53.934746 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:53.938897 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 983/1990] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:30:53 2022] POST /identity/v3/users => generated 306 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:30:53.944846 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7a87fb-ede0-4ad9-9542-42c014ddc896 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:53.958196 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7a87fb-ede0-4ad9-9542-42c014ddc896 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:53.966255 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db8e6d5-ff33-458a-a72c-df8c0716654e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:53.967230 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db8e6d5-ff33-458a-a72c-df8c0716654e admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:53.967606 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db8e6d5-ff33-458a-a72c-df8c0716654e admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:53.967899 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db8e6d5-ff33-458a-a72c-df8c0716654e admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:53.969315 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db8e6d5-ff33-458a-a72c-df8c0716654e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:53.970299 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db8e6d5-ff33-458a-a72c-df8c0716654e admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:53.992227 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1008/1991] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:30:53 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 12:30:53.997299 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae54d3c-05f7-4aa3-859b-24da9b3e0d1f admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:54.010228 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae54d3c-05f7-4aa3-859b-24da9b3e0d1f admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:54.028368 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c1d2ea-1298-41c0-8c52-0696f3b23d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:54.029675 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c1d2ea-1298-41c0-8c52-0696f3b23d1a admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:54.029846 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c1d2ea-1298-41c0-8c52-0696f3b23d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:54.030249 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c1d2ea-1298-41c0-8c52-0696f3b23d1a admin admin] PATH_INFO: `/v3/projects/9ad09385508541a28aafd4ba7fd3272f/users/73f8edcf5bbf47faaa0f1b65ff813946/roles/a332ef951db949b0bad7019fbd28a1b9` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:54.055107 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c1d2ea-1298-41c0-8c52-0696f3b23d1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ad09385508541a28aafd4ba7fd3272f, user_id=73f8edcf5bbf47faaa0f1b65ff813946, role_id=a332ef951db949b0bad7019fbd28a1b9)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:54.060206 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c1d2ea-1298-41c0-8c52-0696f3b23d1a admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:54.099895 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 984/1992] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:30:53 2022] PUT /identity/v3/projects/9ad09385508541a28aafd4ba7fd3272f/users/73f8edcf5bbf47faaa0f1b65ff813946/roles/a332ef951db949b0bad7019fbd28a1b9 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:30:54.106563 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db8e6d5-ff33-458a-a72c-df8c0716654e admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:54.142770 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db8e6d5-ff33-458a-a72c-df8c0716654e admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:54.241894 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c1d2ea-1298-41c0-8c52-0696f3b23d1a admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:54.244388 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-73c1d2ea-1298-41c0-8c52-0696f3b23d1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:54.331475 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed7e4d-f86f-4bae-aef7-9f4ae4db7db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:54.332215 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed7e4d-f86f-4bae-aef7-9f4ae4db7db1 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:54.332520 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed7e4d-f86f-4bae-aef7-9f4ae4db7db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:54.332848 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed7e4d-f86f-4bae-aef7-9f4ae4db7db1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:54.333491 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eed7e4d-f86f-4bae-aef7-9f4ae4db7db1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:54.335952 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eed7e4d-f86f-4bae-aef7-9f4ae4db7db1 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:54.359389 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1009/1993] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:30:54 2022] GET /identity/v3/roles => generated 1420 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:30:54.365101 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed7e4d-f86f-4bae-aef7-9f4ae4db7db1 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:54.378287 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed7e4d-f86f-4bae-aef7-9f4ae4db7db1 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:54.383985 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5276e67-d44f-486f-85a1-158781624b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:54.384719 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5276e67-d44f-486f-85a1-158781624b69 admin admin] REQUEST_METHOD: `PUT` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:54.385076 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5276e67-d44f-486f-85a1-158781624b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:54.385610 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5276e67-d44f-486f-85a1-158781624b69 admin admin] PATH_INFO: `/v3/projects/9ad09385508541a28aafd4ba7fd3272f/users/73f8edcf5bbf47faaa0f1b65ff813946/roles/a332ef951db949b0bad7019fbd28a1b9` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:54.389211 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5276e67-d44f-486f-85a1-158781624b69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ad09385508541a28aafd4ba7fd3272f, user_id=73f8edcf5bbf47faaa0f1b65ff813946, role_id=a332ef951db949b0bad7019fbd28a1b9)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:54.392449 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5276e67-d44f-486f-85a1-158781624b69 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:54.407126 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1010/1994] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:30:54 2022] PUT /identity/v3/projects/9ad09385508541a28aafd4ba7fd3272f/users/73f8edcf5bbf47faaa0f1b65ff813946/roles/a332ef951db949b0bad7019fbd28a1b9 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:30:54.412923 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c1d2ea-1298-41c0-8c52-0696f3b23d1a admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:54.434162 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab25dcb-b4a9-45f2-bbcc-4848e1184bd9 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:54.434893 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab25dcb-b4a9-45f2-bbcc-4848e1184bd9 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:54.435982 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab25dcb-b4a9-45f2-bbcc-4848e1184bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:54.499778 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-bab25dcb-b4a9-45f2-bbcc-4848e1184bd9 None None] MFA Rules not processed for user `73f8edcf5bbf47faaa0f1b65ff813946`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:30:54.501064 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-bab25dcb-b4a9-45f2-bbcc-4848e1184bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:54.537556 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb27ce34-2963-458f-a7bb-fafbb1f5a272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:54.539111 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb27ce34-2963-458f-a7bb-fafbb1f5a272 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:54.539665 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb27ce34-2963-458f-a7bb-fafbb1f5a272 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:54.540165 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb27ce34-2963-458f-a7bb-fafbb1f5a272 admin admin] PATH_INFO: `/v3/projects/92b45d2909a44897a41134e6d9026dc9` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:54.544586 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb27ce34-2963-458f-a7bb-fafbb1f5a272 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92b45d2909a44897a41134e6d9026dc9)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:54.548537 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb27ce34-2963-458f-a7bb-fafbb1f5a272 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:54.586522 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:54.657484 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-bb27ce34-2963-458f-a7bb-fafbb1f5a272 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92b45d2909a44897a41134e6d9026dc9', 'request_id': 'req-bb27ce34-2963-458f-a7bb-fafbb1f5a272'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:54.669380 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-bb27ce34-2963-458f-a7bb-fafbb1f5a272 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92b45d2909a44897a41134e6d9026dc9', 'request_id': 'req-bb27ce34-2963-458f-a7bb-fafbb1f5a272'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:54.682439 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1011/1995] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:30:54 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:30:54.687390 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-bb27ce34-2963-458f-a7bb-fafbb1f5a272 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92b45d2909a44897a41134e6d9026dc9', 'request_id': 'req-bb27ce34-2963-458f-a7bb-fafbb1f5a272'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:54.696206 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab25dcb-b4a9-45f2-bbcc-4848e1184bd9 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:54.699654 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-bab25dcb-b4a9-45f2-bbcc-4848e1184bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:54.713628 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-bb27ce34-2963-458f-a7bb-fafbb1f5a272 admin admin] The token cache is being invalidate because project 92b45d2909a44897a41134e6d9026dc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:30:54.714257 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-bb27ce34-2963-458f-a7bb-fafbb1f5a272 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:54.715680 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-bb27ce34-2963-458f-a7bb-fafbb1f5a272 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:54.717841 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 985/1996] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:30:54 2022] DELETE /identity/v3/projects/92b45d2909a44897a41134e6d9026dc9 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:30:54.722501 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15bef40-9b6a-4055-bd45-bfc9e059ec2e None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:54.722828 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15bef40-9b6a-4055-bd45-bfc9e059ec2e None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:54.723174 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15bef40-9b6a-4055-bd45-bfc9e059ec2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:54.747625 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-b15bef40-9b6a-4055-bd45-bfc9e059ec2e None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:30:54.748917 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-b15bef40-9b6a-4055-bd45-bfc9e059ec2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:54.760905 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:54.836743 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab25dcb-b4a9-45f2-bbcc-4848e1184bd9 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:54.930947 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 986/1997] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:30:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:30:54.938320 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e67481b-6298-44e3-94e0-fb755c783d58 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:54.938613 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e67481b-6298-44e3-94e0-fb755c783d58 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:54.940235 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e67481b-6298-44e3-94e0-fb755c783d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:54.979197 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-1e67481b-6298-44e3-94e0-fb755c783d58 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:30:54.983107 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-1e67481b-6298-44e3-94e0-fb755c783d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:54.994906 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e05436-e1de-4302-a04b-851effd01779 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e79503178ac54e62ba385467d5617ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:54.998620 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e05436-e1de-4302-a04b-851effd01779 service cinder] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:54.998998 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e05436-e1de-4302-a04b-851effd01779 service cinder] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:54.999227 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e05436-e1de-4302-a04b-851effd01779 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:55.001488 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 987/1998] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:30:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:30:55.006144 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e67481b-6298-44e3-94e0-fb755c783d58 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:55.006824 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-75e05436-e1de-4302-a04b-851effd01779 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:55.021462 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e67481b-6298-44e3-94e0-fb755c783d58 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:55.044271 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b7cc6-878b-40ba-8782-8e695a65ecd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:55.045174 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b7cc6-878b-40ba-8782-8e695a65ecd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:55.045464 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b7cc6-878b-40ba-8782-8e695a65ecd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:55.045737 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b7cc6-878b-40ba-8782-8e695a65ecd6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:55.046438 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285b7cc6-878b-40ba-8782-8e695a65ecd6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:30:55.046742 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285b7cc6-878b-40ba-8782-8e695a65ecd6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:55.062350 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285b7cc6-878b-40ba-8782-8e695a65ecd6 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:55.092945 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 988/1999] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 12:30:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:30:55.099228 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b7cc6-878b-40ba-8782-8e695a65ecd6 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:55.123913 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b7cc6-878b-40ba-8782-8e695a65ecd6 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:55.152262 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c6543c-e4b5-407f-89ca-9c3de5255dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:55.153394 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c6543c-e4b5-407f-89ca-9c3de5255dbd admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:55.153857 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c6543c-e4b5-407f-89ca-9c3de5255dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:55.154380 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c6543c-e4b5-407f-89ca-9c3de5255dbd admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:55.155551 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c6543c-e4b5-407f-89ca-9c3de5255dbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:55.157940 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c6543c-e4b5-407f-89ca-9c3de5255dbd admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:55.197978 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 989/2000] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:30:55 2022] POST /identity/v3/projects => generated 375 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:30:55.198212 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e05436-e1de-4302-a04b-851effd01779 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:55.199692 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e05436-e1de-4302-a04b-851effd01779 service cinder] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:55.201575 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c6543c-e4b5-407f-89ca-9c3de5255dbd admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:55.226432 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1012/2001] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:30:54 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:30:55.349626 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c6543c-e4b5-407f-89ca-9c3de5255dbd admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:55.367192 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27625c18-b474-4aad-a401-b0510dc2ba57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:55.367990 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27625c18-b474-4aad-a401-b0510dc2ba57 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:55.368839 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27625c18-b474-4aad-a401-b0510dc2ba57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:55.369548 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27625c18-b474-4aad-a401-b0510dc2ba57 admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:55.371166 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27625c18-b474-4aad-a401-b0510dc2ba57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:55.372734 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e05436-e1de-4302-a04b-851effd01779 service cinder] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:55.374981 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27625c18-b474-4aad-a401-b0510dc2ba57 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:55.375460 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-75e05436-e1de-4302-a04b-851effd01779 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:55.401283 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e05436-e1de-4302-a04b-851effd01779 service cinder] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:55.413786 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 990/2002] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:30:55 2022] POST /identity/v3/users => generated 288 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:30:55.417126 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27625c18-b474-4aad-a401-b0510dc2ba57 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:55.457647 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27625c18-b474-4aad-a401-b0510dc2ba57 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:55.464117 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df080f3a-98b2-4e4b-97b3-c3e0b3f272e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:55.464806 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df080f3a-98b2-4e4b-97b3-c3e0b3f272e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:55.465087 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df080f3a-98b2-4e4b-97b3-c3e0b3f272e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:55.465357 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df080f3a-98b2-4e4b-97b3-c3e0b3f272e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:55.466238 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df080f3a-98b2-4e4b-97b3-c3e0b3f272e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:55.468298 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df080f3a-98b2-4e4b-97b3-c3e0b3f272e0 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:55.475611 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:55.484628 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 991/2003] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:30:55 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:30:55.488584 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df080f3a-98b2-4e4b-97b3-c3e0b3f272e0 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:55.500255 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d706ef72-dc20-4cd1-91af-667506a7b284 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e79503178ac54e62ba385467d5617ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:55.511606 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df080f3a-98b2-4e4b-97b3-c3e0b3f272e0 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:55.511606 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b425258b-0255-4246-89c5-b350d1d1cab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:55.512033 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b425258b-0255-4246-89c5-b350d1d1cab6 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:55.512033 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b425258b-0255-4246-89c5-b350d1d1cab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:55.512261 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b425258b-0255-4246-89c5-b350d1d1cab6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:55.513205 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b425258b-0255-4246-89c5-b350d1d1cab6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:55.513623 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d706ef72-dc20-4cd1-91af-667506a7b284 service cinder] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:55.514113 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d706ef72-dc20-4cd1-91af-667506a7b284 service cinder] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:55.514771 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d706ef72-dc20-4cd1-91af-667506a7b284 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:55.515305 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b425258b-0255-4246-89c5-b350d1d1cab6 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:55.517458 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-d706ef72-dc20-4cd1-91af-667506a7b284 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:55.531159 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 992/2004] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:30:55 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 12:30:55.532735 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f16bdb9-df8a-4de4-b30c-56818d7237c7 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:55.533022 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f16bdb9-df8a-4de4-b30c-56818d7237c7 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:55.533359 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f16bdb9-df8a-4de4-b30c-56818d7237c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:55.579684 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-1f16bdb9-df8a-4de4-b30c-56818d7237c7 None None] MFA Rules not processed for user `575e4af8587c4c61a3178f5eeef0b729`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:30:55.583361 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-1f16bdb9-df8a-4de4-b30c-56818d7237c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:55.614408 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d706ef72-dc20-4cd1-91af-667506a7b284 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:55.615883 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d706ef72-dc20-4cd1-91af-667506a7b284 service cinder] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:55.629208 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:55.631905 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1013/2005] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:30:55 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:30:55.632787 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d706ef72-dc20-4cd1-91af-667506a7b284 service cinder] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:55.652871 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d706ef72-dc20-4cd1-91af-667506a7b284 service cinder] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:55.661332 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e74c1d-64ff-4bdc-8f98-9477402b5093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:55.662033 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e74c1d-64ff-4bdc-8f98-9477402b5093 admin admin] REQUEST_METHOD: `PUT` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:55.662338 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e74c1d-64ff-4bdc-8f98-9477402b5093 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:55.662601 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e74c1d-64ff-4bdc-8f98-9477402b5093 admin admin] PATH_INFO: `/v3/projects/a395fc63f96a486e9713cc9eb8b3665d/users/932bd9bfbc0243258e49eb880c78ee98/roles/b5cfd7a855a448359e9017f51d32b6fc` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:55.685699 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e74c1d-64ff-4bdc-8f98-9477402b5093 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a395fc63f96a486e9713cc9eb8b3665d, user_id=932bd9bfbc0243258e49eb880c78ee98, role_id=b5cfd7a855a448359e9017f51d32b6fc)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:55.689321 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e74c1d-64ff-4bdc-8f98-9477402b5093 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:55.704172 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 993/2006] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:30:55 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:30:55.705701 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f16bdb9-df8a-4de4-b30c-56818d7237c7 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:55.708291 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1014/2007] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:30:55 2022] PUT /identity/v3/projects/a395fc63f96a486e9713cc9eb8b3665d/users/932bd9bfbc0243258e49eb880c78ee98/roles/b5cfd7a855a448359e9017f51d32b6fc => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:30:55.725361 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-1f16bdb9-df8a-4de4-b30c-56818d7237c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:55.726058 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079db923-d5ec-4f6d-b07d-c2b4718f7cc0 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:55.726467 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079db923-d5ec-4f6d-b07d-c2b4718f7cc0 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:55.726750 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079db923-d5ec-4f6d-b07d-c2b4718f7cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:55.753593 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f16bdb9-df8a-4de4-b30c-56818d7237c7 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:55.791355 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-079db923-d5ec-4f6d-b07d-c2b4718f7cc0 None None] MFA Rules not processed for user `932bd9bfbc0243258e49eb880c78ee98`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:30:55.795240 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-079db923-d5ec-4f6d-b07d-c2b4718f7cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:55.841429 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e9d4b3-e08b-469b-b073-bde3f005d95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:55.842190 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e9d4b3-e08b-469b-b073-bde3f005d95b admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:55.842536 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e9d4b3-e08b-469b-b073-bde3f005d95b admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:55.842923 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e9d4b3-e08b-469b-b073-bde3f005d95b admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:55.843690 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e9d4b3-e08b-469b-b073-bde3f005d95b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:55.845769 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e9d4b3-e08b-469b-b073-bde3f005d95b admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:55.879677 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 994/2008] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:30:55 2022] POST /identity/v3/projects => generated 373 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:30:55.884502 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e9d4b3-e08b-469b-b073-bde3f005d95b admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:55.915330 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1015/2009] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:30:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:30:55.931734 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079db923-d5ec-4f6d-b07d-c2b4718f7cc0 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:55.934703 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-079db923-d5ec-4f6d-b07d-c2b4718f7cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:55.997013 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e9d4b3-e08b-469b-b073-bde3f005d95b admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:56.008345 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d4a457-9060-47d8-b6ed-104c4b81fae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:56.011178 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d4a457-9060-47d8-b6ed-104c4b81fae5 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:56.012135 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d4a457-9060-47d8-b6ed-104c4b81fae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:56.012367 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d4a457-9060-47d8-b6ed-104c4b81fae5 admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:56.015055 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d4a457-9060-47d8-b6ed-104c4b81fae5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:56.017992 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d4a457-9060-47d8-b6ed-104c4b81fae5 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:56.046972 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079db923-d5ec-4f6d-b07d-c2b4718f7cc0 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:56.062900 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 995/2010] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:30:55 2022] POST /identity/v3/users => generated 293 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:30:56.075808 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:56.078839 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d4a457-9060-47d8-b6ed-104c4b81fae5 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:56.135925 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d4a457-9060-47d8-b6ed-104c4b81fae5 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:56.152943 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8486f9-ec05-4424-b1a9-d5f1b6976bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:56.154831 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8486f9-ec05-4424-b1a9-d5f1b6976bad admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:56.157285 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8486f9-ec05-4424-b1a9-d5f1b6976bad admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:56.160533 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8486f9-ec05-4424-b1a9-d5f1b6976bad admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:56.160533 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8486f9-ec05-4424-b1a9-d5f1b6976bad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:56.175255 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8486f9-ec05-4424-b1a9-d5f1b6976bad admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:56.223764 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 996/2011] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:30:56 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:30:56.226084 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938d95c4-4350-4971-ab48-69a6291fb0d3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8b3bb8f689b45b99ed43f672264a26d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:56.226800 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d95c4-4350-4971-ab48-69a6291fb0d3 service glance] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:56.229482 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d95c4-4350-4971-ab48-69a6291fb0d3 service glance] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:56.231043 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d95c4-4350-4971-ab48-69a6291fb0d3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:56.231618 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8486f9-ec05-4424-b1a9-d5f1b6976bad admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:56.256994 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8486f9-ec05-4424-b1a9-d5f1b6976bad admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:56.273356 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a90b82-01d1-45fd-8b90-54fb90bb1e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:56.274926 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a90b82-01d1-45fd-8b90-54fb90bb1e81 admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:56.276258 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a90b82-01d1-45fd-8b90-54fb90bb1e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:56.277282 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a90b82-01d1-45fd-8b90-54fb90bb1e81 admin admin] PATH_INFO: `/v3/projects/e4d5f1b342c24251940ee00919fe28a9/users/5460688586f34e1cab305097c7a7088a/roles/a332ef951db949b0bad7019fbd28a1b9` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:56.322365 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a90b82-01d1-45fd-8b90-54fb90bb1e81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4d5f1b342c24251940ee00919fe28a9, user_id=5460688586f34e1cab305097c7a7088a, role_id=a332ef951db949b0bad7019fbd28a1b9)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:56.331170 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a90b82-01d1-45fd-8b90-54fb90bb1e81 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:56.365527 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 997/2012] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:30:56 2022] PUT /identity/v3/projects/e4d5f1b342c24251940ee00919fe28a9/users/5460688586f34e1cab305097c7a7088a/roles/a332ef951db949b0bad7019fbd28a1b9 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:30:56.371895 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a90b82-01d1-45fd-8b90-54fb90bb1e81 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:56.381294 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938d95c4-4350-4971-ab48-69a6291fb0d3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:56.383022 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938d95c4-4350-4971-ab48-69a6291fb0d3 service glance] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:56.394389 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:56.395365 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1016/2013] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:30:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:30:56.517432 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a90b82-01d1-45fd-8b90-54fb90bb1e81 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:56.526180 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6783523d-daa9-40e5-8525-017aa0f6efc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:56.527740 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783523d-daa9-40e5-8525-017aa0f6efc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:56.527987 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783523d-daa9-40e5-8525-017aa0f6efc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:56.528339 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783523d-daa9-40e5-8525-017aa0f6efc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:56.529597 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6783523d-daa9-40e5-8525-017aa0f6efc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:56.532768 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6783523d-daa9-40e5-8525-017aa0f6efc2 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:56.548293 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 998/2014] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:30:56 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:30:56.554398 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938d95c4-4350-4971-ab48-69a6291fb0d3 service glance] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:56.573226 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938d95c4-4350-4971-ab48-69a6291fb0d3 service glance] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:56.579731 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b02c1d4-545d-4e2b-a495-23a328b136dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:56.580817 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02c1d4-545d-4e2b-a495-23a328b136dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:56.581236 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02c1d4-545d-4e2b-a495-23a328b136dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:56.581709 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02c1d4-545d-4e2b-a495-23a328b136dd admin admin] PATH_INFO: `/v3/projects/e4d5f1b342c24251940ee00919fe28a9/users/5460688586f34e1cab305097c7a7088a/roles/a332ef951db949b0bad7019fbd28a1b9` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:56.584053 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b02c1d4-545d-4e2b-a495-23a328b136dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4d5f1b342c24251940ee00919fe28a9, user_id=5460688586f34e1cab305097c7a7088a, role_id=a332ef951db949b0bad7019fbd28a1b9)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:56.591236 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b02c1d4-545d-4e2b-a495-23a328b136dd admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:56.605118 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1017/2015] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:30:56 2022] PUT /identity/v3/projects/e4d5f1b342c24251940ee00919fe28a9/users/5460688586f34e1cab305097c7a7088a/roles/a332ef951db949b0bad7019fbd28a1b9 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:30:57.905756 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cebdc1e-2580-4dcd-8101-6b9851b3c153 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:57.906511 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cebdc1e-2580-4dcd-8101-6b9851b3c153 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:57.906511 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cebdc1e-2580-4dcd-8101-6b9851b3c153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:57.949790 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-6cebdc1e-2580-4dcd-8101-6b9851b3c153 None None] MFA Rules not processed for user `5460688586f34e1cab305097c7a7088a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:30:57.951022 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-6cebdc1e-2580-4dcd-8101-6b9851b3c153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:58.063156 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 999/2016] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:30:57 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:30:58.076252 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b02c1d4-545d-4e2b-a495-23a328b136dd admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:58.173343 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b02c1d4-545d-4e2b-a495-23a328b136dd admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:58.197201 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9e37ef-163a-4651-81c5-0c2eaf74f00b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e79503178ac54e62ba385467d5617ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:58.198595 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e37ef-163a-4651-81c5-0c2eaf74f00b service cinder] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:58.199188 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e37ef-163a-4651-81c5-0c2eaf74f00b service cinder] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:58.199665 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e37ef-163a-4651-81c5-0c2eaf74f00b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:58.289982 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9e37ef-163a-4651-81c5-0c2eaf74f00b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:58.291617 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9e37ef-163a-4651-81c5-0c2eaf74f00b service cinder] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:58.302367 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1018/2017] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:30:58 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:30:59.803642 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cebdc1e-2580-4dcd-8101-6b9851b3c153 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:59.805483 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-6cebdc1e-2580-4dcd-8101-6b9851b3c153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:59.818838 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cebdc1e-2580-4dcd-8101-6b9851b3c153 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:59.822987 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968a379b-e1d0-454e-a987-05fd0c9ed8e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e79503178ac54e62ba385467d5617ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:59.824244 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a379b-e1d0-454e-a987-05fd0c9ed8e0 service cinder] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:59.824698 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a379b-e1d0-454e-a987-05fd0c9ed8e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:59.825204 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a379b-e1d0-454e-a987-05fd0c9ed8e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:59.836440 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968a379b-e1d0-454e-a987-05fd0c9ed8e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:59.837927 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968a379b-e1d0-454e-a987-05fd0c9ed8e0 service cinder] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:59.854593 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1000/2018] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:30:59 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:31:00.658677 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9e37ef-163a-4651-81c5-0c2eaf74f00b service cinder] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:00.660487 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-bf9e37ef-163a-4651-81c5-0c2eaf74f00b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:00.677713 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:00.750167 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9e37ef-163a-4651-81c5-0c2eaf74f00b service cinder] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:00.755113 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1c7392-d052-4b65-87cd-76c18317e728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:00.755782 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c7392-d052-4b65-87cd-76c18317e728 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:00.756057 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c7392-d052-4b65-87cd-76c18317e728 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:00.756329 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c7392-d052-4b65-87cd-76c18317e728 admin admin] PATH_INFO: `/v3/users/e4415718ec5f45e99b59944c07d122f5` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:00.757584 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1c7392-d052-4b65-87cd-76c18317e728 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4415718ec5f45e99b59944c07d122f5)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:00.759675 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1c7392-d052-4b65-87cd-76c18317e728 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:00.819640 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-9d1c7392-d052-4b65-87cd-76c18317e728 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4415718ec5f45e99b59944c07d122f5'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:00.836080 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-9d1c7392-d052-4b65-87cd-76c18317e728 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4415718ec5f45e99b59944c07d122f5'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:00.844506 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-9d1c7392-d052-4b65-87cd-76c18317e728 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4415718ec5f45e99b59944c07d122f5'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:00.845289 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-9d1c7392-d052-4b65-87cd-76c18317e728 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4415718ec5f45e99b59944c07d122f5'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:00.856025 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-9d1c7392-d052-4b65-87cd-76c18317e728 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4415718ec5f45e99b59944c07d122f5'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:00.867737 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1019/2019] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:31:00 2022] DELETE /identity/v3/users/e4415718ec5f45e99b59944c07d122f5 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:31:00.873451 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592cb47-2074-4c03-bb5a-b5285d417c52 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:00.874328 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592cb47-2074-4c03-bb5a-b5285d417c52 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:00.874601 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592cb47-2074-4c03-bb5a-b5285d417c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:00.903770 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-1592cb47-2074-4c03-bb5a-b5285d417c52 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:31:00.905914 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-1592cb47-2074-4c03-bb5a-b5285d417c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:00.983620 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1001/2020] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:31:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:31:00.995035 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1c7392-d052-4b65-87cd-76c18317e728 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:00.997854 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-9d1c7392-d052-4b65-87cd-76c18317e728 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:01.076655 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1c7392-d052-4b65-87cd-76c18317e728 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:01.081024 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae529d-c928-4d56-b305-cf7038403304 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:01.081853 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae529d-c928-4d56-b305-cf7038403304 service neutron] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:01.082134 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae529d-c928-4d56-b305-cf7038403304 service neutron] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:01.082413 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae529d-c928-4d56-b305-cf7038403304 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:01.095880 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ae529d-c928-4d56-b305-cf7038403304 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:01.097515 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ae529d-c928-4d56-b305-cf7038403304 service neutron] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:01.110296 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1020/2021] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:31:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:31:01.631576 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1592cb47-2074-4c03-bb5a-b5285d417c52 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:01.634357 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-1592cb47-2074-4c03-bb5a-b5285d417c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:01.675373 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1592cb47-2074-4c03-bb5a-b5285d417c52 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:01.689455 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d2f8b-0d7d-4e74-b0ad-869619956a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:01.690750 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d2f8b-0d7d-4e74-b0ad-869619956a35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:01.691524 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d2f8b-0d7d-4e74-b0ad-869619956a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:01.692286 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d2f8b-0d7d-4e74-b0ad-869619956a35 admin admin] PATH_INFO: `/v3/projects/973565e0837b4e16bbd5bfc8967b1706` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:01.694702 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800d2f8b-0d7d-4e74-b0ad-869619956a35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=973565e0837b4e16bbd5bfc8967b1706)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:01.699268 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800d2f8b-0d7d-4e74-b0ad-869619956a35 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:01.724094 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:01.811003 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-800d2f8b-0d7d-4e74-b0ad-869619956a35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '973565e0837b4e16bbd5bfc8967b1706', 'request_id': 'req-800d2f8b-0d7d-4e74-b0ad-869619956a35'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:01.825419 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-800d2f8b-0d7d-4e74-b0ad-869619956a35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '973565e0837b4e16bbd5bfc8967b1706', 'request_id': 'req-800d2f8b-0d7d-4e74-b0ad-869619956a35'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:01.835345 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-800d2f8b-0d7d-4e74-b0ad-869619956a35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '973565e0837b4e16bbd5bfc8967b1706', 'request_id': 'req-800d2f8b-0d7d-4e74-b0ad-869619956a35'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:01.849652 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-800d2f8b-0d7d-4e74-b0ad-869619956a35 admin admin] The token cache is being invalidate because project 973565e0837b4e16bbd5bfc8967b1706 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:31:01.850081 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-800d2f8b-0d7d-4e74-b0ad-869619956a35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:01.850747 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-800d2f8b-0d7d-4e74-b0ad-869619956a35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:01.852389 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1002/2022] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:31:01 2022] DELETE /identity/v3/projects/973565e0837b4e16bbd5bfc8967b1706 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:31:01.858141 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae529d-c928-4d56-b305-cf7038403304 service neutron] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:01.868315 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae529d-c928-4d56-b305-cf7038403304 service neutron] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:01.908679 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:01.937610 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4e4d61-5276-43c7-bccd-6471da35b252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:01.938343 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e4d61-5276-43c7-bccd-6471da35b252 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:01.938625 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e4d61-5276-43c7-bccd-6471da35b252 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:01.938956 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e4d61-5276-43c7-bccd-6471da35b252 admin admin] PATH_INFO: `/v3/users/73f8edcf5bbf47faaa0f1b65ff813946` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:01.940361 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4e4d61-5276-43c7-bccd-6471da35b252 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73f8edcf5bbf47faaa0f1b65ff813946)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:01.942334 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4e4d61-5276-43c7-bccd-6471da35b252 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:01.999628 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-bc4e4d61-5276-43c7-bccd-6471da35b252 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73f8edcf5bbf47faaa0f1b65ff813946'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:02.014446 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-bc4e4d61-5276-43c7-bccd-6471da35b252 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73f8edcf5bbf47faaa0f1b65ff813946'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:02.024873 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-bc4e4d61-5276-43c7-bccd-6471da35b252 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73f8edcf5bbf47faaa0f1b65ff813946'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:02.025682 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-bc4e4d61-5276-43c7-bccd-6471da35b252 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73f8edcf5bbf47faaa0f1b65ff813946'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:02.035604 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-bc4e4d61-5276-43c7-bccd-6471da35b252 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73f8edcf5bbf47faaa0f1b65ff813946'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:02.042792 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1021/2023] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:31:01 2022] DELETE /identity/v3/users/73f8edcf5bbf47faaa0f1b65ff813946 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:31:02.395721 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d2f8b-0d7d-4e74-b0ad-869619956a35 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:02.397251 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-800d2f8b-0d7d-4e74-b0ad-869619956a35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:02.428805 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d2f8b-0d7d-4e74-b0ad-869619956a35 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:02.533530 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2d9f57-33a4-448a-8c08-912647a4c0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:02.534193 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2d9f57-33a4-448a-8c08-912647a4c0b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:02.534494 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2d9f57-33a4-448a-8c08-912647a4c0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:02.534765 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2d9f57-33a4-448a-8c08-912647a4c0b0 admin admin] PATH_INFO: `/v3/projects/9ad09385508541a28aafd4ba7fd3272f` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:02.536136 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2d9f57-33a4-448a-8c08-912647a4c0b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ad09385508541a28aafd4ba7fd3272f)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:02.538977 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2d9f57-33a4-448a-8c08-912647a4c0b0 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:02.601512 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-1e2d9f57-33a4-448a-8c08-912647a4c0b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ad09385508541a28aafd4ba7fd3272f', 'request_id': 'req-1e2d9f57-33a4-448a-8c08-912647a4c0b0'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:02.616728 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-1e2d9f57-33a4-448a-8c08-912647a4c0b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ad09385508541a28aafd4ba7fd3272f', 'request_id': 'req-1e2d9f57-33a4-448a-8c08-912647a4c0b0'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:02.647935 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-1e2d9f57-33a4-448a-8c08-912647a4c0b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ad09385508541a28aafd4ba7fd3272f', 'request_id': 'req-1e2d9f57-33a4-448a-8c08-912647a4c0b0'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:02.682939 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-1e2d9f57-33a4-448a-8c08-912647a4c0b0 admin admin] The token cache is being invalidate because project 9ad09385508541a28aafd4ba7fd3272f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:31:02.682939 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-1e2d9f57-33a4-448a-8c08-912647a4c0b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:02.682939 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-1e2d9f57-33a4-448a-8c08-912647a4c0b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:02.682939 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1003/2024] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:31:02 2022] DELETE /identity/v3/projects/9ad09385508541a28aafd4ba7fd3272f => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:31:02.687460 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd2639-55f4-4148-8d8e-db24265edfd4 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:02.687804 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd2639-55f4-4148-8d8e-db24265edfd4 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:02.688818 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd2639-55f4-4148-8d8e-db24265edfd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:02.712832 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-03cd2639-55f4-4148-8d8e-db24265edfd4 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:31:02.714643 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-03cd2639-55f4-4148-8d8e-db24265edfd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:02.867895 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1022/2025] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:31:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:31:02.872224 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c6e32-d9a3-444b-804f-7be0545bd3f4 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:02.873006 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c6e32-d9a3-444b-804f-7be0545bd3f4 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:02.873657 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c6e32-d9a3-444b-804f-7be0545bd3f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:02.911478 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-191c6e32-d9a3-444b-804f-7be0545bd3f4 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:31:02.913792 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-191c6e32-d9a3-444b-804f-7be0545bd3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:02.937120 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cd2639-55f4-4148-8d8e-db24265edfd4 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:02.941640 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1004/2026] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:31:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:31:02.953262 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cd2639-55f4-4148-8d8e-db24265edfd4 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:02.959091 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8299ee-a805-4626-ab95-57ec3622244c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:02.959899 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8299ee-a805-4626-ab95-57ec3622244c admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:02.960286 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8299ee-a805-4626-ab95-57ec3622244c admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:02.960660 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8299ee-a805-4626-ab95-57ec3622244c admin admin] PATH_INFO: `/v3/domains` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:02.961466 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8299ee-a805-4626-ab95-57ec3622244c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:31:02.962045 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8299ee-a805-4626-ab95-57ec3622244c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:02.963931 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8299ee-a805-4626-ab95-57ec3622244c admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:02.979763 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1023/2027] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 12:31:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:31:02.984980 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191c6e32-d9a3-444b-804f-7be0545bd3f4 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:03.002051 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191c6e32-d9a3-444b-804f-7be0545bd3f4 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:03.010557 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b5fe4-6dfa-4aec-b346-5c29c3b44fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:03.012204 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b5fe4-6dfa-4aec-b346-5c29c3b44fd1 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:03.014926 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b5fe4-6dfa-4aec-b346-5c29c3b44fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:03.014926 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b5fe4-6dfa-4aec-b346-5c29c3b44fd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:03.014926 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5b5fe4-6dfa-4aec-b346-5c29c3b44fd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:03.017633 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5b5fe4-6dfa-4aec-b346-5c29c3b44fd1 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:03.065521 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1005/2028] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:31:02 2022] POST /identity/v3/projects => generated 383 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:31:03.070324 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8299ee-a805-4626-ab95-57ec3622244c admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:03.085211 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8299ee-a805-4626-ab95-57ec3622244c admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:03.182286 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:03.222705 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d630149-f1d0-4325-83cb-440ce65152a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:03.223812 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d630149-f1d0-4325-83cb-440ce65152a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:03.224304 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d630149-f1d0-4325-83cb-440ce65152a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:03.224826 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d630149-f1d0-4325-83cb-440ce65152a7 admin admin] PATH_INFO: `/v3/users` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:03.226708 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d630149-f1d0-4325-83cb-440ce65152a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:03.232065 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d630149-f1d0-4325-83cb-440ce65152a7 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:03.270410 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1024/2029] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:31:03 2022] POST /identity/v3/users => generated 292 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:31:03.276137 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b5fe4-6dfa-4aec-b346-5c29c3b44fd1 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:03.286876 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:03.316438 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b5fe4-6dfa-4aec-b346-5c29c3b44fd1 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:03.328541 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7a9477-dda9-4ac5-8e45-2d0ee9c28402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:03.329189 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a9477-dda9-4ac5-8e45-2d0ee9c28402 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:03.329565 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a9477-dda9-4ac5-8e45-2d0ee9c28402 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:03.329927 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a9477-dda9-4ac5-8e45-2d0ee9c28402 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:03.330885 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7a9477-dda9-4ac5-8e45-2d0ee9c28402 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:03.333033 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7a9477-dda9-4ac5-8e45-2d0ee9c28402 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:03.347870 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1006/2030] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:31:03 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:31:03.353072 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d630149-f1d0-4325-83cb-440ce65152a7 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:03.369946 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d630149-f1d0-4325-83cb-440ce65152a7 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:03.376431 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b176620-28b8-46db-9e5c-fda4f31ca82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:03.377170 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b176620-28b8-46db-9e5c-fda4f31ca82f admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:03.377449 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b176620-28b8-46db-9e5c-fda4f31ca82f admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:03.377730 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b176620-28b8-46db-9e5c-fda4f31ca82f admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:03.378394 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b176620-28b8-46db-9e5c-fda4f31ca82f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:03.380243 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b176620-28b8-46db-9e5c-fda4f31ca82f admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:03.407078 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1025/2031] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:31:03 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:31:03.412331 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7a9477-dda9-4ac5-8e45-2d0ee9c28402 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:03.430484 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7a9477-dda9-4ac5-8e45-2d0ee9c28402 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:03.438764 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de4f1e7-9136-4dfd-a6e5-c483d573fd8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:03.440016 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de4f1e7-9136-4dfd-a6e5-c483d573fd8f admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:03.440613 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de4f1e7-9136-4dfd-a6e5-c483d573fd8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:03.443325 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de4f1e7-9136-4dfd-a6e5-c483d573fd8f admin admin] PATH_INFO: `/v3/projects/c88e75b863414db6a4efa2ca59fd3987/users/a7fce3fd3fd543c8b6fb71b5b5d7e50b/roles/b5cfd7a855a448359e9017f51d32b6fc` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:03.479866 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de4f1e7-9136-4dfd-a6e5-c483d573fd8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c88e75b863414db6a4efa2ca59fd3987, user_id=a7fce3fd3fd543c8b6fb71b5b5d7e50b, role_id=b5cfd7a855a448359e9017f51d32b6fc)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:03.484452 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de4f1e7-9136-4dfd-a6e5-c483d573fd8f admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:03.501946 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1007/2032] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:31:03 2022] PUT /identity/v3/projects/c88e75b863414db6a4efa2ca59fd3987/users/a7fce3fd3fd543c8b6fb71b5b5d7e50b/roles/b5cfd7a855a448359e9017f51d32b6fc => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:31:03.514165 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d3958-e312-42ef-8a68-62cdb991af06 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:03.514455 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d3958-e312-42ef-8a68-62cdb991af06 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:03.514761 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d3958-e312-42ef-8a68-62cdb991af06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:03.547432 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-a41d3958-e312-42ef-8a68-62cdb991af06 None None] MFA Rules not processed for user `a7fce3fd3fd543c8b6fb71b5b5d7e50b`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:31:03.548845 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-a41d3958-e312-42ef-8a68-62cdb991af06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:03.662175 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1026/2033] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:31:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:31:03.670490 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de4f1e7-9136-4dfd-a6e5-c483d573fd8f admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:03.819423 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de4f1e7-9136-4dfd-a6e5-c483d573fd8f admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:03.828896 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741f0750-7ad6-43e5-8d3b-2da8fbcd4ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:03.830059 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f0750-7ad6-43e5-8d3b-2da8fbcd4ae1 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:03.830613 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f0750-7ad6-43e5-8d3b-2da8fbcd4ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:03.831142 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f0750-7ad6-43e5-8d3b-2da8fbcd4ae1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:03.832272 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741f0750-7ad6-43e5-8d3b-2da8fbcd4ae1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:03.836051 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741f0750-7ad6-43e5-8d3b-2da8fbcd4ae1 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:03.878836 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1008/2034] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:31:03 2022] POST /identity/v3/projects => generated 383 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:31:03.885421 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41d3958-e312-42ef-8a68-62cdb991af06 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:03.907065 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41d3958-e312-42ef-8a68-62cdb991af06 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:04.004461 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a226504-5174-4f86-bb0d-18aa6221259d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:04.005234 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a226504-5174-4f86-bb0d-18aa6221259d admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:04.005631 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a226504-5174-4f86-bb0d-18aa6221259d admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:04.005997 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a226504-5174-4f86-bb0d-18aa6221259d admin admin] PATH_INFO: `/v3/users` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:04.006970 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a226504-5174-4f86-bb0d-18aa6221259d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:04.009215 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a226504-5174-4f86-bb0d-18aa6221259d admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:04.040819 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1027/2035] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:31:03 2022] POST /identity/v3/users => generated 298 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:31:04.047034 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741f0750-7ad6-43e5-8d3b-2da8fbcd4ae1 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:04.062369 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741f0750-7ad6-43e5-8d3b-2da8fbcd4ae1 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:04.068186 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7de6895-38e3-4e69-805d-1fc8c09f113b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:04.068939 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de6895-38e3-4e69-805d-1fc8c09f113b admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:04.069294 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de6895-38e3-4e69-805d-1fc8c09f113b admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:04.069640 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de6895-38e3-4e69-805d-1fc8c09f113b admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:04.070397 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7de6895-38e3-4e69-805d-1fc8c09f113b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:04.072207 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7de6895-38e3-4e69-805d-1fc8c09f113b admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:04.085478 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1009/2036] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:31:04 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 12:31:04.090656 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a226504-5174-4f86-bb0d-18aa6221259d admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:04.108169 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a226504-5174-4f86-bb0d-18aa6221259d admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:04.115880 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c08fe53-5fcd-4977-91ea-8e955fe91ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:04.116950 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c08fe53-5fcd-4977-91ea-8e955fe91ac3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:04.117453 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c08fe53-5fcd-4977-91ea-8e955fe91ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:04.117892 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c08fe53-5fcd-4977-91ea-8e955fe91ac3 admin admin] PATH_INFO: `/v3/projects/f9392b67edc144f391b5368ede24f921/users/a0ed4ffc0f1a49408cdc64c1b93793c7/roles/a332ef951db949b0bad7019fbd28a1b9` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:04.147271 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c08fe53-5fcd-4977-91ea-8e955fe91ac3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9392b67edc144f391b5368ede24f921, user_id=a0ed4ffc0f1a49408cdc64c1b93793c7, role_id=a332ef951db949b0bad7019fbd28a1b9)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:04.153927 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c08fe53-5fcd-4977-91ea-8e955fe91ac3 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:04.176471 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1028/2037] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:31:04 2022] PUT /identity/v3/projects/f9392b67edc144f391b5368ede24f921/users/a0ed4ffc0f1a49408cdc64c1b93793c7/roles/a332ef951db949b0bad7019fbd28a1b9 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:31:04.183601 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7de6895-38e3-4e69-805d-1fc8c09f113b admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:04.195526 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7de6895-38e3-4e69-805d-1fc8c09f113b admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:04.301031 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1940dd1-bf3e-44c1-a7b3-732249b61d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:04.301862 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1940dd1-bf3e-44c1-a7b3-732249b61d46 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:04.302317 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1940dd1-bf3e-44c1-a7b3-732249b61d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:04.302568 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1940dd1-bf3e-44c1-a7b3-732249b61d46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:04.303506 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1940dd1-bf3e-44c1-a7b3-732249b61d46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:04.305182 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1940dd1-bf3e-44c1-a7b3-732249b61d46 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:04.319681 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1010/2038] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:31:04 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:31:04.325681 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c08fe53-5fcd-4977-91ea-8e955fe91ac3 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:04.337744 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c08fe53-5fcd-4977-91ea-8e955fe91ac3 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:04.346806 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd4d77c-58b4-4282-9750-ae5589e48199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:04.348166 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd4d77c-58b4-4282-9750-ae5589e48199 admin admin] REQUEST_METHOD: `PUT` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:04.349509 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd4d77c-58b4-4282-9750-ae5589e48199 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:04.350064 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd4d77c-58b4-4282-9750-ae5589e48199 admin admin] PATH_INFO: `/v3/projects/f9392b67edc144f391b5368ede24f921/users/a0ed4ffc0f1a49408cdc64c1b93793c7/roles/a332ef951db949b0bad7019fbd28a1b9` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:04.363682 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd4d77c-58b4-4282-9750-ae5589e48199 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9392b67edc144f391b5368ede24f921, user_id=a0ed4ffc0f1a49408cdc64c1b93793c7, role_id=a332ef951db949b0bad7019fbd28a1b9)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:04.366468 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd4d77c-58b4-4282-9750-ae5589e48199 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:04.408031 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1029/2039] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:31:04 2022] PUT /identity/v3/projects/f9392b67edc144f391b5368ede24f921/users/a0ed4ffc0f1a49408cdc64c1b93793c7/roles/a332ef951db949b0bad7019fbd28a1b9 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:31:04.421594 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15351400-306a-40f8-a48a-0f8e90b16020 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:04.422611 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15351400-306a-40f8-a48a-0f8e90b16020 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:04.423071 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15351400-306a-40f8-a48a-0f8e90b16020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:04.463203 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-15351400-306a-40f8-a48a-0f8e90b16020 None None] MFA Rules not processed for user `a0ed4ffc0f1a49408cdc64c1b93793c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:31:04.465276 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-15351400-306a-40f8-a48a-0f8e90b16020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:04.511573 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:04.589908 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1011/2040] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:31:04 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:31:04.602917 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd4d77c-58b4-4282-9750-ae5589e48199 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:04.606052 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-cbd4d77c-58b4-4282-9750-ae5589e48199 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:04.611876 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:04.695718 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd4d77c-58b4-4282-9750-ae5589e48199 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:04.703816 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545e5457-e30b-4f47-8ce8-35976e6401f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e79503178ac54e62ba385467d5617ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:04.704754 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e5457-e30b-4f47-8ce8-35976e6401f6 service cinder] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:04.705050 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e5457-e30b-4f47-8ce8-35976e6401f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:04.705356 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e5457-e30b-4f47-8ce8-35976e6401f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:04.786844 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545e5457-e30b-4f47-8ce8-35976e6401f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:04.788461 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545e5457-e30b-4f47-8ce8-35976e6401f6 service cinder] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:04.806275 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1030/2041] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:31:04 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:31:09.904203 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15351400-306a-40f8-a48a-0f8e90b16020 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:09.908481 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-15351400-306a-40f8-a48a-0f8e90b16020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:09.924086 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15351400-306a-40f8-a48a-0f8e90b16020 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:09.928247 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17810fdc-284b-42d4-8265-d33925c76377 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e79503178ac54e62ba385467d5617ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:09.928889 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17810fdc-284b-42d4-8265-d33925c76377 service cinder] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:09.929164 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17810fdc-284b-42d4-8265-d33925c76377 service cinder] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:09.929468 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17810fdc-284b-42d4-8265-d33925c76377 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:09.945585 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17810fdc-284b-42d4-8265-d33925c76377 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:09.947433 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17810fdc-284b-42d4-8265-d33925c76377 service cinder] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:09.959934 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1012/2042] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:31:09 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:31:12.741957 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc899ea3-a7ca-4343-9fc1-8d613232b1ff None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:12.743658 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc899ea3-a7ca-4343-9fc1-8d613232b1ff None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:12.743658 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc899ea3-a7ca-4343-9fc1-8d613232b1ff None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:12.747684 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1031/2043] 10.222.0.79 () {54 vars in 921 bytes} [Wed Aug 31 12:31:12 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:31:12.787589 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbdbe37-7bfa-4009-b5d1-f7deeccfc753 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:12.788395 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbdbe37-7bfa-4009-b5d1-f7deeccfc753 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:12.788395 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbdbe37-7bfa-4009-b5d1-f7deeccfc753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:12.816280 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-4cbdbe37-7bfa-4009-b5d1-f7deeccfc753 None None] MFA Rules not processed for user `b6deab40ae6244d4b9affa47b274aea3`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:31:12.817647 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-4cbdbe37-7bfa-4009-b5d1-f7deeccfc753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:12.844803 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc899ea3-a7ca-4343-9fc1-8d613232b1ff None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:12.849650 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-dc899ea3-a7ca-4343-9fc1-8d613232b1ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:12.902845 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1013/2044] 10.222.0.79 () {58 vars in 1018 bytes} [Wed Aug 31 12:31:12 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:31:12.921558 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbdbe37-7bfa-4009-b5d1-f7deeccfc753 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:12.923057 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-4cbdbe37-7bfa-4009-b5d1-f7deeccfc753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:12.944345 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbdbe37-7bfa-4009-b5d1-f7deeccfc753 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:12.954399 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f158da6a-b598-4bcd-a103-fc5ad73fe8f0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6deab40ae6244d4b9affa47b274aea3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:12.955937 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158da6a-b598-4bcd-a103-fc5ad73fe8f0 service placement] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:12.956428 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158da6a-b598-4bcd-a103-fc5ad73fe8f0 service placement] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:12.956912 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158da6a-b598-4bcd-a103-fc5ad73fe8f0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:12.959427 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc899ea3-a7ca-4343-9fc1-8d613232b1ff None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:12.965294 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc637861-9c83-4cf4-a5fc-338a5af8556b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:12.966050 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc637861-9c83-4cf4-a5fc-338a5af8556b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:12.966396 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc637861-9c83-4cf4-a5fc-338a5af8556b admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:12.966743 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc637861-9c83-4cf4-a5fc-338a5af8556b admin admin] PATH_INFO: `/v3/users/f8a3ebaaec7442039ecda2d63c54cc59` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:12.968090 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc637861-9c83-4cf4-a5fc-338a5af8556b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8a3ebaaec7442039ecda2d63c54cc59)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:12.970117 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc637861-9c83-4cf4-a5fc-338a5af8556b admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:12.972495 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f158da6a-b598-4bcd-a103-fc5ad73fe8f0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:12.974652 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f158da6a-b598-4bcd-a103-fc5ad73fe8f0 service placement] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:12.987508 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1014/2045] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:31:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:31:13.044353 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-fc637861-9c83-4cf4-a5fc-338a5af8556b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8a3ebaaec7442039ecda2d63c54cc59'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:13.059003 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:13.066180 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-fc637861-9c83-4cf4-a5fc-338a5af8556b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8a3ebaaec7442039ecda2d63c54cc59'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:13.075064 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-fc637861-9c83-4cf4-a5fc-338a5af8556b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8a3ebaaec7442039ecda2d63c54cc59'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:13.075865 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-fc637861-9c83-4cf4-a5fc-338a5af8556b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8a3ebaaec7442039ecda2d63c54cc59'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:13.084863 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-fc637861-9c83-4cf4-a5fc-338a5af8556b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8a3ebaaec7442039ecda2d63c54cc59'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:13.092209 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1032/2046] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:31:12 2022] DELETE /identity/v3/users/f8a3ebaaec7442039ecda2d63c54cc59 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:31:13.298669 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f158da6a-b598-4bcd-a103-fc5ad73fe8f0 service placement] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:13.317905 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f158da6a-b598-4bcd-a103-fc5ad73fe8f0 service placement] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:13.430597 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b421fd-48b6-4dc9-be96-af8e74a6c968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:13.431819 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b421fd-48b6-4dc9-be96-af8e74a6c968 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:13.432414 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b421fd-48b6-4dc9-be96-af8e74a6c968 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:13.433060 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b421fd-48b6-4dc9-be96-af8e74a6c968 admin admin] PATH_INFO: `/v3/projects/67cc2121d964451892be22fdcdd78b63` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:13.435228 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b421fd-48b6-4dc9-be96-af8e74a6c968 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67cc2121d964451892be22fdcdd78b63)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:13.439113 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b421fd-48b6-4dc9-be96-af8e74a6c968 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:13.501539 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:13.511704 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-37b421fd-48b6-4dc9-be96-af8e74a6c968 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67cc2121d964451892be22fdcdd78b63', 'request_id': 'req-37b421fd-48b6-4dc9-be96-af8e74a6c968'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:13.525680 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-37b421fd-48b6-4dc9-be96-af8e74a6c968 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67cc2121d964451892be22fdcdd78b63', 'request_id': 'req-37b421fd-48b6-4dc9-be96-af8e74a6c968'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:13.538114 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-37b421fd-48b6-4dc9-be96-af8e74a6c968 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67cc2121d964451892be22fdcdd78b63', 'request_id': 'req-37b421fd-48b6-4dc9-be96-af8e74a6c968'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:13.555211 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-37b421fd-48b6-4dc9-be96-af8e74a6c968 admin admin] The token cache is being invalidate because project 67cc2121d964451892be22fdcdd78b63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:31:13.555488 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-37b421fd-48b6-4dc9-be96-af8e74a6c968 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:13.556450 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-37b421fd-48b6-4dc9-be96-af8e74a6c968 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:13.558134 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1015/2047] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:31:13 2022] DELETE /identity/v3/projects/67cc2121d964451892be22fdcdd78b63 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:31:13.566641 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b707cd-952a-48b0-b1df-c6797ce39fa0 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:13.567170 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b707cd-952a-48b0-b1df-c6797ce39fa0 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:13.567662 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b707cd-952a-48b0-b1df-c6797ce39fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:13.602700 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-b7b707cd-952a-48b0-b1df-c6797ce39fa0 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:31:13.603987 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-b7b707cd-952a-48b0-b1df-c6797ce39fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:13.702881 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1033/2048] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:31:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:31:13.715069 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d3f8d-e920-4da9-a0fa-fc1d4d0f1430 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:13.715662 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d3f8d-e920-4da9-a0fa-fc1d4d0f1430 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:13.715966 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d3f8d-e920-4da9-a0fa-fc1d4d0f1430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:13.739454 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-8b9d3f8d-e920-4da9-a0fa-fc1d4d0f1430 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:31:13.740818 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-8b9d3f8d-e920-4da9-a0fa-fc1d4d0f1430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:13.750962 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1016/2049] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:31:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:31:13.755811 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b707cd-952a-48b0-b1df-c6797ce39fa0 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:13.773317 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b707cd-952a-48b0-b1df-c6797ce39fa0 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:13.781856 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5da663e-b513-4a98-9d49-6df390b4cc78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:13.782909 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da663e-b513-4a98-9d49-6df390b4cc78 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:13.783388 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da663e-b513-4a98-9d49-6df390b4cc78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:13.783845 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da663e-b513-4a98-9d49-6df390b4cc78 admin admin] PATH_INFO: `/v3/domains` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:13.785051 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5da663e-b513-4a98-9d49-6df390b4cc78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:31:13.785592 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5da663e-b513-4a98-9d49-6df390b4cc78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:13.788606 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5da663e-b513-4a98-9d49-6df390b4cc78 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:13.811681 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1034/2050] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 12:31:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:31:13.816895 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9d3f8d-e920-4da9-a0fa-fc1d4d0f1430 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:13.828075 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9d3f8d-e920-4da9-a0fa-fc1d4d0f1430 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:13.833461 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409d8c33-0c33-433c-b38f-7eb0f0d5972e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:13.834112 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409d8c33-0c33-433c-b38f-7eb0f0d5972e admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:13.834377 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409d8c33-0c33-433c-b38f-7eb0f0d5972e admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:13.834664 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409d8c33-0c33-433c-b38f-7eb0f0d5972e admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:13.835365 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409d8c33-0c33-433c-b38f-7eb0f0d5972e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:13.837341 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409d8c33-0c33-433c-b38f-7eb0f0d5972e admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:13.877528 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1017/2051] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:31:13 2022] POST /identity/v3/projects => generated 383 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:31:13.882662 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5da663e-b513-4a98-9d49-6df390b4cc78 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:13.901132 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5da663e-b513-4a98-9d49-6df390b4cc78 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:14.005938 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b5976c-c2e1-460c-a3e9-a599972100d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:14.006492 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5976c-c2e1-460c-a3e9-a599972100d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:14.006835 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5976c-c2e1-460c-a3e9-a599972100d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:14.007152 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5976c-c2e1-460c-a3e9-a599972100d1 admin admin] PATH_INFO: `/v3/users` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:14.008264 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b5976c-c2e1-460c-a3e9-a599972100d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:14.010522 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b5976c-c2e1-460c-a3e9-a599972100d1 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:14.040057 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1035/2052] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:31:13 2022] POST /identity/v3/users => generated 292 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:31:14.046272 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409d8c33-0c33-433c-b38f-7eb0f0d5972e admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:14.062677 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409d8c33-0c33-433c-b38f-7eb0f0d5972e admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:14.068502 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09df6488-5571-4b64-b691-4a6283b75afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:14.069148 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09df6488-5571-4b64-b691-4a6283b75afb admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:14.069454 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09df6488-5571-4b64-b691-4a6283b75afb admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:14.069721 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09df6488-5571-4b64-b691-4a6283b75afb admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:14.070388 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09df6488-5571-4b64-b691-4a6283b75afb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:14.072067 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09df6488-5571-4b64-b691-4a6283b75afb admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:14.091101 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1018/2053] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:31:14 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:31:14.095496 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b5976c-c2e1-460c-a3e9-a599972100d1 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:14.109056 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b5976c-c2e1-460c-a3e9-a599972100d1 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:14.115452 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb278e58-0e14-4751-9886-71b62cb7ccf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:14.116313 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb278e58-0e14-4751-9886-71b62cb7ccf6 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:14.116685 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb278e58-0e14-4751-9886-71b62cb7ccf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:14.117051 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb278e58-0e14-4751-9886-71b62cb7ccf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:14.117842 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb278e58-0e14-4751-9886-71b62cb7ccf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:14.119689 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb278e58-0e14-4751-9886-71b62cb7ccf6 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:14.132930 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1036/2054] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:31:14 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:31:14.139133 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09df6488-5571-4b64-b691-4a6283b75afb admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:14.151243 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09df6488-5571-4b64-b691-4a6283b75afb admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:14.157823 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f978d591-abad-4c2e-9318-e17724d0f964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:14.158549 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f978d591-abad-4c2e-9318-e17724d0f964 admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:14.158834 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f978d591-abad-4c2e-9318-e17724d0f964 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:14.159150 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f978d591-abad-4c2e-9318-e17724d0f964 admin admin] PATH_INFO: `/v3/projects/de2fca6d439946e28588e2f3fedfe74f/users/46980487b9a44c0d9849625301d2b997/roles/b5cfd7a855a448359e9017f51d32b6fc` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:14.175967 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f978d591-abad-4c2e-9318-e17724d0f964 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de2fca6d439946e28588e2f3fedfe74f, user_id=46980487b9a44c0d9849625301d2b997, role_id=b5cfd7a855a448359e9017f51d32b6fc)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:14.178664 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f978d591-abad-4c2e-9318-e17724d0f964 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:14.192971 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1019/2055] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:31:14 2022] PUT /identity/v3/projects/de2fca6d439946e28588e2f3fedfe74f/users/46980487b9a44c0d9849625301d2b997/roles/b5cfd7a855a448359e9017f51d32b6fc => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:31:14.204672 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06987928-9595-4161-b9bf-5e687df51539 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:14.204962 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06987928-9595-4161-b9bf-5e687df51539 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:14.205242 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06987928-9595-4161-b9bf-5e687df51539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:14.244062 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-06987928-9595-4161-b9bf-5e687df51539 None None] MFA Rules not processed for user `46980487b9a44c0d9849625301d2b997`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:31:14.245342 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-06987928-9595-4161-b9bf-5e687df51539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:14.283642 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:14.328658 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1037/2056] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:31:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:31:14.340529 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f978d591-abad-4c2e-9318-e17724d0f964 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:14.342359 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-f978d591-abad-4c2e-9318-e17724d0f964 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:14.440721 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f978d591-abad-4c2e-9318-e17724d0f964 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:14.447271 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a59abf-0b3a-4e48-9f11-bb76826fe334 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62401c8e1457450590f4147e0665265a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:14.447913 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a59abf-0b3a-4e48-9f11-bb76826fe334 service nova] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:14.448193 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a59abf-0b3a-4e48-9f11-bb76826fe334 service nova] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:14.449044 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a59abf-0b3a-4e48-9f11-bb76826fe334 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:14.459173 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a59abf-0b3a-4e48-9f11-bb76826fe334 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:14.460997 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a59abf-0b3a-4e48-9f11-bb76826fe334 service nova] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:14.472950 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1020/2057] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:31:14 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:31:21.202103 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec67e5b-95ac-41ac-be6b-dcf92cd1226a None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:21.202694 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec67e5b-95ac-41ac-be6b-dcf92cd1226a None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:21.202791 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec67e5b-95ac-41ac-be6b-dcf92cd1226a None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:21.204240 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1038/2058] 10.222.0.79 () {54 vars in 921 bytes} [Wed Aug 31 12:31:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:31:21.227239 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92de2a6-ec75-4859-9588-5c8763859ccb None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:21.228062 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92de2a6-ec75-4859-9588-5c8763859ccb None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:21.228218 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92de2a6-ec75-4859-9588-5c8763859ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:21.252662 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-b92de2a6-ec75-4859-9588-5c8763859ccb None None] MFA Rules not processed for user `b6deab40ae6244d4b9affa47b274aea3`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:31:21.254224 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-b92de2a6-ec75-4859-9588-5c8763859ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:21.330707 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:21.401972 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1021/2059] 10.222.0.79 () {58 vars in 1018 bytes} [Wed Aug 31 12:31:21 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:31:21.424409 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec67e5b-95ac-41ac-be6b-dcf92cd1226a None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:21.427522 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-4ec67e5b-95ac-41ac-be6b-dcf92cd1226a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:21.450582 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec67e5b-95ac-41ac-be6b-dcf92cd1226a None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:21.457083 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96623c7-39f0-43d0-8925-b937c4a8af12 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6deab40ae6244d4b9affa47b274aea3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:21.457751 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96623c7-39f0-43d0-8925-b937c4a8af12 service placement] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:21.458026 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96623c7-39f0-43d0-8925-b937c4a8af12 service placement] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:21.458301 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96623c7-39f0-43d0-8925-b937c4a8af12 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:21.468962 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96623c7-39f0-43d0-8925-b937c4a8af12 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:21.470654 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96623c7-39f0-43d0-8925-b937c4a8af12 service placement] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:21.487384 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1039/2060] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:31:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:31:22.124224 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92de2a6-ec75-4859-9588-5c8763859ccb None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:22.126261 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-b92de2a6-ec75-4859-9588-5c8763859ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:22.216317 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92de2a6-ec75-4859-9588-5c8763859ccb None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:22.221339 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7c8bc1-14fa-4b7f-a4a0-b04231a188f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:22.222326 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c8bc1-14fa-4b7f-a4a0-b04231a188f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:22.222589 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c8bc1-14fa-4b7f-a4a0-b04231a188f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:22.223022 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c8bc1-14fa-4b7f-a4a0-b04231a188f0 admin admin] PATH_INFO: `/v3/users/575e4af8587c4c61a3178f5eeef0b729` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:22.225166 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7c8bc1-14fa-4b7f-a4a0-b04231a188f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=575e4af8587c4c61a3178f5eeef0b729)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:22.229355 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7c8bc1-14fa-4b7f-a4a0-b04231a188f0 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:22.298627 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-6e7c8bc1-14fa-4b7f-a4a0-b04231a188f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '575e4af8587c4c61a3178f5eeef0b729'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:22.314903 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-6e7c8bc1-14fa-4b7f-a4a0-b04231a188f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '575e4af8587c4c61a3178f5eeef0b729'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:22.315651 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-6e7c8bc1-14fa-4b7f-a4a0-b04231a188f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '575e4af8587c4c61a3178f5eeef0b729'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:22.325754 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-6e7c8bc1-14fa-4b7f-a4a0-b04231a188f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '575e4af8587c4c61a3178f5eeef0b729'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:22.327544 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-6e7c8bc1-14fa-4b7f-a4a0-b04231a188f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '575e4af8587c4c61a3178f5eeef0b729'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:22.347999 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1022/2061] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:31:22 2022] DELETE /identity/v3/users/575e4af8587c4c61a3178f5eeef0b729 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:31:22.582683 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96623c7-39f0-43d0-8925-b937c4a8af12 service placement] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:22.606527 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96623c7-39f0-43d0-8925-b937c4a8af12 service placement] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:22.712983 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4160201-132a-4d83-8ad7-a544c06097e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:22.713640 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4160201-132a-4d83-8ad7-a544c06097e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:22.714626 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4160201-132a-4d83-8ad7-a544c06097e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:22.714946 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4160201-132a-4d83-8ad7-a544c06097e4 admin admin] PATH_INFO: `/v3/projects/1bf89e9ca27940b8be7aaf4faf5d9919` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:22.716231 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4160201-132a-4d83-8ad7-a544c06097e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bf89e9ca27940b8be7aaf4faf5d9919)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:22.718231 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4160201-132a-4d83-8ad7-a544c06097e4 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:22.803765 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-e4160201-132a-4d83-8ad7-a544c06097e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bf89e9ca27940b8be7aaf4faf5d9919', 'request_id': 'req-e4160201-132a-4d83-8ad7-a544c06097e4'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:22.813847 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-e4160201-132a-4d83-8ad7-a544c06097e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bf89e9ca27940b8be7aaf4faf5d9919', 'request_id': 'req-e4160201-132a-4d83-8ad7-a544c06097e4'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:22.821289 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-e4160201-132a-4d83-8ad7-a544c06097e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bf89e9ca27940b8be7aaf4faf5d9919', 'request_id': 'req-e4160201-132a-4d83-8ad7-a544c06097e4'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:22.834316 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-e4160201-132a-4d83-8ad7-a544c06097e4 admin admin] The token cache is being invalidate because project 1bf89e9ca27940b8be7aaf4faf5d9919 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:31:22.834598 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-e4160201-132a-4d83-8ad7-a544c06097e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:22.835575 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-e4160201-132a-4d83-8ad7-a544c06097e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:22.837132 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1040/2062] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:31:22 2022] DELETE /identity/v3/projects/1bf89e9ca27940b8be7aaf4faf5d9919 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:31:22.841319 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7c8bc1-14fa-4b7f-a4a0-b04231a188f0 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:22.842803 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-6e7c8bc1-14fa-4b7f-a4a0-b04231a188f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:22.857332 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7c8bc1-14fa-4b7f-a4a0-b04231a188f0 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:22.952551 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f4227-b33f-47ae-8e2e-df9cf3fc4317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:22.953656 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f4227-b33f-47ae-8e2e-df9cf3fc4317 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:22.954138 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f4227-b33f-47ae-8e2e-df9cf3fc4317 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:22.954605 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f4227-b33f-47ae-8e2e-df9cf3fc4317 admin admin] PATH_INFO: `/v3/users/5460688586f34e1cab305097c7a7088a` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:22.956691 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5f4227-b33f-47ae-8e2e-df9cf3fc4317 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5460688586f34e1cab305097c7a7088a)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:22.960553 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5f4227-b33f-47ae-8e2e-df9cf3fc4317 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:22.963460 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:23.035019 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-cf5f4227-b33f-47ae-8e2e-df9cf3fc4317 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5460688586f34e1cab305097c7a7088a'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:23.050270 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-cf5f4227-b33f-47ae-8e2e-df9cf3fc4317 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5460688586f34e1cab305097c7a7088a'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:23.051019 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-cf5f4227-b33f-47ae-8e2e-df9cf3fc4317 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5460688586f34e1cab305097c7a7088a'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:23.060016 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-cf5f4227-b33f-47ae-8e2e-df9cf3fc4317 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5460688586f34e1cab305097c7a7088a'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:23.060788 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-cf5f4227-b33f-47ae-8e2e-df9cf3fc4317 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5460688586f34e1cab305097c7a7088a'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:23.077593 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1023/2063] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:31:22 2022] DELETE /identity/v3/users/5460688586f34e1cab305097c7a7088a => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:31:23.306708 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4160201-132a-4d83-8ad7-a544c06097e4 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:23.309382 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-e4160201-132a-4d83-8ad7-a544c06097e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:23.325921 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4160201-132a-4d83-8ad7-a544c06097e4 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:23.391746 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:23.407529 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdce4b1-9468-4cbc-96f4-9299e76b353f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:23.408186 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdce4b1-9468-4cbc-96f4-9299e76b353f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:23.408468 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdce4b1-9468-4cbc-96f4-9299e76b353f admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:23.408743 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdce4b1-9468-4cbc-96f4-9299e76b353f admin admin] PATH_INFO: `/v3/projects/e4d5f1b342c24251940ee00919fe28a9` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:23.409939 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdce4b1-9468-4cbc-96f4-9299e76b353f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4d5f1b342c24251940ee00919fe28a9)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:23.411976 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdce4b1-9468-4cbc-96f4-9299e76b353f admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:23.469080 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-6bdce4b1-9468-4cbc-96f4-9299e76b353f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4d5f1b342c24251940ee00919fe28a9', 'request_id': 'req-6bdce4b1-9468-4cbc-96f4-9299e76b353f'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:23.478357 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-6bdce4b1-9468-4cbc-96f4-9299e76b353f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4d5f1b342c24251940ee00919fe28a9', 'request_id': 'req-6bdce4b1-9468-4cbc-96f4-9299e76b353f'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:23.486584 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-6bdce4b1-9468-4cbc-96f4-9299e76b353f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4d5f1b342c24251940ee00919fe28a9', 'request_id': 'req-6bdce4b1-9468-4cbc-96f4-9299e76b353f'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:23.498820 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-6bdce4b1-9468-4cbc-96f4-9299e76b353f admin admin] The token cache is being invalidate because project e4d5f1b342c24251940ee00919fe28a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:31:23.499292 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-6bdce4b1-9468-4cbc-96f4-9299e76b353f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:23.499984 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-6bdce4b1-9468-4cbc-96f4-9299e76b353f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:23.502758 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1041/2064] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:31:23 2022] DELETE /identity/v3/projects/e4d5f1b342c24251940ee00919fe28a9 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:31:23.506925 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b45309d-ff46-4ee2-8809-f00a198d5c49 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:23.507735 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b45309d-ff46-4ee2-8809-f00a198d5c49 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:23.507735 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b45309d-ff46-4ee2-8809-f00a198d5c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:23.531405 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-5b45309d-ff46-4ee2-8809-f00a198d5c49 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:31:23.532706 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-5b45309d-ff46-4ee2-8809-f00a198d5c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:23.644775 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1024/2065] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:31:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:31:23.653815 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037c66c0-12cf-4319-9803-f884ec929dac None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:23.654383 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037c66c0-12cf-4319-9803-f884ec929dac None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:23.654383 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037c66c0-12cf-4319-9803-f884ec929dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:23.677699 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-037c66c0-12cf-4319-9803-f884ec929dac None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:31:23.679008 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-037c66c0-12cf-4319-9803-f884ec929dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:23.689087 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1042/2066] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:31:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:31:23.694280 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b45309d-ff46-4ee2-8809-f00a198d5c49 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:23.706579 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b45309d-ff46-4ee2-8809-f00a198d5c49 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:23.711346 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a3e10c-2ba8-4266-b5a2-ad9e0474fedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:23.711983 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a3e10c-2ba8-4266-b5a2-ad9e0474fedb admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:23.712285 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a3e10c-2ba8-4266-b5a2-ad9e0474fedb admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:23.712596 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a3e10c-2ba8-4266-b5a2-ad9e0474fedb admin admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:23.713241 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a3e10c-2ba8-4266-b5a2-ad9e0474fedb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:31:23.713543 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a3e10c-2ba8-4266-b5a2-ad9e0474fedb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:23.716459 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a3e10c-2ba8-4266-b5a2-ad9e0474fedb admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:23.732356 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1025/2067] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 12:31:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:31:23.736727 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037c66c0-12cf-4319-9803-f884ec929dac None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:23.747209 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037c66c0-12cf-4319-9803-f884ec929dac None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:23.752669 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eb60aa-d011-4bc6-8ed3-4fd9d552ef83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:23.753325 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb60aa-d011-4bc6-8ed3-4fd9d552ef83 admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:23.753606 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb60aa-d011-4bc6-8ed3-4fd9d552ef83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:23.753875 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb60aa-d011-4bc6-8ed3-4fd9d552ef83 admin admin] PATH_INFO: `/v3/projects` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:23.754562 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eb60aa-d011-4bc6-8ed3-4fd9d552ef83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:23.756566 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eb60aa-d011-4bc6-8ed3-4fd9d552ef83 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:23.789882 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1043/2068] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:31:23 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:31:23.796709 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a3e10c-2ba8-4266-b5a2-ad9e0474fedb admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:23.807915 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a3e10c-2ba8-4266-b5a2-ad9e0474fedb admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:23.878293 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75efdfa8-a815-4451-9ec7-485410445e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:23.878996 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75efdfa8-a815-4451-9ec7-485410445e40 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:23.879279 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75efdfa8-a815-4451-9ec7-485410445e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:23.879624 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75efdfa8-a815-4451-9ec7-485410445e40 admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:23.880293 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75efdfa8-a815-4451-9ec7-485410445e40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:23.882349 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75efdfa8-a815-4451-9ec7-485410445e40 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:23.897145 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:23.923981 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1026/2069] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:31:23 2022] POST /identity/v3/users => generated 292 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:31:23.925025 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eb60aa-d011-4bc6-8ed3-4fd9d552ef83 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:23.937331 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eb60aa-d011-4bc6-8ed3-4fd9d552ef83 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:23.943532 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58624576-607d-4efb-9170-ee329c9fbaf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:23.944153 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58624576-607d-4efb-9170-ee329c9fbaf1 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:23.944431 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58624576-607d-4efb-9170-ee329c9fbaf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:23.944703 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58624576-607d-4efb-9170-ee329c9fbaf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:23.945384 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58624576-607d-4efb-9170-ee329c9fbaf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:23.947027 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58624576-607d-4efb-9170-ee329c9fbaf1 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:23.962154 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1044/2070] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:31:23 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 12:31:23.970031 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75efdfa8-a815-4451-9ec7-485410445e40 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:23.987809 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75efdfa8-a815-4451-9ec7-485410445e40 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:23.993997 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378cfb62-8f0e-4485-8d7f-2fbe010957ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:23.994653 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378cfb62-8f0e-4485-8d7f-2fbe010957ae admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:23.995052 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378cfb62-8f0e-4485-8d7f-2fbe010957ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:23.995373 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378cfb62-8f0e-4485-8d7f-2fbe010957ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:23.996994 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378cfb62-8f0e-4485-8d7f-2fbe010957ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:23.999973 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378cfb62-8f0e-4485-8d7f-2fbe010957ae admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:24.013820 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1027/2071] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:31:23 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:31:24.019129 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58624576-607d-4efb-9170-ee329c9fbaf1 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:24.033393 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58624576-607d-4efb-9170-ee329c9fbaf1 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:24.039063 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627f7fa1-c7cc-48aa-a96b-6fe26e59e329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:24.039755 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f7fa1-c7cc-48aa-a96b-6fe26e59e329 admin admin] REQUEST_METHOD: `PUT` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:24.040032 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f7fa1-c7cc-48aa-a96b-6fe26e59e329 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:24.041149 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f7fa1-c7cc-48aa-a96b-6fe26e59e329 admin admin] PATH_INFO: `/v3/projects/1e7f236c21b644ed90112b6e60e52e65/users/ac21d0e500224428bb8f2db075e63a6e/roles/b5cfd7a855a448359e9017f51d32b6fc` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:24.062647 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627f7fa1-c7cc-48aa-a96b-6fe26e59e329 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e7f236c21b644ed90112b6e60e52e65, user_id=ac21d0e500224428bb8f2db075e63a6e, role_id=b5cfd7a855a448359e9017f51d32b6fc)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:24.066254 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627f7fa1-c7cc-48aa-a96b-6fe26e59e329 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:24.090137 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1045/2072] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:31:24 2022] PUT /identity/v3/projects/1e7f236c21b644ed90112b6e60e52e65/users/ac21d0e500224428bb8f2db075e63a6e/roles/b5cfd7a855a448359e9017f51d32b6fc => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:31:24.111922 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69f1df3-124e-4efe-beba-2ed5edc0c40b None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:24.112522 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69f1df3-124e-4efe-beba-2ed5edc0c40b None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:24.113032 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69f1df3-124e-4efe-beba-2ed5edc0c40b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:24.155728 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-d69f1df3-124e-4efe-beba-2ed5edc0c40b None None] MFA Rules not processed for user `ac21d0e500224428bb8f2db075e63a6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:31:24.157012 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-d69f1df3-124e-4efe-beba-2ed5edc0c40b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:24.218193 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627f7fa1-c7cc-48aa-a96b-6fe26e59e329 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:24.221094 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-627f7fa1-c7cc-48aa-a96b-6fe26e59e329 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:24.249341 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1028/2073] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:31:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:31:24.254972 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69f1df3-124e-4efe-beba-2ed5edc0c40b None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:24.341463 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627f7fa1-c7cc-48aa-a96b-6fe26e59e329 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:24.356690 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69f1df3-124e-4efe-beba-2ed5edc0c40b None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:24.356907 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25d9f8a-18cd-4557-b10e-4f66be54d832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:24.356907 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25d9f8a-18cd-4557-b10e-4f66be54d832 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:24.356907 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25d9f8a-18cd-4557-b10e-4f66be54d832 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:24.356907 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25d9f8a-18cd-4557-b10e-4f66be54d832 admin admin] PATH_INFO: `/v3/users/a7fce3fd3fd543c8b6fb71b5b5d7e50b` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:24.359778 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25d9f8a-18cd-4557-b10e-4f66be54d832 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7fce3fd3fd543c8b6fb71b5b5d7e50b)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:24.361778 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25d9f8a-18cd-4557-b10e-4f66be54d832 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:24.368686 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813a02d7-60a9-46fa-887e-c55e0f6f7af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:24.369709 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a02d7-60a9-46fa-887e-c55e0f6f7af0 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:24.370732 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a02d7-60a9-46fa-887e-c55e0f6f7af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:24.371238 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a02d7-60a9-46fa-887e-c55e0f6f7af0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:24.372419 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813a02d7-60a9-46fa-887e-c55e0f6f7af0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:24.377522 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813a02d7-60a9-46fa-887e-c55e0f6f7af0 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:24.391954 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:24.434374 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1029/2074] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:31:24 2022] POST /identity/v3/projects => generated 383 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:31:24.439081 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813a02d7-60a9-46fa-887e-c55e0f6f7af0 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:24.451814 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-b25d9f8a-18cd-4557-b10e-4f66be54d832 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7fce3fd3fd543c8b6fb71b5b5d7e50b'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:24.478806 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-b25d9f8a-18cd-4557-b10e-4f66be54d832 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7fce3fd3fd543c8b6fb71b5b5d7e50b'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:24.494768 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-b25d9f8a-18cd-4557-b10e-4f66be54d832 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7fce3fd3fd543c8b6fb71b5b5d7e50b'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:24.496189 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-b25d9f8a-18cd-4557-b10e-4f66be54d832 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7fce3fd3fd543c8b6fb71b5b5d7e50b'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:24.516866 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-b25d9f8a-18cd-4557-b10e-4f66be54d832 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7fce3fd3fd543c8b6fb71b5b5d7e50b'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:24.528763 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1046/2075] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:31:24 2022] DELETE /identity/v3/users/a7fce3fd3fd543c8b6fb71b5b5d7e50b => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:31:24.535027 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd15ea84-bd0d-4ae9-bc0e-655a944c9b05 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:24.535535 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd15ea84-bd0d-4ae9-bc0e-655a944c9b05 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:24.536056 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd15ea84-bd0d-4ae9-bc0e-655a944c9b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:24.571838 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-fd15ea84-bd0d-4ae9-bc0e-655a944c9b05 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:31:24.574606 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-fd15ea84-bd0d-4ae9-bc0e-655a944c9b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:24.581555 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813a02d7-60a9-46fa-887e-c55e0f6f7af0 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:24.590106 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:24.683845 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1047/2076] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:31:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:31:24.699263 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb3bbb3-4491-4eb7-94cc-1bb77060ba9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:24.700024 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd15ea84-bd0d-4ae9-bc0e-655a944c9b05 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:24.700208 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3bbb3-4491-4eb7-94cc-1bb77060ba9e admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:24.700592 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3bbb3-4491-4eb7-94cc-1bb77060ba9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:24.701045 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3bbb3-4491-4eb7-94cc-1bb77060ba9e admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:24.701856 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb3bbb3-4491-4eb7-94cc-1bb77060ba9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:24.702053 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-fd15ea84-bd0d-4ae9-bc0e-655a944c9b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:24.704290 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb3bbb3-4491-4eb7-94cc-1bb77060ba9e admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:24.732827 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1030/2077] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:31:24 2022] POST /identity/v3/users => generated 292 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:31:24.737431 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb3bbb3-4491-4eb7-94cc-1bb77060ba9e admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:24.739552 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-acb3bbb3-4491-4eb7-94cc-1bb77060ba9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:24.759135 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb3bbb3-4491-4eb7-94cc-1bb77060ba9e admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:24.772375 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00842ef-8014-463d-a3fb-b81ae8d51221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:24.773729 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00842ef-8014-463d-a3fb-b81ae8d51221 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:24.774183 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00842ef-8014-463d-a3fb-b81ae8d51221 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:24.774632 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00842ef-8014-463d-a3fb-b81ae8d51221 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:24.775758 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00842ef-8014-463d-a3fb-b81ae8d51221 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:24.783751 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00842ef-8014-463d-a3fb-b81ae8d51221 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:24.791269 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd15ea84-bd0d-4ae9-bc0e-655a944c9b05 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:24.796465 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c7e05f-0461-4eb9-acbc-a0e0d294b0a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:24.797159 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c7e05f-0461-4eb9-acbc-a0e0d294b0a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:24.797440 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c7e05f-0461-4eb9-acbc-a0e0d294b0a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:24.797818 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c7e05f-0461-4eb9-acbc-a0e0d294b0a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:24.809935 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c7e05f-0461-4eb9-acbc-a0e0d294b0a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:24.811476 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c7e05f-0461-4eb9-acbc-a0e0d294b0a5 service neutron] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:24.812918 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1031/2078] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:31:24 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:31:24.820015 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00842ef-8014-463d-a3fb-b81ae8d51221 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:24.829042 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1048/2079] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:31:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:31:24.845082 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00842ef-8014-463d-a3fb-b81ae8d51221 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:24.854392 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0cc110-8948-4132-a040-910d2c7b7fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:24.855534 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0cc110-8948-4132-a040-910d2c7b7fee admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:24.856411 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0cc110-8948-4132-a040-910d2c7b7fee admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:24.857030 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0cc110-8948-4132-a040-910d2c7b7fee admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:24.858365 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0cc110-8948-4132-a040-910d2c7b7fee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:24.861838 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0cc110-8948-4132-a040-910d2c7b7fee admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:24.892090 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1032/2080] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:31:24 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:31:24.894047 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c7e05f-0461-4eb9-acbc-a0e0d294b0a5 service neutron] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:24.916848 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c7e05f-0461-4eb9-acbc-a0e0d294b0a5 service neutron] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:24.926022 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a4500d-0d89-48d9-8266-f6215c3591a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:24.927202 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4500d-0d89-48d9-8266-f6215c3591a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:24.927694 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4500d-0d89-48d9-8266-f6215c3591a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:24.928181 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4500d-0d89-48d9-8266-f6215c3591a9 admin admin] PATH_INFO: `/v3/projects/ccbdb10cd505494bad4fadf549bd0473/users/47d1624496c3454c97ae529bbe45bf21/roles/b5cfd7a855a448359e9017f51d32b6fc` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:24.959849 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a4500d-0d89-48d9-8266-f6215c3591a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccbdb10cd505494bad4fadf549bd0473, user_id=47d1624496c3454c97ae529bbe45bf21, role_id=b5cfd7a855a448359e9017f51d32b6fc)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:24.967641 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a4500d-0d89-48d9-8266-f6215c3591a9 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:24.993633 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1049/2081] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:31:24 2022] PUT /identity/v3/projects/ccbdb10cd505494bad4fadf549bd0473/users/47d1624496c3454c97ae529bbe45bf21/roles/b5cfd7a855a448359e9017f51d32b6fc => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:31:25.012791 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4859693c-966e-4b81-afb4-6f594aab02fb None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:25.013603 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4859693c-966e-4b81-afb4-6f594aab02fb None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:25.014149 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4859693c-966e-4b81-afb4-6f594aab02fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:25.070197 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-4859693c-966e-4b81-afb4-6f594aab02fb None None] MFA Rules not processed for user `47d1624496c3454c97ae529bbe45bf21`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:31:25.073713 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-4859693c-966e-4b81-afb4-6f594aab02fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:25.224781 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1033/2082] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:31:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:31:25.229876 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a4500d-0d89-48d9-8266-f6215c3591a9 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:25.259943 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:25.334634 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a4500d-0d89-48d9-8266-f6215c3591a9 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:25.338486 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4859693c-966e-4b81-afb4-6f594aab02fb None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:25.340848 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-4859693c-966e-4b81-afb4-6f594aab02fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:25.345762 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dce6e19-185e-4ddb-a266-d51b7f5741d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:25.347145 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce6e19-185e-4ddb-a266-d51b7f5741d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:25.347855 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce6e19-185e-4ddb-a266-d51b7f5741d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:25.348343 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce6e19-185e-4ddb-a266-d51b7f5741d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:25.349512 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dce6e19-185e-4ddb-a266-d51b7f5741d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:25.355212 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dce6e19-185e-4ddb-a266-d51b7f5741d6 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:25.363790 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4859693c-966e-4b81-afb4-6f594aab02fb None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:25.372402 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3870d1-9932-403b-b70b-fa82e53d5d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:25.373172 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3870d1-9932-403b-b70b-fa82e53d5d74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:25.373530 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3870d1-9932-403b-b70b-fa82e53d5d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:25.373877 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3870d1-9932-403b-b70b-fa82e53d5d74 admin admin] PATH_INFO: `/v3/projects/c88e75b863414db6a4efa2ca59fd3987` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:25.375255 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3870d1-9932-403b-b70b-fa82e53d5d74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c88e75b863414db6a4efa2ca59fd3987)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:25.388073 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3870d1-9932-403b-b70b-fa82e53d5d74 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:25.418239 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1050/2083] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:31:25 2022] POST /identity/v3/projects => generated 385 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:31:25.419869 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dce6e19-185e-4ddb-a266-d51b7f5741d6 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:25.451320 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-7d3870d1-9932-403b-b70b-fa82e53d5d74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c88e75b863414db6a4efa2ca59fd3987', 'request_id': 'req-7d3870d1-9932-403b-b70b-fa82e53d5d74'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:25.461239 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-7d3870d1-9932-403b-b70b-fa82e53d5d74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c88e75b863414db6a4efa2ca59fd3987', 'request_id': 'req-7d3870d1-9932-403b-b70b-fa82e53d5d74'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:25.464699 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:25.476230 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-7d3870d1-9932-403b-b70b-fa82e53d5d74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c88e75b863414db6a4efa2ca59fd3987', 'request_id': 'req-7d3870d1-9932-403b-b70b-fa82e53d5d74'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:25.498566 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-7d3870d1-9932-403b-b70b-fa82e53d5d74 admin admin] The token cache is being invalidate because project c88e75b863414db6a4efa2ca59fd3987 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:31:25.499127 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-7d3870d1-9932-403b-b70b-fa82e53d5d74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:25.500162 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-7d3870d1-9932-403b-b70b-fa82e53d5d74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:25.502589 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1034/2084] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:31:25 2022] DELETE /identity/v3/projects/c88e75b863414db6a4efa2ca59fd3987 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:31:25.508454 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3870d1-9932-403b-b70b-fa82e53d5d74 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:25.510453 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-7d3870d1-9932-403b-b70b-fa82e53d5d74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:25.537113 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dce6e19-185e-4ddb-a266-d51b7f5741d6 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:25.601416 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3870d1-9932-403b-b70b-fa82e53d5d74 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:25.609744 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b373da7b-b4d2-46d0-b6b0-e8c1e7be9287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:25.610581 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373da7b-b4d2-46d0-b6b0-e8c1e7be9287 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:25.610581 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373da7b-b4d2-46d0-b6b0-e8c1e7be9287 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:25.610899 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373da7b-b4d2-46d0-b6b0-e8c1e7be9287 admin admin] PATH_INFO: `/v3/users/a0ed4ffc0f1a49408cdc64c1b93793c7` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:25.612070 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b373da7b-b4d2-46d0-b6b0-e8c1e7be9287 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0ed4ffc0f1a49408cdc64c1b93793c7)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:25.614634 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b373da7b-b4d2-46d0-b6b0-e8c1e7be9287 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:25.617455 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe1447f-110d-4fcb-9202-14f4ba07ee0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:25.618080 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe1447f-110d-4fcb-9202-14f4ba07ee0b admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:25.618358 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe1447f-110d-4fcb-9202-14f4ba07ee0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:25.618632 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe1447f-110d-4fcb-9202-14f4ba07ee0b admin admin] PATH_INFO: `/v3/users` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:25.619322 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe1447f-110d-4fcb-9202-14f4ba07ee0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:25.621581 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe1447f-110d-4fcb-9202-14f4ba07ee0b admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:25.659015 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1051/2085] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:31:25 2022] POST /identity/v3/users => generated 299 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:31:25.662316 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe1447f-110d-4fcb-9202-14f4ba07ee0b admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:25.664349 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-bfe1447f-110d-4fcb-9202-14f4ba07ee0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:25.680256 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe1447f-110d-4fcb-9202-14f4ba07ee0b admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:25.688559 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca38dfb-f596-4a9b-a67f-f8560a0e6022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:25.689570 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca38dfb-f596-4a9b-a67f-f8560a0e6022 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:25.689964 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca38dfb-f596-4a9b-a67f-f8560a0e6022 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:25.690359 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca38dfb-f596-4a9b-a67f-f8560a0e6022 admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:25.691117 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca38dfb-f596-4a9b-a67f-f8560a0e6022 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:25.693974 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca38dfb-f596-4a9b-a67f-f8560a0e6022 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:25.694762 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-b373da7b-b4d2-46d0-b6b0-e8c1e7be9287 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0ed4ffc0f1a49408cdc64c1b93793c7'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:25.711168 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1052/2086] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:31:25 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:31:25.721676 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca38dfb-f596-4a9b-a67f-f8560a0e6022 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:25.727899 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-b373da7b-b4d2-46d0-b6b0-e8c1e7be9287 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0ed4ffc0f1a49408cdc64c1b93793c7'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:25.729956 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-b373da7b-b4d2-46d0-b6b0-e8c1e7be9287 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0ed4ffc0f1a49408cdc64c1b93793c7'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:25.734972 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca38dfb-f596-4a9b-a67f-f8560a0e6022 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:25.750509 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-b373da7b-b4d2-46d0-b6b0-e8c1e7be9287 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0ed4ffc0f1a49408cdc64c1b93793c7'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:25.750686 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-b373da7b-b4d2-46d0-b6b0-e8c1e7be9287 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0ed4ffc0f1a49408cdc64c1b93793c7'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:25.752827 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc70d6ec-4762-4bcd-b6f7-a41b9d722727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:25.754580 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc70d6ec-4762-4bcd-b6f7-a41b9d722727 admin admin] REQUEST_METHOD: `PUT` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:25.754580 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc70d6ec-4762-4bcd-b6f7-a41b9d722727 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:25.754580 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc70d6ec-4762-4bcd-b6f7-a41b9d722727 admin admin] PATH_INFO: `/v3/projects/4fcefc6056a742f991aede377568c605/users/7b4664a2586741099790f8ca93e8e6ad/roles/a332ef951db949b0bad7019fbd28a1b9` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:25.775642 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc70d6ec-4762-4bcd-b6f7-a41b9d722727 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fcefc6056a742f991aede377568c605, user_id=7b4664a2586741099790f8ca93e8e6ad, role_id=a332ef951db949b0bad7019fbd28a1b9)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:25.778960 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc70d6ec-4762-4bcd-b6f7-a41b9d722727 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:25.781877 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1035/2087] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:31:25 2022] DELETE /identity/v3/users/a0ed4ffc0f1a49408cdc64c1b93793c7 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:31:25.797149 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:25.806921 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1053/2088] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:31:25 2022] PUT /identity/v3/projects/4fcefc6056a742f991aede377568c605/users/7b4664a2586741099790f8ca93e8e6ad/roles/a332ef951db949b0bad7019fbd28a1b9 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:31:25.811119 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b373da7b-b4d2-46d0-b6b0-e8c1e7be9287 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:25.812597 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-b373da7b-b4d2-46d0-b6b0-e8c1e7be9287 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:25.846480 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc70d6ec-4762-4bcd-b6f7-a41b9d722727 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:25.846480 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-fc70d6ec-4762-4bcd-b6f7-a41b9d722727 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:25.913324 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b373da7b-b4d2-46d0-b6b0-e8c1e7be9287 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:25.936417 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:25.985370 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc70d6ec-4762-4bcd-b6f7-a41b9d722727 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:25.993054 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cc663a-9ca2-4c2f-9466-18aa39a81fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:25.994279 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc663a-9ca2-4c2f-9466-18aa39a81fee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:25.994723 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc663a-9ca2-4c2f-9466-18aa39a81fee admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:25.995968 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc663a-9ca2-4c2f-9466-18aa39a81fee admin admin] PATH_INFO: `/v3/users/46980487b9a44c0d9849625301d2b997` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:25.999299 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cc663a-9ca2-4c2f-9466-18aa39a81fee admin admin] RBAC: Authorizing `identity:delete_user(user_id=46980487b9a44c0d9849625301d2b997)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:26.001702 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cc663a-9ca2-4c2f-9466-18aa39a81fee admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:26.054876 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8ef630-bb44-440c-a9e5-b0dccbdfc2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:26.055916 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ef630-bb44-440c-a9e5-b0dccbdfc2c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:26.056374 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ef630-bb44-440c-a9e5-b0dccbdfc2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:26.056939 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ef630-bb44-440c-a9e5-b0dccbdfc2c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:26.057957 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8ef630-bb44-440c-a9e5-b0dccbdfc2c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:26.060373 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8ef630-bb44-440c-a9e5-b0dccbdfc2c1 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:26.093860 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-d0cc663a-9ca2-4c2f-9466-18aa39a81fee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46980487b9a44c0d9849625301d2b997'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:26.095105 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1036/2089] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:31:25 2022] GET /identity/v3/roles => generated 1420 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:31:26.097603 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8ef630-bb44-440c-a9e5-b0dccbdfc2c1 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:26.115812 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8ef630-bb44-440c-a9e5-b0dccbdfc2c1 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:26.125367 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a17ef6c-5f1d-4e85-808a-3894103f18db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:26.127365 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17ef6c-5f1d-4e85-808a-3894103f18db admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:26.127546 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17ef6c-5f1d-4e85-808a-3894103f18db admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:26.127803 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17ef6c-5f1d-4e85-808a-3894103f18db admin admin] PATH_INFO: `/v3/projects/4fcefc6056a742f991aede377568c605/users/7b4664a2586741099790f8ca93e8e6ad/roles/a332ef951db949b0bad7019fbd28a1b9` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:26.128650 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-d0cc663a-9ca2-4c2f-9466-18aa39a81fee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46980487b9a44c0d9849625301d2b997'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:26.130809 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a17ef6c-5f1d-4e85-808a-3894103f18db admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fcefc6056a742f991aede377568c605, user_id=7b4664a2586741099790f8ca93e8e6ad, role_id=a332ef951db949b0bad7019fbd28a1b9)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:26.134995 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a17ef6c-5f1d-4e85-808a-3894103f18db admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:26.145246 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-d0cc663a-9ca2-4c2f-9466-18aa39a81fee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46980487b9a44c0d9849625301d2b997'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:26.147476 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-d0cc663a-9ca2-4c2f-9466-18aa39a81fee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46980487b9a44c0d9849625301d2b997'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:26.155276 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1037/2090] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:31:26 2022] PUT /identity/v3/projects/4fcefc6056a742f991aede377568c605/users/7b4664a2586741099790f8ca93e8e6ad/roles/a332ef951db949b0bad7019fbd28a1b9 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:31:26.170292 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-d0cc663a-9ca2-4c2f-9466-18aa39a81fee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46980487b9a44c0d9849625301d2b997'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:26.171466 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dfce90-69e3-4057-90cb-17b7341d58a0 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:26.171973 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dfce90-69e3-4057-90cb-17b7341d58a0 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:26.172361 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dfce90-69e3-4057-90cb-17b7341d58a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:26.188318 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1054/2091] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:31:25 2022] DELETE /identity/v3/users/46980487b9a44c0d9849625301d2b997 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:31:26.191310 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42877036-f155-476c-bb4f-763f9b978224 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:26.192485 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42877036-f155-476c-bb4f-763f9b978224 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:26.192987 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42877036-f155-476c-bb4f-763f9b978224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:26.239469 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-42877036-f155-476c-bb4f-763f9b978224 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:31:26.239469 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-42877036-f155-476c-bb4f-763f9b978224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:26.239948 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-e9dfce90-69e3-4057-90cb-17b7341d58a0 None None] MFA Rules not processed for user `7b4664a2586741099790f8ca93e8e6ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:31:26.239948 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-e9dfce90-69e3-4057-90cb-17b7341d58a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:26.386785 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1055/2092] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:31:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:31:26.388207 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42877036-f155-476c-bb4f-763f9b978224 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:26.392315 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-42877036-f155-476c-bb4f-763f9b978224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:26.408732 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1038/2093] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:31:26 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:31:26.410586 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dfce90-69e3-4057-90cb-17b7341d58a0 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:26.411620 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42877036-f155-476c-bb4f-763f9b978224 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:26.416007 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-e9dfce90-69e3-4057-90cb-17b7341d58a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:26.420903 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a3a2b4-c45d-4514-a5c5-f3154d44098c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:26.421519 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a3a2b4-c45d-4514-a5c5-f3154d44098c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:26.421805 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a3a2b4-c45d-4514-a5c5-f3154d44098c admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:26.422081 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a3a2b4-c45d-4514-a5c5-f3154d44098c admin admin] PATH_INFO: `/v3/projects/f9392b67edc144f391b5368ede24f921` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:26.423389 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a3a2b4-c45d-4514-a5c5-f3154d44098c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9392b67edc144f391b5368ede24f921)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:26.425772 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a3a2b4-c45d-4514-a5c5-f3154d44098c admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:26.454120 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:26.507601 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-91a3a2b4-c45d-4514-a5c5-f3154d44098c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9392b67edc144f391b5368ede24f921', 'request_id': 'req-91a3a2b4-c45d-4514-a5c5-f3154d44098c'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:26.522310 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-91a3a2b4-c45d-4514-a5c5-f3154d44098c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9392b67edc144f391b5368ede24f921', 'request_id': 'req-91a3a2b4-c45d-4514-a5c5-f3154d44098c'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:26.527879 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dfce90-69e3-4057-90cb-17b7341d58a0 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:26.530245 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-91a3a2b4-c45d-4514-a5c5-f3154d44098c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9392b67edc144f391b5368ede24f921', 'request_id': 'req-91a3a2b4-c45d-4514-a5c5-f3154d44098c'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:26.543549 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-91a3a2b4-c45d-4514-a5c5-f3154d44098c admin admin] The token cache is being invalidate because project f9392b67edc144f391b5368ede24f921 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:31:26.543850 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-91a3a2b4-c45d-4514-a5c5-f3154d44098c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:26.544619 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-91a3a2b4-c45d-4514-a5c5-f3154d44098c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:26.546526 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1056/2094] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:31:26 2022] DELETE /identity/v3/projects/f9392b67edc144f391b5368ede24f921 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:31:26.547706 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a3a2b4-c45d-4514-a5c5-f3154d44098c admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:26.548617 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-91a3a2b4-c45d-4514-a5c5-f3154d44098c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:26.593540 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:26.625981 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb6625c-ab23-4e30-b638-b019cc174fc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:26.627201 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb6625c-ab23-4e30-b638-b019cc174fc8 service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:26.627630 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb6625c-ab23-4e30-b638-b019cc174fc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:26.628120 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb6625c-ab23-4e30-b638-b019cc174fc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:26.631547 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-bdb6625c-ab23-4e30-b638-b019cc174fc8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:26.647493 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a3a2b4-c45d-4514-a5c5-f3154d44098c admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:26.655460 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1857729c-1a89-4b59-ac25-949b241e346f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e79503178ac54e62ba385467d5617ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:26.657296 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857729c-1a89-4b59-ac25-949b241e346f service cinder] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:26.657805 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857729c-1a89-4b59-ac25-949b241e346f service cinder] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:26.658292 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857729c-1a89-4b59-ac25-949b241e346f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:26.663495 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-1857729c-1a89-4b59-ac25-949b241e346f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:26.742397 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb6625c-ab23-4e30-b638-b019cc174fc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:26.744190 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb6625c-ab23-4e30-b638-b019cc174fc8 service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:26.756619 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1039/2095] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:31:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:31:26.757417 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1857729c-1a89-4b59-ac25-949b241e346f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:26.758163 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1556c6-89c3-4ffa-8e1a-d98199d4b363 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:26.758557 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1556c6-89c3-4ffa-8e1a-d98199d4b363 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:26.758980 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1556c6-89c3-4ffa-8e1a-d98199d4b363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:26.760509 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1857729c-1a89-4b59-ac25-949b241e346f service cinder] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:26.778553 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1057/2096] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:31:26 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:31:26.791095 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-9f1556c6-89c3-4ffa-8e1a-d98199d4b363 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:31:26.793532 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-9f1556c6-89c3-4ffa-8e1a-d98199d4b363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:26.806559 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1040/2097] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:31:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:31:26.816261 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e81bda-d0bc-4710-b7c1-780b30769160 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:26.816518 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e81bda-d0bc-4710-b7c1-780b30769160 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:26.816802 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e81bda-d0bc-4710-b7c1-780b30769160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:26.841375 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-c4e81bda-d0bc-4710-b7c1-780b30769160 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:31:26.842736 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-c4e81bda-d0bc-4710-b7c1-780b30769160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:26.858357 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1556c6-89c3-4ffa-8e1a-d98199d4b363 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:26.867151 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1058/2098] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:31:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:31:26.869370 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1556c6-89c3-4ffa-8e1a-d98199d4b363 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:26.876334 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5659a872-dbce-4be3-8a48-6db84053b38b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:26.877008 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5659a872-dbce-4be3-8a48-6db84053b38b admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:26.877263 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5659a872-dbce-4be3-8a48-6db84053b38b admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:26.877698 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5659a872-dbce-4be3-8a48-6db84053b38b admin admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:26.878403 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5659a872-dbce-4be3-8a48-6db84053b38b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:31:26.878709 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5659a872-dbce-4be3-8a48-6db84053b38b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:26.880419 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5659a872-dbce-4be3-8a48-6db84053b38b admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:26.896293 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1041/2099] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 12:31:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:31:26.900603 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e81bda-d0bc-4710-b7c1-780b30769160 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:26.913110 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e81bda-d0bc-4710-b7c1-780b30769160 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:26.920734 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a94b516-817e-47e4-a98c-da8b5c08c401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:26.921531 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a94b516-817e-47e4-a98c-da8b5c08c401 admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:26.921836 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a94b516-817e-47e4-a98c-da8b5c08c401 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:26.922184 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a94b516-817e-47e4-a98c-da8b5c08c401 admin admin] PATH_INFO: `/v3/projects` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:26.923610 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a94b516-817e-47e4-a98c-da8b5c08c401 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:26.926088 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a94b516-817e-47e4-a98c-da8b5c08c401 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:26.971199 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1059/2100] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:31:26 2022] POST /identity/v3/projects => generated 383 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:31:26.972713 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5659a872-dbce-4be3-8a48-6db84053b38b admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:26.986676 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5659a872-dbce-4be3-8a48-6db84053b38b admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:27.075854 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b637e2f-4567-472e-9a85-35cb294f212a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:27.076479 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b637e2f-4567-472e-9a85-35cb294f212a admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:27.076769 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b637e2f-4567-472e-9a85-35cb294f212a admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:27.077041 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b637e2f-4567-472e-9a85-35cb294f212a admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:27.077716 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b637e2f-4567-472e-9a85-35cb294f212a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:27.079795 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b637e2f-4567-472e-9a85-35cb294f212a admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:27.110962 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1042/2101] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:31:26 2022] POST /identity/v3/users => generated 292 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:31:27.112906 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a94b516-817e-47e4-a98c-da8b5c08c401 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:27.129212 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a94b516-817e-47e4-a98c-da8b5c08c401 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:27.136211 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc472656-415d-4a0d-98a0-e5fd7d6688d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:27.136963 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc472656-415d-4a0d-98a0-e5fd7d6688d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:27.137317 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc472656-415d-4a0d-98a0-e5fd7d6688d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:27.137690 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc472656-415d-4a0d-98a0-e5fd7d6688d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:27.138339 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc472656-415d-4a0d-98a0-e5fd7d6688d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:27.140025 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc472656-415d-4a0d-98a0-e5fd7d6688d4 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:27.155988 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1060/2102] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:31:27 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 12:31:27.160416 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b637e2f-4567-472e-9a85-35cb294f212a admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:27.170596 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc472656-415d-4a0d-98a0-e5fd7d6688d4 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:27.172477 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-cc472656-415d-4a0d-98a0-e5fd7d6688d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:27.190787 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc472656-415d-4a0d-98a0-e5fd7d6688d4 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:27.197225 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b55b32-4ff1-4c8f-9d94-3c1adbf14082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:27.198123 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b55b32-4ff1-4c8f-9d94-3c1adbf14082 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:27.198683 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b55b32-4ff1-4c8f-9d94-3c1adbf14082 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:27.199052 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b55b32-4ff1-4c8f-9d94-3c1adbf14082 admin admin] PATH_INFO: `/v3/projects/de2fca6d439946e28588e2f3fedfe74f` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:27.200981 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b55b32-4ff1-4c8f-9d94-3c1adbf14082 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de2fca6d439946e28588e2f3fedfe74f)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:27.203400 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b55b32-4ff1-4c8f-9d94-3c1adbf14082 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:27.209007 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b637e2f-4567-472e-9a85-35cb294f212a admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:27.236126 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:27.238804 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fc4a0b-60a1-436a-9c78-1a3298f16602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:27.240058 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc4a0b-60a1-436a-9c78-1a3298f16602 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:27.240557 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc4a0b-60a1-436a-9c78-1a3298f16602 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:27.241030 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc4a0b-60a1-436a-9c78-1a3298f16602 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:27.243233 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fc4a0b-60a1-436a-9c78-1a3298f16602 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:27.248119 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fc4a0b-60a1-436a-9c78-1a3298f16602 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:27.269946 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1043/2103] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:31:27 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:31:27.275408 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fc4a0b-60a1-436a-9c78-1a3298f16602 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:27.287919 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-b4b55b32-4ff1-4c8f-9d94-3c1adbf14082 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de2fca6d439946e28588e2f3fedfe74f', 'request_id': 'req-b4b55b32-4ff1-4c8f-9d94-3c1adbf14082'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:27.295437 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fc4a0b-60a1-436a-9c78-1a3298f16602 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:27.300269 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-b4b55b32-4ff1-4c8f-9d94-3c1adbf14082 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de2fca6d439946e28588e2f3fedfe74f', 'request_id': 'req-b4b55b32-4ff1-4c8f-9d94-3c1adbf14082'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:27.310043 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-b4b55b32-4ff1-4c8f-9d94-3c1adbf14082 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de2fca6d439946e28588e2f3fedfe74f', 'request_id': 'req-b4b55b32-4ff1-4c8f-9d94-3c1adbf14082'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:27.323944 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-b4b55b32-4ff1-4c8f-9d94-3c1adbf14082 admin admin] The token cache is being invalidate because project de2fca6d439946e28588e2f3fedfe74f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:31:27.324878 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-b4b55b32-4ff1-4c8f-9d94-3c1adbf14082 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:27.325978 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-b4b55b32-4ff1-4c8f-9d94-3c1adbf14082 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:27.328570 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1061/2104] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:31:27 2022] DELETE /identity/v3/projects/de2fca6d439946e28588e2f3fedfe74f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:31:27.333753 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb104b-edea-41b9-85fa-06566eb1caf0 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:27.334221 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb104b-edea-41b9-85fa-06566eb1caf0 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:27.334803 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb104b-edea-41b9-85fa-06566eb1caf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:27.362230 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-3beb104b-edea-41b9-85fa-06566eb1caf0 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:31:27.363626 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-3beb104b-edea-41b9-85fa-06566eb1caf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:27.366089 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:27.390036 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a454abb-8997-41e3-94ed-f34e26c41535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:27.390680 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a454abb-8997-41e3-94ed-f34e26c41535 admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:27.391022 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a454abb-8997-41e3-94ed-f34e26c41535 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:27.391339 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a454abb-8997-41e3-94ed-f34e26c41535 admin admin] PATH_INFO: `/v3/projects/7b76e4e23dcb42c58bc66b22054f42e0/users/148f6f4727474fae9b6436fc1e1a328f/roles/b5cfd7a855a448359e9017f51d32b6fc` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:27.412123 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a454abb-8997-41e3-94ed-f34e26c41535 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b76e4e23dcb42c58bc66b22054f42e0, user_id=148f6f4727474fae9b6436fc1e1a328f, role_id=b5cfd7a855a448359e9017f51d32b6fc)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:27.415054 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a454abb-8997-41e3-94ed-f34e26c41535 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:27.447226 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1044/2105] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:31:27 2022] PUT /identity/v3/projects/7b76e4e23dcb42c58bc66b22054f42e0/users/148f6f4727474fae9b6436fc1e1a328f/roles/b5cfd7a855a448359e9017f51d32b6fc => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:31:27.461762 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2798d-090d-4c8f-b251-0091b790283c None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:27.462050 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2798d-090d-4c8f-b251-0091b790283c None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:27.462308 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2798d-090d-4c8f-b251-0091b790283c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:27.477105 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1062/2106] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:31:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:31:27.487709 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ed3c7-7d92-403e-a195-ea0a79680749 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:27.488009 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ed3c7-7d92-403e-a195-ea0a79680749 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:27.488290 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ed3c7-7d92-403e-a195-ea0a79680749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:27.499274 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-b7a2798d-090d-4c8f-b251-0091b790283c None None] MFA Rules not processed for user `148f6f4727474fae9b6436fc1e1a328f`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:31:27.500763 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-b7a2798d-090d-4c8f-b251-0091b790283c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:27.512568 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-987ed3c7-7d92-403e-a195-ea0a79680749 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:31:27.513929 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-987ed3c7-7d92-403e-a195-ea0a79680749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:27.614967 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1045/2107] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:31:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:31:27.633472 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a2798d-090d-4c8f-b251-0091b790283c None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:27.635862 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-b7a2798d-090d-4c8f-b251-0091b790283c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:27.642553 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1063/2108] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:31:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:31:27.643999 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987ed3c7-7d92-403e-a195-ea0a79680749 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:27.656332 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987ed3c7-7d92-403e-a195-ea0a79680749 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:27.662806 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bd24b2-f249-49a9-868c-d468f0a00368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:27.663496 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd24b2-f249-49a9-868c-d468f0a00368 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:27.663777 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd24b2-f249-49a9-868c-d468f0a00368 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:27.664048 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd24b2-f249-49a9-868c-d468f0a00368 admin admin] PATH_INFO: `/v3/domains` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:27.664803 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bd24b2-f249-49a9-868c-d468f0a00368 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:31:27.665181 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bd24b2-f249-49a9-868c-d468f0a00368 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:27.667603 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bd24b2-f249-49a9-868c-d468f0a00368 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:27.681905 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1064/2109] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 12:31:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:31:27.687593 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bd24b2-f249-49a9-868c-d468f0a00368 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:27.699691 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bd24b2-f249-49a9-868c-d468f0a00368 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:27.705271 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54da9d1f-ba8f-49b2-9b9f-96f7f4a52e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:27.706188 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da9d1f-ba8f-49b2-9b9f-96f7f4a52e4e admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:27.706598 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da9d1f-ba8f-49b2-9b9f-96f7f4a52e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:27.707122 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da9d1f-ba8f-49b2-9b9f-96f7f4a52e4e admin admin] PATH_INFO: `/v3/projects` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:27.707994 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54da9d1f-ba8f-49b2-9b9f-96f7f4a52e4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:27.710424 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54da9d1f-ba8f-49b2-9b9f-96f7f4a52e4e admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:27.717860 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a2798d-090d-4c8f-b251-0091b790283c None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:27.721895 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f90039-2fe8-4423-b51e-8dc1ac65297f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e79503178ac54e62ba385467d5617ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:27.722519 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f90039-2fe8-4423-b51e-8dc1ac65297f service cinder] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:27.722796 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f90039-2fe8-4423-b51e-8dc1ac65297f service cinder] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:27.723095 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f90039-2fe8-4423-b51e-8dc1ac65297f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:27.733183 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f90039-2fe8-4423-b51e-8dc1ac65297f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:27.734741 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f90039-2fe8-4423-b51e-8dc1ac65297f service cinder] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:27.751181 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1065/2110] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:31:27 2022] POST /identity/v3/projects => generated 363 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:31:27.751528 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1046/2111] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:31:27 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:31:27.758763 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54da9d1f-ba8f-49b2-9b9f-96f7f4a52e4e admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:27.785920 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:27.796022 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f90039-2fe8-4423-b51e-8dc1ac65297f service cinder] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:27.798225 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-c9f90039-2fe8-4423-b51e-8dc1ac65297f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:27.820769 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f90039-2fe8-4423-b51e-8dc1ac65297f service cinder] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:27.906078 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54da9d1f-ba8f-49b2-9b9f-96f7f4a52e4e admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:27.915042 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c808b87b-af21-41dd-af34-39da5ea71647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:27.916654 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c808b87b-af21-41dd-af34-39da5ea71647 admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:27.917221 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c808b87b-af21-41dd-af34-39da5ea71647 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:27.918148 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c808b87b-af21-41dd-af34-39da5ea71647 admin admin] PATH_INFO: `/v3/users` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:27.919555 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c808b87b-af21-41dd-af34-39da5ea71647 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:27.923699 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c808b87b-af21-41dd-af34-39da5ea71647 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:27.929491 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25852038-3b23-4200-a254-c08f2e432236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:27.943717 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25852038-3b23-4200-a254-c08f2e432236 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:27.944367 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25852038-3b23-4200-a254-c08f2e432236 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:27.944851 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25852038-3b23-4200-a254-c08f2e432236 admin admin] PATH_INFO: `/v3/users/148f6f4727474fae9b6436fc1e1a328f` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:27.947844 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25852038-3b23-4200-a254-c08f2e432236 admin admin] RBAC: Authorizing `identity:delete_user(user_id=148f6f4727474fae9b6436fc1e1a328f)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:27.955624 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25852038-3b23-4200-a254-c08f2e432236 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:27.962121 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:27.971257 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1066/2112] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:31:27 2022] POST /identity/v3/users => generated 282 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:31:27.974708 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c808b87b-af21-41dd-af34-39da5ea71647 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:27.991502 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c808b87b-af21-41dd-af34-39da5ea71647 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:27.999757 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b916da5c-62ab-4502-9d6d-03481fa169da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:28.000950 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b916da5c-62ab-4502-9d6d-03481fa169da admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:28.001275 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b916da5c-62ab-4502-9d6d-03481fa169da admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:28.001596 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b916da5c-62ab-4502-9d6d-03481fa169da admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:28.002410 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b916da5c-62ab-4502-9d6d-03481fa169da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:28.004657 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b916da5c-62ab-4502-9d6d-03481fa169da admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:28.017859 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1067/2113] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:31:27 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:31:28.022732 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b916da5c-62ab-4502-9d6d-03481fa169da admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:28.035489 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-25852038-3b23-4200-a254-c08f2e432236 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '148f6f4727474fae9b6436fc1e1a328f'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:28.039424 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b916da5c-62ab-4502-9d6d-03481fa169da admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:28.047311 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353a93c8-9835-42d9-8963-bf0fd56e83a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:28.048094 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a93c8-9835-42d9-8963-bf0fd56e83a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:28.048448 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a93c8-9835-42d9-8963-bf0fd56e83a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:28.048720 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a93c8-9835-42d9-8963-bf0fd56e83a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:28.049378 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353a93c8-9835-42d9-8963-bf0fd56e83a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:28.051315 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353a93c8-9835-42d9-8963-bf0fd56e83a6 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:28.053415 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-25852038-3b23-4200-a254-c08f2e432236 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '148f6f4727474fae9b6436fc1e1a328f'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:28.054219 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-25852038-3b23-4200-a254-c08f2e432236 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '148f6f4727474fae9b6436fc1e1a328f'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:28.068523 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1068/2114] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:31:28 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:31:28.068798 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-25852038-3b23-4200-a254-c08f2e432236 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '148f6f4727474fae9b6436fc1e1a328f'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:28.068798 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-25852038-3b23-4200-a254-c08f2e432236 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '148f6f4727474fae9b6436fc1e1a328f'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:28.069869 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353a93c8-9835-42d9-8963-bf0fd56e83a6 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:28.071803 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-353a93c8-9835-42d9-8963-bf0fd56e83a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:28.086375 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1047/2115] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:31:27 2022] DELETE /identity/v3/users/148f6f4727474fae9b6436fc1e1a328f => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:31:28.088172 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353a93c8-9835-42d9-8963-bf0fd56e83a6 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:28.092558 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177bfae4-a7e5-48c3-b9a2-f696ce82511a None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:28.092867 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177bfae4-a7e5-48c3-b9a2-f696ce82511a None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:28.093107 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177bfae4-a7e5-48c3-b9a2-f696ce82511a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:28.114137 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-177bfae4-a7e5-48c3-b9a2-f696ce82511a None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:31:28.115525 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-177bfae4-a7e5-48c3-b9a2-f696ce82511a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:28.171728 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777afac0-c316-4ef9-8201-53be74fe272f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:28.172831 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777afac0-c316-4ef9-8201-53be74fe272f admin admin] REQUEST_METHOD: `PUT` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:28.173134 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777afac0-c316-4ef9-8201-53be74fe272f admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:28.173452 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777afac0-c316-4ef9-8201-53be74fe272f admin admin] PATH_INFO: `/v3/projects/372bf2533871419a8a61c4c1b036e738/users/a33022540e3b461488249248e0527c0d/roles/b5cfd7a855a448359e9017f51d32b6fc` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:28.197156 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1048/2116] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:31:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:31:28.199449 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777afac0-c316-4ef9-8201-53be74fe272f admin admin] RBAC: Authorizing `identity:create_grant(project_id=372bf2533871419a8a61c4c1b036e738, user_id=a33022540e3b461488249248e0527c0d, role_id=b5cfd7a855a448359e9017f51d32b6fc)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:28.206718 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777afac0-c316-4ef9-8201-53be74fe272f admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:28.211441 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177bfae4-a7e5-48c3-b9a2-f696ce82511a None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:28.212947 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-177bfae4-a7e5-48c3-b9a2-f696ce82511a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:28.224610 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1069/2117] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:31:28 2022] PUT /identity/v3/projects/372bf2533871419a8a61c4c1b036e738/users/a33022540e3b461488249248e0527c0d/roles/b5cfd7a855a448359e9017f51d32b6fc => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:31:28.235587 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5143b97-233c-4c8c-86e4-d85b03e1aa85 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:28.235990 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5143b97-233c-4c8c-86e4-d85b03e1aa85 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:28.236330 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5143b97-233c-4c8c-86e4-d85b03e1aa85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:28.280879 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-a5143b97-233c-4c8c-86e4-d85b03e1aa85 None None] MFA Rules not processed for user `a33022540e3b461488249248e0527c0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:31:28.282497 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-a5143b97-233c-4c8c-86e4-d85b03e1aa85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:28.323121 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177bfae4-a7e5-48c3-b9a2-f696ce82511a None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:28.348311 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:28.379558 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1070/2118] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:31:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:31:28.387494 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5143b97-233c-4c8c-86e4-d85b03e1aa85 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:28.390287 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:28.425026 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb9f851-8ba4-4cf5-ad66-0db7926e7737 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:28.425702 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9f851-8ba4-4cf5-ad66-0db7926e7737 service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:28.426261 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9f851-8ba4-4cf5-ad66-0db7926e7737 service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:28.426513 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9f851-8ba4-4cf5-ad66-0db7926e7737 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:28.482805 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5143b97-233c-4c8c-86e4-d85b03e1aa85 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:28.489504 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb10e61b-4270-4935-a9c0-9c28a6c8b115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:28.490303 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb10e61b-4270-4935-a9c0-9c28a6c8b115 admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:28.490693 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb10e61b-4270-4935-a9c0-9c28a6c8b115 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:28.491128 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb10e61b-4270-4935-a9c0-9c28a6c8b115 admin admin] PATH_INFO: `/v3/projects` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:28.492089 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb10e61b-4270-4935-a9c0-9c28a6c8b115 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:28.494208 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb10e61b-4270-4935-a9c0-9c28a6c8b115 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:28.513881 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb9f851-8ba4-4cf5-ad66-0db7926e7737 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:28.515930 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb9f851-8ba4-4cf5-ad66-0db7926e7737 service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:28.529109 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1049/2119] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:31:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:31:28.542908 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1071/2120] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:31:28 2022] POST /identity/v3/projects => generated 363 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:31:28.547169 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb9f851-8ba4-4cf5-ad66-0db7926e7737 service neutron] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:28.558356 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb9f851-8ba4-4cf5-ad66-0db7926e7737 service neutron] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:28.623042 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb10e61b-4270-4935-a9c0-9c28a6c8b115 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:28.627355 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-fb10e61b-4270-4935-a9c0-9c28a6c8b115 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:28.649756 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5c512d-3444-4c77-93ba-e33e3a0132ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:28.650659 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c512d-3444-4c77-93ba-e33e3a0132ce admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:28.651056 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c512d-3444-4c77-93ba-e33e3a0132ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:28.651352 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c512d-3444-4c77-93ba-e33e3a0132ce admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:28.654231 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5c512d-3444-4c77-93ba-e33e3a0132ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:28.657008 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5c512d-3444-4c77-93ba-e33e3a0132ce admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:28.693076 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1050/2121] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:31:28 2022] POST /identity/v3/users => generated 288 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:31:28.700010 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5c512d-3444-4c77-93ba-e33e3a0132ce admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:28.715125 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5c512d-3444-4c77-93ba-e33e3a0132ce admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:28.716178 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb10e61b-4270-4935-a9c0-9c28a6c8b115 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:28.720570 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655adedc-3eee-419f-aab4-4b3e36326b4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e79503178ac54e62ba385467d5617ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:28.721257 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8374f80-a2aa-4184-9458-ff7319aac90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:28.721467 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655adedc-3eee-419f-aab4-4b3e36326b4d service cinder] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:28.721692 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655adedc-3eee-419f-aab4-4b3e36326b4d service cinder] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:28.722033 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655adedc-3eee-419f-aab4-4b3e36326b4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:28.722195 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8374f80-a2aa-4184-9458-ff7319aac90c admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:28.722794 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8374f80-a2aa-4184-9458-ff7319aac90c admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:28.723150 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8374f80-a2aa-4184-9458-ff7319aac90c admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:28.724386 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-655adedc-3eee-419f-aab4-4b3e36326b4d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:28.724952 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8374f80-a2aa-4184-9458-ff7319aac90c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:28.726912 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8374f80-a2aa-4184-9458-ff7319aac90c admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:28.740272 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1051/2122] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:31:28 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 12:31:28.746899 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8374f80-a2aa-4184-9458-ff7319aac90c admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:28.763621 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8374f80-a2aa-4184-9458-ff7319aac90c admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:28.773506 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4a1b85-dc52-4a2b-8f68-a6dffcfcd5fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:28.775465 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a1b85-dc52-4a2b-8f68-a6dffcfcd5fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:28.776322 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a1b85-dc52-4a2b-8f68-a6dffcfcd5fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:28.777593 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a1b85-dc52-4a2b-8f68-a6dffcfcd5fa admin admin] PATH_INFO: `/v3/projects/02b1dad9fb244acf940881f0cb34cca5/users/3ff5131d6b99403aaf751a43baf3693d/roles/a332ef951db949b0bad7019fbd28a1b9` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:28.808103 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655adedc-3eee-419f-aab4-4b3e36326b4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:28.810494 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655adedc-3eee-419f-aab4-4b3e36326b4d service cinder] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:28.822470 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1072/2123] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:31:28 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:31:28.823245 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4a1b85-dc52-4a2b-8f68-a6dffcfcd5fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=02b1dad9fb244acf940881f0cb34cca5, user_id=3ff5131d6b99403aaf751a43baf3693d, role_id=a332ef951db949b0bad7019fbd28a1b9)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:28.826575 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4a1b85-dc52-4a2b-8f68-a6dffcfcd5fa admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:28.864221 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1052/2124] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:31:28 2022] PUT /identity/v3/projects/02b1dad9fb244acf940881f0cb34cca5/users/3ff5131d6b99403aaf751a43baf3693d/roles/a332ef951db949b0bad7019fbd28a1b9 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:31:28.869966 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655adedc-3eee-419f-aab4-4b3e36326b4d service cinder] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:28.883767 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655adedc-3eee-419f-aab4-4b3e36326b4d service cinder] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:28.918385 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:28.976934 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a7afac-d9b7-4748-abf0-09e3070b20a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:28.977580 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a7afac-d9b7-4748-abf0-09e3070b20a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:28.977858 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a7afac-d9b7-4748-abf0-09e3070b20a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:28.978150 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a7afac-d9b7-4748-abf0-09e3070b20a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:28.979279 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a7afac-d9b7-4748-abf0-09e3070b20a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:28.982276 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a7afac-d9b7-4748-abf0-09e3070b20a4 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:28.998903 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1073/2125] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:31:28 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 12:31:29.004455 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4a1b85-dc52-4a2b-8f68-a6dffcfcd5fa admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:29.023961 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4a1b85-dc52-4a2b-8f68-a6dffcfcd5fa admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:29.039621 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fde312f-71f6-486f-9878-969a5940b13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:29.041077 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde312f-71f6-486f-9878-969a5940b13f admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:29.041376 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde312f-71f6-486f-9878-969a5940b13f admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:29.041785 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde312f-71f6-486f-9878-969a5940b13f admin admin] PATH_INFO: `/v3/projects/02b1dad9fb244acf940881f0cb34cca5/users/3ff5131d6b99403aaf751a43baf3693d/roles/a332ef951db949b0bad7019fbd28a1b9` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:29.046903 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fde312f-71f6-486f-9878-969a5940b13f admin admin] RBAC: Authorizing `identity:create_grant(project_id=02b1dad9fb244acf940881f0cb34cca5, user_id=3ff5131d6b99403aaf751a43baf3693d, role_id=a332ef951db949b0bad7019fbd28a1b9)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:29.050966 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fde312f-71f6-486f-9878-969a5940b13f admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:29.084903 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1053/2126] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:31:29 2022] PUT /identity/v3/projects/02b1dad9fb244acf940881f0cb34cca5/users/3ff5131d6b99403aaf751a43baf3693d/roles/a332ef951db949b0bad7019fbd28a1b9 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:31:29.087455 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d93bbc-88e3-48e6-88ca-82f5ce9f5dfc None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:29.087764 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d93bbc-88e3-48e6-88ca-82f5ce9f5dfc None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:29.088136 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d93bbc-88e3-48e6-88ca-82f5ce9f5dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:29.140714 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-b6d93bbc-88e3-48e6-88ca-82f5ce9f5dfc None None] MFA Rules not processed for user `3ff5131d6b99403aaf751a43baf3693d`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:31:29.144444 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-b6d93bbc-88e3-48e6-88ca-82f5ce9f5dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:29.161946 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fde312f-71f6-486f-9878-969a5940b13f admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:29.164366 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-9fde312f-71f6-486f-9878-969a5940b13f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:29.249825 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:29.340712 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fde312f-71f6-486f-9878-969a5940b13f admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:29.367781 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1074/2127] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:31:29 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:31:29.368079 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f385cc8d-95ae-4166-ad32-fe84c9bd4f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:29.368079 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f385cc8d-95ae-4166-ad32-fe84c9bd4f0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:29.368079 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f385cc8d-95ae-4166-ad32-fe84c9bd4f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:29.368079 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f385cc8d-95ae-4166-ad32-fe84c9bd4f0f admin admin] PATH_INFO: `/v3/projects/7b76e4e23dcb42c58bc66b22054f42e0` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:29.368640 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f385cc8d-95ae-4166-ad32-fe84c9bd4f0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b76e4e23dcb42c58bc66b22054f42e0)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:29.371098 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f385cc8d-95ae-4166-ad32-fe84c9bd4f0f admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:29.408140 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d93bbc-88e3-48e6-88ca-82f5ce9f5dfc None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:29.410212 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-b6d93bbc-88e3-48e6-88ca-82f5ce9f5dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:29.469289 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-f385cc8d-95ae-4166-ad32-fe84c9bd4f0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b76e4e23dcb42c58bc66b22054f42e0', 'request_id': 'req-f385cc8d-95ae-4166-ad32-fe84c9bd4f0f'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:29.490712 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-f385cc8d-95ae-4166-ad32-fe84c9bd4f0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b76e4e23dcb42c58bc66b22054f42e0', 'request_id': 'req-f385cc8d-95ae-4166-ad32-fe84c9bd4f0f'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:29.502377 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-f385cc8d-95ae-4166-ad32-fe84c9bd4f0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b76e4e23dcb42c58bc66b22054f42e0', 'request_id': 'req-f385cc8d-95ae-4166-ad32-fe84c9bd4f0f'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:29.536931 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-f385cc8d-95ae-4166-ad32-fe84c9bd4f0f admin admin] The token cache is being invalidate because project 7b76e4e23dcb42c58bc66b22054f42e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:31:29.537483 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-f385cc8d-95ae-4166-ad32-fe84c9bd4f0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:29.538252 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d93bbc-88e3-48e6-88ca-82f5ce9f5dfc None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:29.539639 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-f385cc8d-95ae-4166-ad32-fe84c9bd4f0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:29.543925 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1054/2128] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:31:29 2022] DELETE /identity/v3/projects/7b76e4e23dcb42c58bc66b22054f42e0 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:31:29.555600 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e450edc-f6cd-43b6-86d2-08615283f35a None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:29.557028 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e450edc-f6cd-43b6-86d2-08615283f35a None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:29.557434 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e450edc-f6cd-43b6-86d2-08615283f35a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:29.583863 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-3e450edc-f6cd-43b6-86d2-08615283f35a None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:31:29.585277 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-3e450edc-f6cd-43b6-86d2-08615283f35a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:29.674653 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11090eb3-a8f6-44f1-98c9-b8c85dd58dc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e79503178ac54e62ba385467d5617ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:29.675727 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11090eb3-a8f6-44f1-98c9-b8c85dd58dc3 service cinder] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:29.676221 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11090eb3-a8f6-44f1-98c9-b8c85dd58dc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:29.676994 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11090eb3-a8f6-44f1-98c9-b8c85dd58dc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:29.680416 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-11090eb3-a8f6-44f1-98c9-b8c85dd58dc3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:29.686153 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1055/2129] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:31:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:31:29.693844 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b6833c-2aa9-4f09-883f-e4b4bf1557fb None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:29.694335 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b6833c-2aa9-4f09-883f-e4b4bf1557fb None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:29.694685 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b6833c-2aa9-4f09-883f-e4b4bf1557fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:29.718209 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-94b6833c-2aa9-4f09-883f-e4b4bf1557fb None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:31:29.719739 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-94b6833c-2aa9-4f09-883f-e4b4bf1557fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:29.728289 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:29.730703 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1056/2130] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:31:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:31:29.735777 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b6833c-2aa9-4f09-883f-e4b4bf1557fb None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:29.746197 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b6833c-2aa9-4f09-883f-e4b4bf1557fb None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:29.751599 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0891f6-b76a-4eb1-a8e7-d9d991cf3cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:29.752424 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0891f6-b76a-4eb1-a8e7-d9d991cf3cc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:29.752715 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0891f6-b76a-4eb1-a8e7-d9d991cf3cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:29.752990 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0891f6-b76a-4eb1-a8e7-d9d991cf3cc1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:29.753664 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0891f6-b76a-4eb1-a8e7-d9d991cf3cc1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:31:29.753970 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0891f6-b76a-4eb1-a8e7-d9d991cf3cc1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:29.756455 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0891f6-b76a-4eb1-a8e7-d9d991cf3cc1 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:29.770126 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1057/2131] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 12:31:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:31:29.775096 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0891f6-b76a-4eb1-a8e7-d9d991cf3cc1 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:29.787580 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0891f6-b76a-4eb1-a8e7-d9d991cf3cc1 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:29.797693 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e502b-7cbe-48e9-abac-eeb0f3e59890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:29.801141 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e502b-7cbe-48e9-abac-eeb0f3e59890 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:29.802017 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e502b-7cbe-48e9-abac-eeb0f3e59890 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:29.803021 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e502b-7cbe-48e9-abac-eeb0f3e59890 admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:29.804987 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7e502b-7cbe-48e9-abac-eeb0f3e59890 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:29.811802 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7e502b-7cbe-48e9-abac-eeb0f3e59890 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:29.833068 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11090eb3-a8f6-44f1-98c9-b8c85dd58dc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:29.835870 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11090eb3-a8f6-44f1-98c9-b8c85dd58dc3 service cinder] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:29.855061 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1075/2132] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:31:29 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:31:29.895929 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1058/2133] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:31:29 2022] POST /identity/v3/projects => generated 383 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:31:29.902657 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11090eb3-a8f6-44f1-98c9-b8c85dd58dc3 service cinder] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:29.936417 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11090eb3-a8f6-44f1-98c9-b8c85dd58dc3 service cinder] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:29.946771 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e502b-7cbe-48e9-abac-eeb0f3e59890 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:29.950492 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-2f7e502b-7cbe-48e9-abac-eeb0f3e59890 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:29.984526 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:30.063145 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fb3bee-ef4e-4092-b9e4-332ca7488233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:30.063794 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb3bee-ef4e-4092-b9e4-332ca7488233 admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:30.064352 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb3bee-ef4e-4092-b9e4-332ca7488233 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:30.064622 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb3bee-ef4e-4092-b9e4-332ca7488233 admin admin] PATH_INFO: `/v3/users` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:30.065507 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fb3bee-ef4e-4092-b9e4-332ca7488233 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:30.067729 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fb3bee-ef4e-4092-b9e4-332ca7488233 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:30.100087 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e502b-7cbe-48e9-abac-eeb0f3e59890 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:30.109071 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1076/2134] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:31:29 2022] POST /identity/v3/users => generated 292 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:31:30.113561 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fb3bee-ef4e-4092-b9e4-332ca7488233 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:30.114539 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefe7685-4e9b-44b3-bcbf-3343415f2885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:30.115991 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe7685-4e9b-44b3-bcbf-3343415f2885 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:30.116831 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe7685-4e9b-44b3-bcbf-3343415f2885 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:30.117518 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe7685-4e9b-44b3-bcbf-3343415f2885 admin admin] PATH_INFO: `/v3/users/ad745262b78346b5846a3505c3da9f0c` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:30.120059 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefe7685-4e9b-44b3-bcbf-3343415f2885 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad745262b78346b5846a3505c3da9f0c)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:30.125841 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefe7685-4e9b-44b3-bcbf-3343415f2885 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:30.135068 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fb3bee-ef4e-4092-b9e4-332ca7488233 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:30.161540 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e6ccb5-e411-45d0-b720-8d80f2537582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:30.164492 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6ccb5-e411-45d0-b720-8d80f2537582 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:30.165567 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6ccb5-e411-45d0-b720-8d80f2537582 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:30.166177 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6ccb5-e411-45d0-b720-8d80f2537582 admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:30.168000 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e6ccb5-e411-45d0-b720-8d80f2537582 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:30.171572 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e6ccb5-e411-45d0-b720-8d80f2537582 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:30.201889 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1077/2135] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:31:30 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:31:30.201889 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e6ccb5-e411-45d0-b720-8d80f2537582 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:30.205390 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-53e6ccb5-e411-45d0-b720-8d80f2537582 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:30.239837 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-eefe7685-4e9b-44b3-bcbf-3343415f2885 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad745262b78346b5846a3505c3da9f0c'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:30.267689 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-eefe7685-4e9b-44b3-bcbf-3343415f2885 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad745262b78346b5846a3505c3da9f0c'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:30.269384 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-eefe7685-4e9b-44b3-bcbf-3343415f2885 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad745262b78346b5846a3505c3da9f0c'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:30.288590 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-eefe7685-4e9b-44b3-bcbf-3343415f2885 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad745262b78346b5846a3505c3da9f0c'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:30.289801 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-eefe7685-4e9b-44b3-bcbf-3343415f2885 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad745262b78346b5846a3505c3da9f0c'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:30.320871 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1059/2136] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:31:29 2022] DELETE /identity/v3/users/ad745262b78346b5846a3505c3da9f0c => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:31:30.322181 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefe7685-4e9b-44b3-bcbf-3343415f2885 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:30.327018 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-eefe7685-4e9b-44b3-bcbf-3343415f2885 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:30.337210 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e6ccb5-e411-45d0-b720-8d80f2537582 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:30.438346 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:30.455307 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefe7685-4e9b-44b3-bcbf-3343415f2885 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:30.462972 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f808b022-101c-49fc-bc92-6d6bcb00bdb3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e79503178ac54e62ba385467d5617ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:30.464112 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f808b022-101c-49fc-bc92-6d6bcb00bdb3 service cinder] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:30.464724 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f808b022-101c-49fc-bc92-6d6bcb00bdb3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:30.465431 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f808b022-101c-49fc-bc92-6d6bcb00bdb3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:30.469161 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-f808b022-101c-49fc-bc92-6d6bcb00bdb3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:30.476323 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a7da41-4a76-4275-87c0-4f3d9d92bab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:30.478670 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a7da41-4a76-4275-87c0-4f3d9d92bab6 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:30.479588 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a7da41-4a76-4275-87c0-4f3d9d92bab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:30.481134 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a7da41-4a76-4275-87c0-4f3d9d92bab6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:30.483490 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a7da41-4a76-4275-87c0-4f3d9d92bab6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:30.487250 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a7da41-4a76-4275-87c0-4f3d9d92bab6 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:30.516638 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1060/2137] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:31:30 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:31:30.516638 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4160ddc-a195-43ed-90c6-62a5677d6da2 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:30.516638 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4160ddc-a195-43ed-90c6-62a5677d6da2 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:30.516638 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4160ddc-a195-43ed-90c6-62a5677d6da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:30.556428 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-b4160ddc-a195-43ed-90c6-62a5677d6da2 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:31:30.556428 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-b4160ddc-a195-43ed-90c6-62a5677d6da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:30.572279 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1061/2138] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:31:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:31:30.574100 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4160ddc-a195-43ed-90c6-62a5677d6da2 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:30.605258 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4160ddc-a195-43ed-90c6-62a5677d6da2 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:30.613506 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f808b022-101c-49fc-bc92-6d6bcb00bdb3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:30.613928 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c03d372-3db9-409a-9924-e38c803828b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:30.615609 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03d372-3db9-409a-9924-e38c803828b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:30.616077 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03d372-3db9-409a-9924-e38c803828b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:30.616537 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03d372-3db9-409a-9924-e38c803828b8 admin admin] PATH_INFO: `/v3/projects/fbf87357e8374154b26b9b6d726d5269/users/a75359a06c734021bba849a0c85fe64e/roles/b5cfd7a855a448359e9017f51d32b6fc` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:30.619331 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f808b022-101c-49fc-bc92-6d6bcb00bdb3 service cinder] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:30.642441 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1078/2139] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:31:30 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:31:30.645741 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f808b022-101c-49fc-bc92-6d6bcb00bdb3 service cinder] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:30.659246 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-f808b022-101c-49fc-bc92-6d6bcb00bdb3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:30.671756 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c03d372-3db9-409a-9924-e38c803828b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbf87357e8374154b26b9b6d726d5269, user_id=a75359a06c734021bba849a0c85fe64e, role_id=b5cfd7a855a448359e9017f51d32b6fc)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:30.677543 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c03d372-3db9-409a-9924-e38c803828b8 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:30.711097 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1062/2140] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:31:30 2022] PUT /identity/v3/projects/fbf87357e8374154b26b9b6d726d5269/users/a75359a06c734021bba849a0c85fe64e/roles/b5cfd7a855a448359e9017f51d32b6fc => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:31:30.723818 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5457be2-e17b-4990-a35e-3be7bcb26652 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:30.724093 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5457be2-e17b-4990-a35e-3be7bcb26652 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:30.724368 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5457be2-e17b-4990-a35e-3be7bcb26652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:30.735424 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:30.803236 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-e5457be2-e17b-4990-a35e-3be7bcb26652 None None] MFA Rules not processed for user `a75359a06c734021bba849a0c85fe64e`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:31:30.806622 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-e5457be2-e17b-4990-a35e-3be7bcb26652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:30.825199 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f808b022-101c-49fc-bc92-6d6bcb00bdb3 service cinder] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:30.946613 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb5cbe8-6181-4345-8d6d-4f661dc504a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:30.947752 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb5cbe8-6181-4345-8d6d-4f661dc504a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:30.947752 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb5cbe8-6181-4345-8d6d-4f661dc504a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:30.947975 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb5cbe8-6181-4345-8d6d-4f661dc504a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:30.965988 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1063/2141] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:31:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:31:30.966762 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5457be2-e17b-4990-a35e-3be7bcb26652 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:30.968335 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-e5457be2-e17b-4990-a35e-3be7bcb26652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:31.048148 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb5cbe8-6181-4345-8d6d-4f661dc504a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:31.049916 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb5cbe8-6181-4345-8d6d-4f661dc504a1 service neutron] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:31.063158 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1079/2142] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:31:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:31:31.063776 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb5cbe8-6181-4345-8d6d-4f661dc504a1 service neutron] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:31.072043 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:31.079009 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb5cbe8-6181-4345-8d6d-4f661dc504a1 service neutron] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:31.086306 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5457be2-e17b-4990-a35e-3be7bcb26652 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:31.086623 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc187f96-91ac-4bc3-a73d-cae2c9152bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:31.087186 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc187f96-91ac-4bc3-a73d-cae2c9152bb5 admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:31.087495 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc187f96-91ac-4bc3-a73d-cae2c9152bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:31.087767 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc187f96-91ac-4bc3-a73d-cae2c9152bb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:31.088799 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc187f96-91ac-4bc3-a73d-cae2c9152bb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:31.091057 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc187f96-91ac-4bc3-a73d-cae2c9152bb5 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:31.096743 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38042f55-3fa2-4c1d-80e0-eb5f5179a170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:31.097852 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38042f55-3fa2-4c1d-80e0-eb5f5179a170 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:31.098735 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38042f55-3fa2-4c1d-80e0-eb5f5179a170 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:31.098991 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38042f55-3fa2-4c1d-80e0-eb5f5179a170 admin admin] PATH_INFO: `/v3/users/a33022540e3b461488249248e0527c0d` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:31.100949 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38042f55-3fa2-4c1d-80e0-eb5f5179a170 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a33022540e3b461488249248e0527c0d)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:31.105133 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38042f55-3fa2-4c1d-80e0-eb5f5179a170 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:31.135113 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1080/2143] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:31:31 2022] POST /identity/v3/projects => generated 385 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:31:31.137907 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc187f96-91ac-4bc3-a73d-cae2c9152bb5 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:31.179671 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-38042f55-3fa2-4c1d-80e0-eb5f5179a170 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a33022540e3b461488249248e0527c0d'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:31.201034 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-38042f55-3fa2-4c1d-80e0-eb5f5179a170 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a33022540e3b461488249248e0527c0d'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:31.201916 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-38042f55-3fa2-4c1d-80e0-eb5f5179a170 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a33022540e3b461488249248e0527c0d'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:31.210432 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-38042f55-3fa2-4c1d-80e0-eb5f5179a170 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a33022540e3b461488249248e0527c0d'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:31.211213 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-38042f55-3fa2-4c1d-80e0-eb5f5179a170 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a33022540e3b461488249248e0527c0d'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:31.229720 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1064/2144] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:31:30 2022] DELETE /identity/v3/users/a33022540e3b461488249248e0527c0d => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:31:31.234342 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd9329-4bc2-45f5-973b-13e718af3c40 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:31.234688 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd9329-4bc2-45f5-973b-13e718af3c40 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:31.235043 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd9329-4bc2-45f5-973b-13e718af3c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:31.265119 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-bfcd9329-4bc2-45f5-973b-13e718af3c40 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:31:31.266406 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-bfcd9329-4bc2-45f5-973b-13e718af3c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:31.275689 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:31.289537 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc187f96-91ac-4bc3-a73d-cae2c9152bb5 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:31.365343 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1065/2145] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:31:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:31:31.366376 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcd9329-4bc2-45f5-973b-13e718af3c40 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:31.373366 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-bfcd9329-4bc2-45f5-973b-13e718af3c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:31.394370 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcd9329-4bc2-45f5-973b-13e718af3c40 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:31.400510 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4108718-bdb1-4b1f-83ee-2f0b66b00d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:31.401190 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4108718-bdb1-4b1f-83ee-2f0b66b00d6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:31.401528 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4108718-bdb1-4b1f-83ee-2f0b66b00d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:31.401817 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4108718-bdb1-4b1f-83ee-2f0b66b00d6c admin admin] PATH_INFO: `/v3/users/932bd9bfbc0243258e49eb880c78ee98` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:31.403197 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4108718-bdb1-4b1f-83ee-2f0b66b00d6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=932bd9bfbc0243258e49eb880c78ee98)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:31.406583 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4108718-bdb1-4b1f-83ee-2f0b66b00d6c admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:31.435337 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3ef144-a7b2-4c18-bcbc-6e6923b222fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:31.436339 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ef144-a7b2-4c18-bcbc-6e6923b222fb admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:31.436631 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ef144-a7b2-4c18-bcbc-6e6923b222fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:31.436916 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ef144-a7b2-4c18-bcbc-6e6923b222fb admin admin] PATH_INFO: `/v3/users` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:31.437609 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3ef144-a7b2-4c18-bcbc-6e6923b222fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:31.440076 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3ef144-a7b2-4c18-bcbc-6e6923b222fb admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:31.471049 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1081/2146] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:31:31 2022] POST /identity/v3/users => generated 293 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:31:31.472294 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3ef144-a7b2-4c18-bcbc-6e6923b222fb admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:31.474134 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-2c3ef144-a7b2-4c18-bcbc-6e6923b222fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:31.488257 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-b4108718-bdb1-4b1f-83ee-2f0b66b00d6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '932bd9bfbc0243258e49eb880c78ee98'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:31.505552 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-b4108718-bdb1-4b1f-83ee-2f0b66b00d6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '932bd9bfbc0243258e49eb880c78ee98'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:31.506425 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-b4108718-bdb1-4b1f-83ee-2f0b66b00d6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '932bd9bfbc0243258e49eb880c78ee98'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:31.516384 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-b4108718-bdb1-4b1f-83ee-2f0b66b00d6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '932bd9bfbc0243258e49eb880c78ee98'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:31.517249 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-b4108718-bdb1-4b1f-83ee-2f0b66b00d6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '932bd9bfbc0243258e49eb880c78ee98'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:31.539699 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1066/2147] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:31:31 2022] DELETE /identity/v3/users/932bd9bfbc0243258e49eb880c78ee98 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:31:31.541100 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4108718-bdb1-4b1f-83ee-2f0b66b00d6c admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:31.544454 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-b4108718-bdb1-4b1f-83ee-2f0b66b00d6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:31.550090 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3ef144-a7b2-4c18-bcbc-6e6923b222fb admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:31.610244 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:31.638060 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4108718-bdb1-4b1f-83ee-2f0b66b00d6c admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:31.642330 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7925aa47-189b-4e56-a76c-bbea8396c05f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:31.643396 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7925aa47-189b-4e56-a76c-bbea8396c05f service neutron] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:31.643855 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7925aa47-189b-4e56-a76c-bbea8396c05f service neutron] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:31.644023 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcf38dd-2874-4dd0-9afe-6fd94c623693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:31.644238 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7925aa47-189b-4e56-a76c-bbea8396c05f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:31.644866 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf38dd-2874-4dd0-9afe-6fd94c623693 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:31.645415 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf38dd-2874-4dd0-9afe-6fd94c623693 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:31.645974 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf38dd-2874-4dd0-9afe-6fd94c623693 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:31.646748 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcf38dd-2874-4dd0-9afe-6fd94c623693 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:31.647084 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-7925aa47-189b-4e56-a76c-bbea8396c05f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:31.648879 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcf38dd-2874-4dd0-9afe-6fd94c623693 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:31.661009 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1067/2148] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:31:31 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:31:31.662232 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a4eaf-dd51-495f-a911-715471fb6d23 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:31.662591 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a4eaf-dd51-495f-a911-715471fb6d23 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:31.662952 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a4eaf-dd51-495f-a911-715471fb6d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:31.667860 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7925aa47-189b-4e56-a76c-bbea8396c05f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:31.671085 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7925aa47-189b-4e56-a76c-bbea8396c05f service neutron] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:31.684604 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-133a4eaf-dd51-495f-a911-715471fb6d23 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:31:31.685877 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-133a4eaf-dd51-495f-a911-715471fb6d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:31.690569 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1082/2149] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:31:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:31:31.692318 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7925aa47-189b-4e56-a76c-bbea8396c05f service neutron] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:31.693889 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1068/2150] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:31:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:31:31.694641 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-7925aa47-189b-4e56-a76c-bbea8396c05f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:31.694911 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133a4eaf-dd51-495f-a911-715471fb6d23 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:31.709814 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133a4eaf-dd51-495f-a911-715471fb6d23 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:31.715313 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7925aa47-189b-4e56-a76c-bbea8396c05f service neutron] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:31.719518 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed999a93-39de-41d1-8df6-0261768944b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:31.720719 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed999a93-39de-41d1-8df6-0261768944b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:31.721215 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed999a93-39de-41d1-8df6-0261768944b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:31.721770 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed999a93-39de-41d1-8df6-0261768944b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:31.723809 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed999a93-39de-41d1-8df6-0261768944b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:31.723949 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559b641c-ff5c-4bc8-85da-b7a6f40b67af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:31.725134 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b641c-ff5c-4bc8-85da-b7a6f40b67af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:31.725707 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b641c-ff5c-4bc8-85da-b7a6f40b67af admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:31.726278 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b641c-ff5c-4bc8-85da-b7a6f40b67af admin admin] PATH_INFO: `/v3/projects/ede2f6ce771948fe901ab4bd9bbbd2f9` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:31.727649 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed999a93-39de-41d1-8df6-0261768944b8 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:31.728496 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559b641c-ff5c-4bc8-85da-b7a6f40b67af admin admin] RBAC: Authorizing `identity:delete_project(project_id=ede2f6ce771948fe901ab4bd9bbbd2f9)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:31.733360 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559b641c-ff5c-4bc8-85da-b7a6f40b67af admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:31.753431 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1069/2151] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:31:31 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:31:31.755389 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed999a93-39de-41d1-8df6-0261768944b8 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:31.758708 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-ed999a93-39de-41d1-8df6-0261768944b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:31.769156 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:31.779106 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed999a93-39de-41d1-8df6-0261768944b8 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:31.788184 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848785a0-357b-4198-8aae-ce8dbee2e789 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:31.788866 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848785a0-357b-4198-8aae-ce8dbee2e789 service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:31.789693 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848785a0-357b-4198-8aae-ce8dbee2e789 service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:31.789924 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848785a0-357b-4198-8aae-ce8dbee2e789 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:31.803492 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848785a0-357b-4198-8aae-ce8dbee2e789 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:31.805030 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848785a0-357b-4198-8aae-ce8dbee2e789 service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:31.818104 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1070/2152] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:31:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:31:31.830233 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-559b641c-ff5c-4bc8-85da-b7a6f40b67af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ede2f6ce771948fe901ab4bd9bbbd2f9', 'request_id': 'req-559b641c-ff5c-4bc8-85da-b7a6f40b67af'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:31.831629 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848785a0-357b-4198-8aae-ce8dbee2e789 service neutron] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:31.844701 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-559b641c-ff5c-4bc8-85da-b7a6f40b67af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ede2f6ce771948fe901ab4bd9bbbd2f9', 'request_id': 'req-559b641c-ff5c-4bc8-85da-b7a6f40b67af'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:31.853266 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848785a0-357b-4198-8aae-ce8dbee2e789 service neutron] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:31.858490 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-559b641c-ff5c-4bc8-85da-b7a6f40b67af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ede2f6ce771948fe901ab4bd9bbbd2f9', 'request_id': 'req-559b641c-ff5c-4bc8-85da-b7a6f40b67af'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:31.887241 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-559b641c-ff5c-4bc8-85da-b7a6f40b67af admin admin] The token cache is being invalidate because project ede2f6ce771948fe901ab4bd9bbbd2f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:31:31.889612 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-559b641c-ff5c-4bc8-85da-b7a6f40b67af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:31.890800 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-559b641c-ff5c-4bc8-85da-b7a6f40b67af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:31.893786 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1083/2153] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:31:31 2022] DELETE /identity/v3/projects/ede2f6ce771948fe901ab4bd9bbbd2f9 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:31:31.901388 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5399491-4867-4743-9ed6-fba665b9d35b None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:31.901861 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5399491-4867-4743-9ed6-fba665b9d35b None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:31.902357 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5399491-4867-4743-9ed6-fba665b9d35b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:31.992192 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-c5399491-4867-4743-9ed6-fba665b9d35b None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:31:31.998683 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-c5399491-4867-4743-9ed6-fba665b9d35b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:32.088024 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc8516a-2e1b-497a-9d1a-132ff3d467f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:32.093191 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc8516a-2e1b-497a-9d1a-132ff3d467f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:32.093737 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc8516a-2e1b-497a-9d1a-132ff3d467f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:32.094219 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc8516a-2e1b-497a-9d1a-132ff3d467f7 admin admin] PATH_INFO: `/v3/projects/893c5cc2efda4500a202d18408c12d9f/users/5ec3809a62b24b41b2620778c99172ec/roles/b5cfd7a855a448359e9017f51d32b6fc` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:32.193619 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc8516a-2e1b-497a-9d1a-132ff3d467f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=893c5cc2efda4500a202d18408c12d9f, user_id=5ec3809a62b24b41b2620778c99172ec, role_id=b5cfd7a855a448359e9017f51d32b6fc)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:32.205206 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc8516a-2e1b-497a-9d1a-132ff3d467f7 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:32.245179 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1084/2154] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:31:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:31:32.257267 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6668bc-86e9-4842-9ffe-519abee12433 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:32.258043 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6668bc-86e9-4842-9ffe-519abee12433 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:32.258539 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6668bc-86e9-4842-9ffe-519abee12433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:32.268944 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1071/2155] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:31:31 2022] PUT /identity/v3/projects/893c5cc2efda4500a202d18408c12d9f/users/5ec3809a62b24b41b2620778c99172ec/roles/b5cfd7a855a448359e9017f51d32b6fc => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:31:32.289660 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45569bf0-03c2-401b-aa7a-a863085bb79e None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:32.290290 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45569bf0-03c2-401b-aa7a-a863085bb79e None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:32.290968 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45569bf0-03c2-401b-aa7a-a863085bb79e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:32.319077 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-8c6668bc-86e9-4842-9ffe-519abee12433 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:31:32.322356 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-8c6668bc-86e9-4842-9ffe-519abee12433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:32.351853 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-45569bf0-03c2-401b-aa7a-a863085bb79e None None] MFA Rules not processed for user `5ec3809a62b24b41b2620778c99172ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:31:32.353989 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-45569bf0-03c2-401b-aa7a-a863085bb79e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:32.551806 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1072/2156] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:31:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:31:32.554335 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45569bf0-03c2-401b-aa7a-a863085bb79e None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:32.557843 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-45569bf0-03c2-401b-aa7a-a863085bb79e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:32.573889 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1085/2157] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:31:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:31:32.573889 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6668bc-86e9-4842-9ffe-519abee12433 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:32.576115 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-8c6668bc-86e9-4842-9ffe-519abee12433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:32.590947 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45569bf0-03c2-401b-aa7a-a863085bb79e None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:32.592739 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:32.599387 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a6e9fa-2b86-44d6-add2-5643a96215ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:32.601635 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6e9fa-2b86-44d6-add2-5643a96215ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:32.602174 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6e9fa-2b86-44d6-add2-5643a96215ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:32.602518 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6e9fa-2b86-44d6-add2-5643a96215ee admin admin] PATH_INFO: `/v3/projects/a395fc63f96a486e9713cc9eb8b3665d` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:32.603971 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a6e9fa-2b86-44d6-add2-5643a96215ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=a395fc63f96a486e9713cc9eb8b3665d)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:32.606948 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6668bc-86e9-4842-9ffe-519abee12433 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:32.608741 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a6e9fa-2b86-44d6-add2-5643a96215ee admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:32.619646 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862c6634-974e-4fac-a1c9-754c3973115f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:32.623118 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c6634-974e-4fac-a1c9-754c3973115f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:32.623477 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c6634-974e-4fac-a1c9-754c3973115f admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:32.623865 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c6634-974e-4fac-a1c9-754c3973115f admin admin] PATH_INFO: `/v3/projects/372bf2533871419a8a61c4c1b036e738` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:32.627170 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862c6634-974e-4fac-a1c9-754c3973115f admin admin] RBAC: Authorizing `identity:delete_project(project_id=372bf2533871419a8a61c4c1b036e738)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:32.628647 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862c6634-974e-4fac-a1c9-754c3973115f admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:32.684788 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-e9a6e9fa-2b86-44d6-add2-5643a96215ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a395fc63f96a486e9713cc9eb8b3665d', 'request_id': 'req-e9a6e9fa-2b86-44d6-add2-5643a96215ee'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:32.696520 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-e9a6e9fa-2b86-44d6-add2-5643a96215ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a395fc63f96a486e9713cc9eb8b3665d', 'request_id': 'req-e9a6e9fa-2b86-44d6-add2-5643a96215ee'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:32.700357 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:32.712709 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-e9a6e9fa-2b86-44d6-add2-5643a96215ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a395fc63f96a486e9713cc9eb8b3665d', 'request_id': 'req-e9a6e9fa-2b86-44d6-add2-5643a96215ee'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:32.720156 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-862c6634-974e-4fac-a1c9-754c3973115f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '372bf2533871419a8a61c4c1b036e738', 'request_id': 'req-862c6634-974e-4fac-a1c9-754c3973115f'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:32.736299 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-862c6634-974e-4fac-a1c9-754c3973115f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '372bf2533871419a8a61c4c1b036e738', 'request_id': 'req-862c6634-974e-4fac-a1c9-754c3973115f'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:32.739806 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-e9a6e9fa-2b86-44d6-add2-5643a96215ee admin admin] The token cache is being invalidate because project a395fc63f96a486e9713cc9eb8b3665d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:31:32.740305 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-e9a6e9fa-2b86-44d6-add2-5643a96215ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:32.743692 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-e9a6e9fa-2b86-44d6-add2-5643a96215ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:32.746990 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1073/2158] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:31:32 2022] DELETE /identity/v3/projects/a395fc63f96a486e9713cc9eb8b3665d => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:31:32.748203 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a6e9fa-2b86-44d6-add2-5643a96215ee admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:32.749631 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-862c6634-974e-4fac-a1c9-754c3973115f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '372bf2533871419a8a61c4c1b036e738', 'request_id': 'req-862c6634-974e-4fac-a1c9-754c3973115f'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:32.751766 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-e9a6e9fa-2b86-44d6-add2-5643a96215ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:32.788954 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-862c6634-974e-4fac-a1c9-754c3973115f admin admin] The token cache is being invalidate because project 372bf2533871419a8a61c4c1b036e738 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:31:32.789297 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-862c6634-974e-4fac-a1c9-754c3973115f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:32.791878 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-862c6634-974e-4fac-a1c9-754c3973115f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:32.795180 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1086/2159] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:31:32 2022] DELETE /identity/v3/projects/372bf2533871419a8a61c4c1b036e738 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:31:32.795868 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862c6634-974e-4fac-a1c9-754c3973115f admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:32.802401 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-862c6634-974e-4fac-a1c9-754c3973115f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:32.881043 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a6e9fa-2b86-44d6-add2-5643a96215ee admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:32.908398 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862c6634-974e-4fac-a1c9-754c3973115f admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:32.915052 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e3f6c1-d019-45c4-bf09-176773ce0f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:32.915970 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e3f6c1-d019-45c4-bf09-176773ce0f08 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:32.916318 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e3f6c1-d019-45c4-bf09-176773ce0f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:32.916660 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e3f6c1-d019-45c4-bf09-176773ce0f08 admin admin] PATH_INFO: `/v3/domains` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:32.917951 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e3f6c1-d019-45c4-bf09-176773ce0f08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:31:32.918477 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e3f6c1-d019-45c4-bf09-176773ce0f08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:32.920275 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e3f6c1-d019-45c4-bf09-176773ce0f08 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:32.941177 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1087/2160] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 12:31:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:31:32.941863 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff86e93-a4a7-4b44-a924-bfcb7f0a6431 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:32.942989 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff86e93-a4a7-4b44-a924-bfcb7f0a6431 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:32.943494 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff86e93-a4a7-4b44-a924-bfcb7f0a6431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:32.969123 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f73639f-cd4e-45db-b75d-8a559f561259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:32.970147 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f73639f-cd4e-45db-b75d-8a559f561259 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:32.970731 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f73639f-cd4e-45db-b75d-8a559f561259 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:32.971368 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f73639f-cd4e-45db-b75d-8a559f561259 admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:32.972574 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f73639f-cd4e-45db-b75d-8a559f561259 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:32.974307 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-9ff86e93-a4a7-4b44-a924-bfcb7f0a6431 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:31:32.975893 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-9ff86e93-a4a7-4b44-a924-bfcb7f0a6431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:32.976591 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f73639f-cd4e-45db-b75d-8a559f561259 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:32.988735 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1088/2161] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:31:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:31:32.989905 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff86e93-a4a7-4b44-a924-bfcb7f0a6431 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:32.991728 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-9ff86e93-a4a7-4b44-a924-bfcb7f0a6431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:33.010377 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff86e93-a4a7-4b44-a924-bfcb7f0a6431 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:33.018570 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15640256-2e53-4fe7-9357-a70f91f74792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:33.019692 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15640256-2e53-4fe7-9357-a70f91f74792 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:33.019986 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15640256-2e53-4fe7-9357-a70f91f74792 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:33.020487 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15640256-2e53-4fe7-9357-a70f91f74792 admin admin] PATH_INFO: `/v3/users/3ff5131d6b99403aaf751a43baf3693d` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:33.022563 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15640256-2e53-4fe7-9357-a70f91f74792 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ff5131d6b99403aaf751a43baf3693d)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:33.026043 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15640256-2e53-4fe7-9357-a70f91f74792 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:33.037045 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1074/2162] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:31:32 2022] POST /identity/v3/projects => generated 385 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:31:33.038830 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f73639f-cd4e-45db-b75d-8a559f561259 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:33.113023 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-15640256-2e53-4fe7-9357-a70f91f74792 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ff5131d6b99403aaf751a43baf3693d'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:33.140952 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-15640256-2e53-4fe7-9357-a70f91f74792 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ff5131d6b99403aaf751a43baf3693d'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:33.145019 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:33.157741 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-15640256-2e53-4fe7-9357-a70f91f74792 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ff5131d6b99403aaf751a43baf3693d'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:33.159269 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-15640256-2e53-4fe7-9357-a70f91f74792 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ff5131d6b99403aaf751a43baf3693d'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:33.165950 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f73639f-cd4e-45db-b75d-8a559f561259 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:33.175644 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57656c71-18ab-4106-948a-ce22fe5263f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:33.176623 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-15640256-2e53-4fe7-9357-a70f91f74792 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ff5131d6b99403aaf751a43baf3693d'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:33.176837 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57656c71-18ab-4106-948a-ce22fe5263f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:33.177444 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57656c71-18ab-4106-948a-ce22fe5263f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:33.177678 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57656c71-18ab-4106-948a-ce22fe5263f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:33.178764 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57656c71-18ab-4106-948a-ce22fe5263f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:33.182786 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57656c71-18ab-4106-948a-ce22fe5263f5 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:33.191250 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1089/2163] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:31:32 2022] DELETE /identity/v3/users/3ff5131d6b99403aaf751a43baf3693d => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:31:33.194313 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cbbe5d-555d-4634-9825-248afbde9b84 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:33.196167 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cbbe5d-555d-4634-9825-248afbde9b84 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:33.196623 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cbbe5d-555d-4634-9825-248afbde9b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:33.239018 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1075/2164] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:31:33 2022] POST /identity/v3/projects => generated 385 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:31:33.240063 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57656c71-18ab-4106-948a-ce22fe5263f5 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:33.243069 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-57656c71-18ab-4106-948a-ce22fe5263f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:33.245956 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-f7cbbe5d-555d-4634-9825-248afbde9b84 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:31:33.253858 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:33.261775 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-f7cbbe5d-555d-4634-9825-248afbde9b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:33.454914 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57656c71-18ab-4106-948a-ce22fe5263f5 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:33.461235 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1090/2165] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:31:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:31:33.462691 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cbbe5d-555d-4634-9825-248afbde9b84 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:33.465228 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc999c2-5db1-4e2d-8fcb-0e62b9d9f527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:33.465628 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-f7cbbe5d-555d-4634-9825-248afbde9b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:33.466421 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc999c2-5db1-4e2d-8fcb-0e62b9d9f527 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:33.466922 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc999c2-5db1-4e2d-8fcb-0e62b9d9f527 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:33.467435 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc999c2-5db1-4e2d-8fcb-0e62b9d9f527 admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:33.468948 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc999c2-5db1-4e2d-8fcb-0e62b9d9f527 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:33.473765 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc999c2-5db1-4e2d-8fcb-0e62b9d9f527 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:33.502220 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cbbe5d-555d-4634-9825-248afbde9b84 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:33.518576 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1076/2166] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:31:33 2022] POST /identity/v3/users => generated 299 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:31:33.520227 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc999c2-5db1-4e2d-8fcb-0e62b9d9f527 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:33.540046 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd08a12a-b96c-4ff5-a88f-bc2453e26935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:33.540849 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc999c2-5db1-4e2d-8fcb-0e62b9d9f527 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:33.541096 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08a12a-b96c-4ff5-a88f-bc2453e26935 admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:33.541602 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08a12a-b96c-4ff5-a88f-bc2453e26935 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:33.542293 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08a12a-b96c-4ff5-a88f-bc2453e26935 admin admin] PATH_INFO: `/v3/users` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:33.546567 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd08a12a-b96c-4ff5-a88f-bc2453e26935 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:33.550823 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc79a50b-d853-4c8e-9e31-72f09b023916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:33.551150 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd08a12a-b96c-4ff5-a88f-bc2453e26935 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:33.552470 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc79a50b-d853-4c8e-9e31-72f09b023916 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:33.553037 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc79a50b-d853-4c8e-9e31-72f09b023916 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:33.553746 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc79a50b-d853-4c8e-9e31-72f09b023916 admin admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:33.555246 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc79a50b-d853-4c8e-9e31-72f09b023916 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:31:33.555976 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc79a50b-d853-4c8e-9e31-72f09b023916 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:33.560826 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc79a50b-d853-4c8e-9e31-72f09b023916 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:33.589154 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1077/2167] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 12:31:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:31:33.595091 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc79a50b-d853-4c8e-9e31-72f09b023916 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:33.615397 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1091/2168] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:31:33 2022] POST /identity/v3/users => generated 293 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:31:33.615397 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd08a12a-b96c-4ff5-a88f-bc2453e26935 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:33.617053 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc79a50b-d853-4c8e-9e31-72f09b023916 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:33.628249 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0569c27f-2b73-4cec-95c8-45f520cf8e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:33.629595 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569c27f-2b73-4cec-95c8-45f520cf8e72 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:33.630196 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569c27f-2b73-4cec-95c8-45f520cf8e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:33.630763 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569c27f-2b73-4cec-95c8-45f520cf8e72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:33.632129 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0569c27f-2b73-4cec-95c8-45f520cf8e72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:33.634342 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd08a12a-b96c-4ff5-a88f-bc2453e26935 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:33.635418 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0569c27f-2b73-4cec-95c8-45f520cf8e72 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:33.641039 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eb026d-2096-4a01-bd6f-d1c82d802116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:33.641973 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb026d-2096-4a01-bd6f-d1c82d802116 admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:33.642352 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb026d-2096-4a01-bd6f-d1c82d802116 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:33.642720 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb026d-2096-4a01-bd6f-d1c82d802116 admin admin] PATH_INFO: `/v3/projects` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:33.643528 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eb026d-2096-4a01-bd6f-d1c82d802116 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:33.645850 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eb026d-2096-4a01-bd6f-d1c82d802116 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:33.656075 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1078/2169] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:31:33 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:31:33.657346 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0569c27f-2b73-4cec-95c8-45f520cf8e72 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:33.676508 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0569c27f-2b73-4cec-95c8-45f520cf8e72 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:33.684884 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1092/2170] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:31:33 2022] POST /identity/v3/projects => generated 385 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:31:33.685915 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eb026d-2096-4a01-bd6f-d1c82d802116 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:33.690840 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e54021-8bc2-48f4-b3f4-c93166ed5188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:33.691965 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e54021-8bc2-48f4-b3f4-c93166ed5188 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:33.692489 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e54021-8bc2-48f4-b3f4-c93166ed5188 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:33.692893 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e54021-8bc2-48f4-b3f4-c93166ed5188 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:33.694105 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e54021-8bc2-48f4-b3f4-c93166ed5188 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:33.697259 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e54021-8bc2-48f4-b3f4-c93166ed5188 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:33.715229 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1079/2171] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:31:33 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:31:33.716673 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e54021-8bc2-48f4-b3f4-c93166ed5188 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:33.734114 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e54021-8bc2-48f4-b3f4-c93166ed5188 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:33.794610 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eb026d-2096-4a01-bd6f-d1c82d802116 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:33.802027 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf27855-74cd-434b-af7a-31c41a1be41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:33.802773 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf27855-74cd-434b-af7a-31c41a1be41b admin admin] REQUEST_METHOD: `PUT` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:33.803174 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf27855-74cd-434b-af7a-31c41a1be41b admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:33.803591 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf27855-74cd-434b-af7a-31c41a1be41b admin admin] PATH_INFO: `/v3/projects/fd986bf22bd344cf805d7a0d089ab18e/users/1b1f128c1d5d4f63a3fa0a1a46e8c5f2/roles/a332ef951db949b0bad7019fbd28a1b9` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:33.823916 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf27855-74cd-434b-af7a-31c41a1be41b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd986bf22bd344cf805d7a0d089ab18e, user_id=1b1f128c1d5d4f63a3fa0a1a46e8c5f2, role_id=a332ef951db949b0bad7019fbd28a1b9)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:33.827226 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf27855-74cd-434b-af7a-31c41a1be41b admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:33.846840 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1093/2172] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:31:33 2022] PUT /identity/v3/projects/fd986bf22bd344cf805d7a0d089ab18e/users/1b1f128c1d5d4f63a3fa0a1a46e8c5f2/roles/a332ef951db949b0bad7019fbd28a1b9 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:31:33.851189 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf27855-74cd-434b-af7a-31c41a1be41b admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:33.871354 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c458d-f997-4d8e-8396-98c584733247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:33.872199 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c458d-f997-4d8e-8396-98c584733247 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:33.873078 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c458d-f997-4d8e-8396-98c584733247 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:33.873505 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c458d-f997-4d8e-8396-98c584733247 admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:33.874298 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5c458d-f997-4d8e-8396-98c584733247 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:33.876878 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5c458d-f997-4d8e-8396-98c584733247 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:33.891520 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=93,keystone:INSERT=6,keystone:DELETE=1 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:33.915793 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1080/2173] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:31:33 2022] POST /identity/v3/users => generated 293 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:31:33.916594 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c458d-f997-4d8e-8396-98c584733247 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:33.924541 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-6d5c458d-f997-4d8e-8396-98c584733247 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:33.946443 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c458d-f997-4d8e-8396-98c584733247 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:33.951289 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf27855-74cd-434b-af7a-31c41a1be41b admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:33.956172 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12067ac0-11f0-4a11-9d33-752602493485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:33.957307 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12067ac0-11f0-4a11-9d33-752602493485 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:33.957817 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12067ac0-11f0-4a11-9d33-752602493485 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:33.958278 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12067ac0-11f0-4a11-9d33-752602493485 admin admin] PATH_INFO: `/v3/projects/02b1dad9fb244acf940881f0cb34cca5` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:33.960351 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af43f006-fc94-4c68-b32e-6807617749bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:33.961165 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12067ac0-11f0-4a11-9d33-752602493485 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02b1dad9fb244acf940881f0cb34cca5)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:33.961432 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af43f006-fc94-4c68-b32e-6807617749bf admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:33.963078 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af43f006-fc94-4c68-b32e-6807617749bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:33.963357 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af43f006-fc94-4c68-b32e-6807617749bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:33.964782 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af43f006-fc94-4c68-b32e-6807617749bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:33.966900 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12067ac0-11f0-4a11-9d33-752602493485 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:33.967137 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af43f006-fc94-4c68-b32e-6807617749bf admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:33.986049 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1094/2174] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:31:33 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:31:33.987850 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af43f006-fc94-4c68-b32e-6807617749bf admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:34.008750 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af43f006-fc94-4c68-b32e-6807617749bf admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:34.020563 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6664c6-6fcb-499d-8967-5c1b61c3fb18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:34.021731 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6664c6-6fcb-499d-8967-5c1b61c3fb18 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:34.022335 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6664c6-6fcb-499d-8967-5c1b61c3fb18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:34.022880 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6664c6-6fcb-499d-8967-5c1b61c3fb18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:34.024113 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6664c6-6fcb-499d-8967-5c1b61c3fb18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:34.027722 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6664c6-6fcb-499d-8967-5c1b61c3fb18 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:34.047231 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1095/2175] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:31:33 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:31:34.048781 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6664c6-6fcb-499d-8967-5c1b61c3fb18 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:34.057239 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=91,keystone:INSERT=6,keystone:DELETE=3 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:34.069393 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6664c6-6fcb-499d-8967-5c1b61c3fb18 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:34.077220 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-12067ac0-11f0-4a11-9d33-752602493485 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02b1dad9fb244acf940881f0cb34cca5', 'request_id': 'req-12067ac0-11f0-4a11-9d33-752602493485'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:34.092362 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-12067ac0-11f0-4a11-9d33-752602493485 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02b1dad9fb244acf940881f0cb34cca5', 'request_id': 'req-12067ac0-11f0-4a11-9d33-752602493485'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:34.107472 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-12067ac0-11f0-4a11-9d33-752602493485 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02b1dad9fb244acf940881f0cb34cca5', 'request_id': 'req-12067ac0-11f0-4a11-9d33-752602493485'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:34.127553 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-12067ac0-11f0-4a11-9d33-752602493485 admin admin] The token cache is being invalidate because project 02b1dad9fb244acf940881f0cb34cca5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:31:34.128015 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-12067ac0-11f0-4a11-9d33-752602493485 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:34.129265 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-12067ac0-11f0-4a11-9d33-752602493485 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:34.132276 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1081/2176] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:31:33 2022] DELETE /identity/v3/projects/02b1dad9fb244acf940881f0cb34cca5 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:31:34.133403 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12067ac0-11f0-4a11-9d33-752602493485 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:34.135638 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-12067ac0-11f0-4a11-9d33-752602493485 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:34.167203 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3b6882-23a4-4f82-9f37-1c9e491fe1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:34.168328 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b6882-23a4-4f82-9f37-1c9e491fe1db admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:34.168839 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b6882-23a4-4f82-9f37-1c9e491fe1db admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:34.169415 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b6882-23a4-4f82-9f37-1c9e491fe1db admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:34.170651 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3b6882-23a4-4f82-9f37-1c9e491fe1db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:34.174142 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3b6882-23a4-4f82-9f37-1c9e491fe1db admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:34.195855 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1096/2177] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:31:34 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:31:34.200143 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3b6882-23a4-4f82-9f37-1c9e491fe1db admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:34.203713 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-6d3b6882-23a4-4f82-9f37-1c9e491fe1db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:34.228030 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3b6882-23a4-4f82-9f37-1c9e491fe1db admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:34.236903 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f64c73-deba-4087-90a3-1db3c90b2626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:34.238297 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f64c73-deba-4087-90a3-1db3c90b2626 admin admin] REQUEST_METHOD: `PUT` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:34.238716 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f64c73-deba-4087-90a3-1db3c90b2626 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:34.239228 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f64c73-deba-4087-90a3-1db3c90b2626 admin admin] PATH_INFO: `/v3/projects/fd986bf22bd344cf805d7a0d089ab18e/users/1b1f128c1d5d4f63a3fa0a1a46e8c5f2/roles/a332ef951db949b0bad7019fbd28a1b9` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:34.241742 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f64c73-deba-4087-90a3-1db3c90b2626 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd986bf22bd344cf805d7a0d089ab18e, user_id=1b1f128c1d5d4f63a3fa0a1a46e8c5f2, role_id=a332ef951db949b0bad7019fbd28a1b9)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:34.247025 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f64c73-deba-4087-90a3-1db3c90b2626 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:34.258808 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12067ac0-11f0-4a11-9d33-752602493485 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:34.264159 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1097/2178] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:31:34 2022] PUT /identity/v3/projects/fd986bf22bd344cf805d7a0d089ab18e/users/1b1f128c1d5d4f63a3fa0a1a46e8c5f2/roles/a332ef951db949b0bad7019fbd28a1b9 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:31:34.265675 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7006d7a4-31e1-4446-84d6-72b206b04fd0 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:34.265962 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7006d7a4-31e1-4446-84d6-72b206b04fd0 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:34.266236 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7006d7a4-31e1-4446-84d6-72b206b04fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:34.296912 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-7006d7a4-31e1-4446-84d6-72b206b04fd0 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:31:34.298421 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-7006d7a4-31e1-4446-84d6-72b206b04fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:34.369166 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056c8a5b-9984-45c7-a808-77298c7034e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:34.371215 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c8a5b-9984-45c7-a808-77298c7034e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:34.371707 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c8a5b-9984-45c7-a808-77298c7034e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:34.372161 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c8a5b-9984-45c7-a808-77298c7034e3 admin admin] PATH_INFO: `/v3/projects/956c1d813a4c46ecaf583c93fe5a1e84/users/f11e0c1d436d48619d6d9f650c567a16/roles/b5cfd7a855a448359e9017f51d32b6fc` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:34.393528 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056c8a5b-9984-45c7-a808-77298c7034e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=956c1d813a4c46ecaf583c93fe5a1e84, user_id=f11e0c1d436d48619d6d9f650c567a16, role_id=b5cfd7a855a448359e9017f51d32b6fc)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:34.399568 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056c8a5b-9984-45c7-a808-77298c7034e3 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:34.406505 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1098/2179] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:31:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:31:34.407508 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7006d7a4-31e1-4446-84d6-72b206b04fd0 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:34.418672 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-7006d7a4-31e1-4446-84d6-72b206b04fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:34.426953 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1082/2180] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:31:34 2022] PUT /identity/v3/projects/956c1d813a4c46ecaf583c93fe5a1e84/users/f11e0c1d436d48619d6d9f650c567a16/roles/b5cfd7a855a448359e9017f51d32b6fc => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:31:34.426953 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c3d64-5902-43d9-9f0f-cd96ab54cc85 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:34.426953 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c3d64-5902-43d9-9f0f-cd96ab54cc85 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:34.426953 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c3d64-5902-43d9-9f0f-cd96ab54cc85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:34.435506 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7006d7a4-31e1-4446-84d6-72b206b04fd0 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:34.473504 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-981c3d64-5902-43d9-9f0f-cd96ab54cc85 None None] MFA Rules not processed for user `1b1f128c1d5d4f63a3fa0a1a46e8c5f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:31:34.477672 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-981c3d64-5902-43d9-9f0f-cd96ab54cc85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:34.496300 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:34.535013 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66542ad-e760-4693-9a69-2b32491e39c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:34.535774 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66542ad-e760-4693-9a69-2b32491e39c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:34.536123 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66542ad-e760-4693-9a69-2b32491e39c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:34.537039 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66542ad-e760-4693-9a69-2b32491e39c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:34.537296 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66542ad-e760-4693-9a69-2b32491e39c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:34.540221 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66542ad-e760-4693-9a69-2b32491e39c0 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:34.559921 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1099/2181] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:31:34 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:31:34.561568 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb4dce-cec8-43cc-a62f-77468c66baaf None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:34.561787 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb4dce-cec8-43cc-a62f-77468c66baaf None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:34.562059 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb4dce-cec8-43cc-a62f-77468c66baaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:34.581212 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:34.586109 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-2ceb4dce-cec8-43cc-a62f-77468c66baaf None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:31:34.587906 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-2ceb4dce-cec8-43cc-a62f-77468c66baaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:34.600161 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1100/2182] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:31:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:31:34.601432 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15891cb2-d3c8-41f0-a3a4-75f83d64751b None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:34.601765 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15891cb2-d3c8-41f0-a3a4-75f83d64751b None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:34.602119 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15891cb2-d3c8-41f0-a3a4-75f83d64751b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:34.623100 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1083/2183] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:31:34 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:31:34.623767 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981c3d64-5902-43d9-9f0f-cd96ab54cc85 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:34.641476 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-15891cb2-d3c8-41f0-a3a4-75f83d64751b None None] MFA Rules not processed for user `f11e0c1d436d48619d6d9f650c567a16`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:31:34.642738 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-15891cb2-d3c8-41f0-a3a4-75f83d64751b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:34.650534 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981c3d64-5902-43d9-9f0f-cd96ab54cc85 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:34.656807 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6044c471-558a-4bfc-9b63-03a1db605f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:34.657525 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6044c471-558a-4bfc-9b63-03a1db605f6c admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:34.657929 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6044c471-558a-4bfc-9b63-03a1db605f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:34.658136 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6044c471-558a-4bfc-9b63-03a1db605f6c admin admin] PATH_INFO: `/v3/projects/71001425c24a48a2b26d9d45bda9be1b/users/5d64688f4e6b43e48d3c25a6ef86523d/roles/b5cfd7a855a448359e9017f51d32b6fc` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:34.682003 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6044c471-558a-4bfc-9b63-03a1db605f6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=71001425c24a48a2b26d9d45bda9be1b, user_id=5d64688f4e6b43e48d3c25a6ef86523d, role_id=b5cfd7a855a448359e9017f51d32b6fc)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:34.687250 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6044c471-558a-4bfc-9b63-03a1db605f6c admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:34.710583 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1084/2184] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:31:34 2022] PUT /identity/v3/projects/71001425c24a48a2b26d9d45bda9be1b/users/5d64688f4e6b43e48d3c25a6ef86523d/roles/b5cfd7a855a448359e9017f51d32b6fc => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:31:34.712172 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6044c471-558a-4bfc-9b63-03a1db605f6c admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:34.739904 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1101/2185] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:31:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:31:34.746544 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15891cb2-d3c8-41f0-a3a4-75f83d64751b None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:34.746544 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-15891cb2-d3c8-41f0-a3a4-75f83d64751b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:34.824350 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15891cb2-d3c8-41f0-a3a4-75f83d64751b None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:34.859067 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6044c471-558a-4bfc-9b63-03a1db605f6c admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:34.865088 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e6724-ec7f-479b-af29-5267f9c1bd53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:34.865725 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e6724-ec7f-479b-af29-5267f9c1bd53 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:34.866010 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e6724-ec7f-479b-af29-5267f9c1bd53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:34.866285 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e6724-ec7f-479b-af29-5267f9c1bd53 admin admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:34.867016 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345e6724-ec7f-479b-af29-5267f9c1bd53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:31:34.867322 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345e6724-ec7f-479b-af29-5267f9c1bd53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:34.869090 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345e6724-ec7f-479b-af29-5267f9c1bd53 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:34.900778 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1085/2186] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 12:31:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:31:34.900778 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12152ac-07d2-4154-ba84-ce0725eb2c9e None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:34.900778 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12152ac-07d2-4154-ba84-ce0725eb2c9e None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:34.900778 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12152ac-07d2-4154-ba84-ce0725eb2c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:34.916378 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52406d1-e3d3-4db1-81bf-35f42ade09be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e79503178ac54e62ba385467d5617ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:34.917091 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52406d1-e3d3-4db1-81bf-35f42ade09be service cinder] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:34.917871 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52406d1-e3d3-4db1-81bf-35f42ade09be service cinder] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:34.918144 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52406d1-e3d3-4db1-81bf-35f42ade09be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:34.927666 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-a52406d1-e3d3-4db1-81bf-35f42ade09be service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:34.952624 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-b12152ac-07d2-4154-ba84-ce0725eb2c9e None None] MFA Rules not processed for user `5d64688f4e6b43e48d3c25a6ef86523d`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:31:34.953775 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-b12152ac-07d2-4154-ba84-ce0725eb2c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:34.991577 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:35.064288 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52406d1-e3d3-4db1-81bf-35f42ade09be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:35.074037 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1086/2187] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:31:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:31:35.074350 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52406d1-e3d3-4db1-81bf-35f42ade09be service cinder] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:35.074511 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12152ac-07d2-4154-ba84-ce0725eb2c9e None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:35.074511 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-b12152ac-07d2-4154-ba84-ce0725eb2c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:35.089586 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1102/2188] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:31:34 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:31:35.091961 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52406d1-e3d3-4db1-81bf-35f42ade09be service cinder] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:35.108356 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52406d1-e3d3-4db1-81bf-35f42ade09be service cinder] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:35.116220 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819de737-d16a-4f82-8880-909d978164dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:35.117059 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12152ac-07d2-4154-ba84-ce0725eb2c9e None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:35.117904 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819de737-d16a-4f82-8880-909d978164dc admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:35.118595 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819de737-d16a-4f82-8880-909d978164dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:35.119347 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819de737-d16a-4f82-8880-909d978164dc admin admin] PATH_INFO: `/v3/projects` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:35.121266 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819de737-d16a-4f82-8880-909d978164dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:35.123801 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8774119a-7621-48ac-a6dc-a3f6e862eefb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e79503178ac54e62ba385467d5617ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:35.125806 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819de737-d16a-4f82-8880-909d978164dc admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:35.128509 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8774119a-7621-48ac-a6dc-a3f6e862eefb service cinder] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:35.128986 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8774119a-7621-48ac-a6dc-a3f6e862eefb service cinder] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:35.129455 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8774119a-7621-48ac-a6dc-a3f6e862eefb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:35.185776 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1103/2189] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:31:35 2022] POST /identity/v3/projects => generated 385 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:31:35.191714 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819de737-d16a-4f82-8880-909d978164dc admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:35.238062 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:35.268563 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8774119a-7621-48ac-a6dc-a3f6e862eefb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:35.272713 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8774119a-7621-48ac-a6dc-a3f6e862eefb service cinder] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:35.293059 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1087/2190] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:31:35 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:31:35.299934 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819de737-d16a-4f82-8880-909d978164dc admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:35.305861 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ecdf83-dabe-40f8-9992-55391efdb2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:35.306952 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ecdf83-dabe-40f8-9992-55391efdb2e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:35.307233 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ecdf83-dabe-40f8-9992-55391efdb2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:35.307688 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ecdf83-dabe-40f8-9992-55391efdb2e4 admin admin] PATH_INFO: `/v3/users` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:35.308943 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ecdf83-dabe-40f8-9992-55391efdb2e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:35.311221 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ecdf83-dabe-40f8-9992-55391efdb2e4 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:35.341124 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1104/2191] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:31:35 2022] POST /identity/v3/users => generated 293 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:31:35.347872 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8774119a-7621-48ac-a6dc-a3f6e862eefb service cinder] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:35.378650 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8774119a-7621-48ac-a6dc-a3f6e862eefb service cinder] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:35.388120 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d735ba9-9d73-4f7b-b347-ce44e9d290b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:35.389181 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d735ba9-9d73-4f7b-b347-ce44e9d290b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:35.389635 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d735ba9-9d73-4f7b-b347-ce44e9d290b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:35.390093 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d735ba9-9d73-4f7b-b347-ce44e9d290b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:35.391301 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d735ba9-9d73-4f7b-b347-ce44e9d290b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:35.394454 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d735ba9-9d73-4f7b-b347-ce44e9d290b0 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:35.425044 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1088/2192] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:31:35 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:31:35.426641 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ecdf83-dabe-40f8-9992-55391efdb2e4 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:35.446633 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ecdf83-dabe-40f8-9992-55391efdb2e4 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:35.452538 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d25a02f-fce6-4721-b7c5-0f75702ea512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:35.453180 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25a02f-fce6-4721-b7c5-0f75702ea512 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:35.453477 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25a02f-fce6-4721-b7c5-0f75702ea512 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:35.453716 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25a02f-fce6-4721-b7c5-0f75702ea512 admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:35.454389 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d25a02f-fce6-4721-b7c5-0f75702ea512 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:35.456074 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d25a02f-fce6-4721-b7c5-0f75702ea512 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:35.471250 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1105/2193] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:31:35 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 12:31:35.475186 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d735ba9-9d73-4f7b-b347-ce44e9d290b0 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:35.489345 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d735ba9-9d73-4f7b-b347-ce44e9d290b0 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:35.495294 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c95fa2b-4235-4df5-a9fb-d1f7a2468d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:35.496341 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95fa2b-4235-4df5-a9fb-d1f7a2468d3f admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:35.496518 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95fa2b-4235-4df5-a9fb-d1f7a2468d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:35.496650 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95fa2b-4235-4df5-a9fb-d1f7a2468d3f admin admin] PATH_INFO: `/v3/projects/8446d3401d0d496d877b2a20cc9af2a3/users/4594b085bf1d46d7b52e536de99a9834/roles/b5cfd7a855a448359e9017f51d32b6fc` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:35.515585 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c95fa2b-4235-4df5-a9fb-d1f7a2468d3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8446d3401d0d496d877b2a20cc9af2a3, user_id=4594b085bf1d46d7b52e536de99a9834, role_id=b5cfd7a855a448359e9017f51d32b6fc)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:35.518483 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c95fa2b-4235-4df5-a9fb-d1f7a2468d3f admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:35.539674 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1089/2194] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:31:35 2022] PUT /identity/v3/projects/8446d3401d0d496d877b2a20cc9af2a3/users/4594b085bf1d46d7b52e536de99a9834/roles/b5cfd7a855a448359e9017f51d32b6fc => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:31:35.554160 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a66ff55-d333-4d37-ba68-db81750f58d4 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:35.554739 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a66ff55-d333-4d37-ba68-db81750f58d4 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:35.555399 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a66ff55-d333-4d37-ba68-db81750f58d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:35.607089 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c95fa2b-4235-4df5-a9fb-d1f7a2468d3f admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:35.623896 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-0a66ff55-d333-4d37-ba68-db81750f58d4 None None] MFA Rules not processed for user `4594b085bf1d46d7b52e536de99a9834`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:31:35.626169 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-0a66ff55-d333-4d37-ba68-db81750f58d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:35.782340 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c95fa2b-4235-4df5-a9fb-d1f7a2468d3f admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:35.788516 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17e2ee-e3fc-4a93-aa92-c61f4cf7428f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e79503178ac54e62ba385467d5617ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:35.790006 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17e2ee-e3fc-4a93-aa92-c61f4cf7428f service cinder] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:35.790583 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17e2ee-e3fc-4a93-aa92-c61f4cf7428f service cinder] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:35.791369 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17e2ee-e3fc-4a93-aa92-c61f4cf7428f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:35.858417 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1106/2195] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:31:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:31:35.859847 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a66ff55-d333-4d37-ba68-db81750f58d4 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:35.889341 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:35.974167 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b17e2ee-e3fc-4a93-aa92-c61f4cf7428f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:35.974167 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b17e2ee-e3fc-4a93-aa92-c61f4cf7428f service cinder] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:35.990202 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1090/2196] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:31:35 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:31:36.110660 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a66ff55-d333-4d37-ba68-db81750f58d4 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:36.119135 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da820406-70e7-4627-add9-81e570436b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:36.120450 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da820406-70e7-4627-add9-81e570436b69 admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:36.120991 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da820406-70e7-4627-add9-81e570436b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:36.121540 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da820406-70e7-4627-add9-81e570436b69 admin admin] PATH_INFO: `/v3/projects` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:36.122755 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da820406-70e7-4627-add9-81e570436b69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:36.126687 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da820406-70e7-4627-add9-81e570436b69 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:36.187864 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17e2ee-e3fc-4a93-aa92-c61f4cf7428f service cinder] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:36.191058 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-2b17e2ee-e3fc-4a93-aa92-c61f4cf7428f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:36.200904 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1107/2197] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:31:35 2022] POST /identity/v3/projects => generated 387 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:31:36.204484 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da820406-70e7-4627-add9-81e570436b69 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:36.233217 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17e2ee-e3fc-4a93-aa92-c61f4cf7428f service cinder] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:36.350099 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a63930c-c8f1-4cd5-88f9-24cd19817c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:36.351034 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a63930c-c8f1-4cd5-88f9-24cd19817c14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:36.351383 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a63930c-c8f1-4cd5-88f9-24cd19817c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:36.352064 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a63930c-c8f1-4cd5-88f9-24cd19817c14 admin admin] PATH_INFO: `/v3/users/ac21d0e500224428bb8f2db075e63a6e` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:36.353277 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a63930c-c8f1-4cd5-88f9-24cd19817c14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac21d0e500224428bb8f2db075e63a6e)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:36.356789 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a63930c-c8f1-4cd5-88f9-24cd19817c14 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:36.360016 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:36.361769 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da820406-70e7-4627-add9-81e570436b69 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:36.369806 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4faf4af-8283-4569-8741-8ae044f8147b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:36.372050 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4faf4af-8283-4569-8741-8ae044f8147b admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:36.372656 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4faf4af-8283-4569-8741-8ae044f8147b admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:36.373130 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4faf4af-8283-4569-8741-8ae044f8147b admin admin] PATH_INFO: `/v3/users` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:36.374270 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4faf4af-8283-4569-8741-8ae044f8147b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:36.378529 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4faf4af-8283-4569-8741-8ae044f8147b admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:36.426910 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1108/2198] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:31:36 2022] POST /identity/v3/users => generated 300 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:31:36.431869 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4faf4af-8283-4569-8741-8ae044f8147b admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:36.437949 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-0a63930c-c8f1-4cd5-88f9-24cd19817c14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac21d0e500224428bb8f2db075e63a6e'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:36.467807 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-0a63930c-c8f1-4cd5-88f9-24cd19817c14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac21d0e500224428bb8f2db075e63a6e'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:36.469314 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-0a63930c-c8f1-4cd5-88f9-24cd19817c14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac21d0e500224428bb8f2db075e63a6e'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:36.481809 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4faf4af-8283-4569-8741-8ae044f8147b admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:36.485404 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-0a63930c-c8f1-4cd5-88f9-24cd19817c14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac21d0e500224428bb8f2db075e63a6e'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:36.486950 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-0a63930c-c8f1-4cd5-88f9-24cd19817c14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac21d0e500224428bb8f2db075e63a6e'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:36.496039 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0e3352-39ca-4f5c-87b8-913a41f812d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:36.497684 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e3352-39ca-4f5c-87b8-913a41f812d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:36.498219 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e3352-39ca-4f5c-87b8-913a41f812d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:36.498744 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e3352-39ca-4f5c-87b8-913a41f812d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:36.500018 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0e3352-39ca-4f5c-87b8-913a41f812d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:36.503932 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0e3352-39ca-4f5c-87b8-913a41f812d5 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:36.525620 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1109/2200] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:31:36 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 12:31:36.526009 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1091/2200] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:31:36 2022] DELETE /identity/v3/users/ac21d0e500224428bb8f2db075e63a6e => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:31:36.529811 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a63930c-c8f1-4cd5-88f9-24cd19817c14 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:36.532320 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-0a63930c-c8f1-4cd5-88f9-24cd19817c14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:36.533514 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaeda7c-46d9-4d94-a8eb-9a0e239f5c66 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:36.534049 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaeda7c-46d9-4d94-a8eb-9a0e239f5c66 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:36.534517 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaeda7c-46d9-4d94-a8eb-9a0e239f5c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:36.567692 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-fbaeda7c-46d9-4d94-a8eb-9a0e239f5c66 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:31:36.580565 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-fbaeda7c-46d9-4d94-a8eb-9a0e239f5c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:36.674912 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a63930c-c8f1-4cd5-88f9-24cd19817c14 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:36.681868 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ffd8c1-43ac-48eb-b7ed-f24ac96ea4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:36.682746 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ffd8c1-43ac-48eb-b7ed-f24ac96ea4d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:36.684250 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ffd8c1-43ac-48eb-b7ed-f24ac96ea4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:36.684760 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ffd8c1-43ac-48eb-b7ed-f24ac96ea4d3 admin admin] PATH_INFO: `/v3/projects/f03e90393e11401faf0a6f28bb3546c7/users/d76d39cb8f3a486c80d31694dd503d1e/roles/a332ef951db949b0bad7019fbd28a1b9` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:36.688186 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1110/2201] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:31:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:31:36.695858 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaeda7c-46d9-4d94-a8eb-9a0e239f5c66 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:36.700140 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-fbaeda7c-46d9-4d94-a8eb-9a0e239f5c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:36.704728 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ffd8c1-43ac-48eb-b7ed-f24ac96ea4d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f03e90393e11401faf0a6f28bb3546c7, user_id=d76d39cb8f3a486c80d31694dd503d1e, role_id=a332ef951db949b0bad7019fbd28a1b9)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:36.707866 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ffd8c1-43ac-48eb-b7ed-f24ac96ea4d3 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:36.730477 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1092/2202] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:31:36 2022] PUT /identity/v3/projects/f03e90393e11401faf0a6f28bb3546c7/users/d76d39cb8f3a486c80d31694dd503d1e/roles/a332ef951db949b0bad7019fbd28a1b9 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:31:36.734940 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ffd8c1-43ac-48eb-b7ed-f24ac96ea4d3 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:36.755885 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:36.812770 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaeda7c-46d9-4d94-a8eb-9a0e239f5c66 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:36.833604 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ffd8c1-43ac-48eb-b7ed-f24ac96ea4d3 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:36.840996 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1cc73e-21f5-479b-87d6-51a30088bf71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:36.841929 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1cc73e-21f5-479b-87d6-51a30088bf71 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:36.842388 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1cc73e-21f5-479b-87d6-51a30088bf71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:36.842878 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1cc73e-21f5-479b-87d6-51a30088bf71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:36.843887 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1cc73e-21f5-479b-87d6-51a30088bf71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:36.846239 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1cc73e-21f5-479b-87d6-51a30088bf71 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:36.853824 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:36.862843 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1093/2203] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:31:36 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 12:31:36.868965 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1cc73e-21f5-479b-87d6-51a30088bf71 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:36.875508 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96b8b50-6a41-4584-b05e-82b1a7755a7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:36.876141 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b8b50-6a41-4584-b05e-82b1a7755a7b service neutron] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:36.876421 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b8b50-6a41-4584-b05e-82b1a7755a7b service neutron] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:36.876694 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b8b50-6a41-4584-b05e-82b1a7755a7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:36.883605 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1cc73e-21f5-479b-87d6-51a30088bf71 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:36.888889 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96b8b50-6a41-4584-b05e-82b1a7755a7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:36.890613 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96b8b50-6a41-4584-b05e-82b1a7755a7b service neutron] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:36.891633 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd3b6e9-ec5b-4f2f-bee4-7e80a8f040a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:36.892657 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3b6e9-ec5b-4f2f-bee4-7e80a8f040a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:36.893086 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3b6e9-ec5b-4f2f-bee4-7e80a8f040a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:36.893665 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3b6e9-ec5b-4f2f-bee4-7e80a8f040a0 admin admin] PATH_INFO: `/v3/projects/f03e90393e11401faf0a6f28bb3546c7/users/d76d39cb8f3a486c80d31694dd503d1e/roles/a332ef951db949b0bad7019fbd28a1b9` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:36.896190 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd3b6e9-ec5b-4f2f-bee4-7e80a8f040a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f03e90393e11401faf0a6f28bb3546c7, user_id=d76d39cb8f3a486c80d31694dd503d1e, role_id=a332ef951db949b0bad7019fbd28a1b9)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:36.899254 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd3b6e9-ec5b-4f2f-bee4-7e80a8f040a0 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:36.903360 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1111/2204] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:31:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:31:36.911944 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1094/2205] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:31:36 2022] PUT /identity/v3/projects/f03e90393e11401faf0a6f28bb3546c7/users/d76d39cb8f3a486c80d31694dd503d1e/roles/a332ef951db949b0bad7019fbd28a1b9 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:31:36.928418 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e9440a-0dd1-432b-b51a-bbf2a72fd2e3 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:36.928711 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e9440a-0dd1-432b-b51a-bbf2a72fd2e3 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:36.929006 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e9440a-0dd1-432b-b51a-bbf2a72fd2e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:36.962169 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-e7e9440a-0dd1-432b-b51a-bbf2a72fd2e3 None None] MFA Rules not processed for user `d76d39cb8f3a486c80d31694dd503d1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:31:36.963467 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-e7e9440a-0dd1-432b-b51a-bbf2a72fd2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:37.090892 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1112/2206] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:31:36 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:31:37.105756 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd3b6e9-ec5b-4f2f-bee4-7e80a8f040a0 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:37.109347 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-fbd3b6e9-ec5b-4f2f-bee4-7e80a8f040a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:37.223896 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd3b6e9-ec5b-4f2f-bee4-7e80a8f040a0 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:37.227967 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d51c0b-c40c-4c61-b63b-67022c196338 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e79503178ac54e62ba385467d5617ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:37.228824 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d51c0b-c40c-4c61-b63b-67022c196338 service cinder] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:37.229026 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d51c0b-c40c-4c61-b63b-67022c196338 service cinder] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:37.229401 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d51c0b-c40c-4c61-b63b-67022c196338 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:37.244189 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d51c0b-c40c-4c61-b63b-67022c196338 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:37.246303 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d51c0b-c40c-4c61-b63b-67022c196338 service cinder] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:37.271796 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1095/2207] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:31:37 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:31:37.306846 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e9440a-0dd1-432b-b51a-bbf2a72fd2e3 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:37.308075 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d51c0b-c40c-4c61-b63b-67022c196338 service cinder] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:37.310447 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-85d51c0b-c40c-4c61-b63b-67022c196338 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:37.457375 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e9440a-0dd1-432b-b51a-bbf2a72fd2e3 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:37.462499 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f6166c-645e-4b1f-bc3c-0499f4469ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:37.463212 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f6166c-645e-4b1f-bc3c-0499f4469ba8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:37.463496 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f6166c-645e-4b1f-bc3c-0499f4469ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:37.463804 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f6166c-645e-4b1f-bc3c-0499f4469ba8 admin admin] PATH_INFO: `/v3/users/4594b085bf1d46d7b52e536de99a9834` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:37.465201 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f6166c-645e-4b1f-bc3c-0499f4469ba8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4594b085bf1d46d7b52e536de99a9834)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:37.467845 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f6166c-645e-4b1f-bc3c-0499f4469ba8 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:37.471589 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:37.496253 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d51c0b-c40c-4c61-b63b-67022c196338 service cinder] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:37.501850 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dadd88a-2526-41f8-86d2-bdff1dba8dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:37.502510 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dadd88a-2526-41f8-86d2-bdff1dba8dc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:37.502798 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dadd88a-2526-41f8-86d2-bdff1dba8dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:37.503103 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dadd88a-2526-41f8-86d2-bdff1dba8dc2 admin admin] PATH_INFO: `/v3/projects/1e7f236c21b644ed90112b6e60e52e65` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:37.504347 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dadd88a-2526-41f8-86d2-bdff1dba8dc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e7f236c21b644ed90112b6e60e52e65)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:37.506806 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dadd88a-2526-41f8-86d2-bdff1dba8dc2 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:37.565796 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-35f6166c-645e-4b1f-bc3c-0499f4469ba8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4594b085bf1d46d7b52e536de99a9834'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:37.582808 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-2dadd88a-2526-41f8-86d2-bdff1dba8dc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e7f236c21b644ed90112b6e60e52e65', 'request_id': 'req-2dadd88a-2526-41f8-86d2-bdff1dba8dc2'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:37.593395 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-2dadd88a-2526-41f8-86d2-bdff1dba8dc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e7f236c21b644ed90112b6e60e52e65', 'request_id': 'req-2dadd88a-2526-41f8-86d2-bdff1dba8dc2'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:37.595017 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-35f6166c-645e-4b1f-bc3c-0499f4469ba8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4594b085bf1d46d7b52e536de99a9834'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:37.602087 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-2dadd88a-2526-41f8-86d2-bdff1dba8dc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e7f236c21b644ed90112b6e60e52e65', 'request_id': 'req-2dadd88a-2526-41f8-86d2-bdff1dba8dc2'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:37.615002 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-35f6166c-645e-4b1f-bc3c-0499f4469ba8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4594b085bf1d46d7b52e536de99a9834'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:37.616535 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-2dadd88a-2526-41f8-86d2-bdff1dba8dc2 admin admin] The token cache is being invalidate because project 1e7f236c21b644ed90112b6e60e52e65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:31:37.617041 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-2dadd88a-2526-41f8-86d2-bdff1dba8dc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:37.617164 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-35f6166c-645e-4b1f-bc3c-0499f4469ba8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4594b085bf1d46d7b52e536de99a9834'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:37.617907 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-2dadd88a-2526-41f8-86d2-bdff1dba8dc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:37.621198 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1096/2208] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:31:37 2022] DELETE /identity/v3/projects/1e7f236c21b644ed90112b6e60e52e65 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:31:37.622232 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dadd88a-2526-41f8-86d2-bdff1dba8dc2 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:37.623720 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-2dadd88a-2526-41f8-86d2-bdff1dba8dc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:37.634901 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-35f6166c-645e-4b1f-bc3c-0499f4469ba8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4594b085bf1d46d7b52e536de99a9834'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:37.645550 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1113/2209] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:31:37 2022] DELETE /identity/v3/users/4594b085bf1d46d7b52e536de99a9834 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:31:37.646761 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f6166c-645e-4b1f-bc3c-0499f4469ba8 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:37.648261 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-35f6166c-645e-4b1f-bc3c-0499f4469ba8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:37.650723 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:37.714815 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dadd88a-2526-41f8-86d2-bdff1dba8dc2 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:37.758357 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f6166c-645e-4b1f-bc3c-0499f4469ba8 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:37.765494 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1e6234-f9c3-42dd-a8d8-3f59edc26966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:37.766158 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e6234-f9c3-42dd-a8d8-3f59edc26966 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:37.766594 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e6234-f9c3-42dd-a8d8-3f59edc26966 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:37.766896 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e6234-f9c3-42dd-a8d8-3f59edc26966 admin admin] PATH_INFO: `/v3/users/47d1624496c3454c97ae529bbe45bf21` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:37.768147 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1e6234-f9c3-42dd-a8d8-3f59edc26966 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47d1624496c3454c97ae529bbe45bf21)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:37.770678 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1e6234-f9c3-42dd-a8d8-3f59edc26966 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:37.795855 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b8d018-8563-4d85-b130-bc77127feb56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e79503178ac54e62ba385467d5617ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:37.797274 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b8d018-8563-4d85-b130-bc77127feb56 service cinder] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:37.797744 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b8d018-8563-4d85-b130-bc77127feb56 service cinder] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:37.798218 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b8d018-8563-4d85-b130-bc77127feb56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:37.802127 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-43b8d018-8563-4d85-b130-bc77127feb56 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:37.852564 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-8f1e6234-f9c3-42dd-a8d8-3f59edc26966 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47d1624496c3454c97ae529bbe45bf21'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:37.878062 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-8f1e6234-f9c3-42dd-a8d8-3f59edc26966 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47d1624496c3454c97ae529bbe45bf21'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:37.890671 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-8f1e6234-f9c3-42dd-a8d8-3f59edc26966 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47d1624496c3454c97ae529bbe45bf21'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:37.892133 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-8f1e6234-f9c3-42dd-a8d8-3f59edc26966 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47d1624496c3454c97ae529bbe45bf21'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:37.902402 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b8d018-8563-4d85-b130-bc77127feb56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:37.905027 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-8f1e6234-f9c3-42dd-a8d8-3f59edc26966 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47d1624496c3454c97ae529bbe45bf21'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:37.905376 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b8d018-8563-4d85-b130-bc77127feb56 service cinder] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:37.909869 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:37.924351 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1114/2210] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:31:37 2022] DELETE /identity/v3/users/47d1624496c3454c97ae529bbe45bf21 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:31:37.925804 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10701679-b87f-4245-a463-02ef40ee7618 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:37.926100 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10701679-b87f-4245-a463-02ef40ee7618 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:37.926683 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10701679-b87f-4245-a463-02ef40ee7618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:37.943461 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1097/2211] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:31:37 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:31:37.964195 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-10701679-b87f-4245-a463-02ef40ee7618 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:31:37.965640 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-10701679-b87f-4245-a463-02ef40ee7618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:38.112106 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1115/2212] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:31:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:31:38.124559 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b8d018-8563-4d85-b130-bc77127feb56 service cinder] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:38.126456 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-43b8d018-8563-4d85-b130-bc77127feb56 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:38.318299 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b8d018-8563-4d85-b130-bc77127feb56 service cinder] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:38.411174 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10701679-b87f-4245-a463-02ef40ee7618 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:38.413206 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-10701679-b87f-4245-a463-02ef40ee7618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:38.424048 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:38.438512 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca9373f-d045-42a9-a2aa-ea037674126e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:38.440988 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca9373f-d045-42a9-a2aa-ea037674126e service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:38.441989 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca9373f-d045-42a9-a2aa-ea037674126e service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:38.443139 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca9373f-d045-42a9-a2aa-ea037674126e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:38.458233 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10701679-b87f-4245-a463-02ef40ee7618 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:38.469460 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135bbb77-9a4d-494c-9cde-faba8ee004fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:38.470218 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca9373f-d045-42a9-a2aa-ea037674126e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:38.470615 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135bbb77-9a4d-494c-9cde-faba8ee004fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:38.471307 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135bbb77-9a4d-494c-9cde-faba8ee004fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:38.471988 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135bbb77-9a4d-494c-9cde-faba8ee004fb admin admin] PATH_INFO: `/v3/projects/ccbdb10cd505494bad4fadf549bd0473` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:38.474519 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135bbb77-9a4d-494c-9cde-faba8ee004fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccbdb10cd505494bad4fadf549bd0473)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:38.475210 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca9373f-d045-42a9-a2aa-ea037674126e service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:38.480221 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135bbb77-9a4d-494c-9cde-faba8ee004fb admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:38.507070 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1098/2213] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:31:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:31:38.543702 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca9373f-d045-42a9-a2aa-ea037674126e service neutron] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:38.547896 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-3ca9373f-d045-42a9-a2aa-ea037674126e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:38.573908 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca9373f-d045-42a9-a2aa-ea037674126e service neutron] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:38.618118 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-135bbb77-9a4d-494c-9cde-faba8ee004fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccbdb10cd505494bad4fadf549bd0473', 'request_id': 'req-135bbb77-9a4d-494c-9cde-faba8ee004fb'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:38.632025 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-135bbb77-9a4d-494c-9cde-faba8ee004fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccbdb10cd505494bad4fadf549bd0473', 'request_id': 'req-135bbb77-9a4d-494c-9cde-faba8ee004fb'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:38.646546 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-135bbb77-9a4d-494c-9cde-faba8ee004fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccbdb10cd505494bad4fadf549bd0473', 'request_id': 'req-135bbb77-9a4d-494c-9cde-faba8ee004fb'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:38.668533 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-135bbb77-9a4d-494c-9cde-faba8ee004fb admin admin] The token cache is being invalidate because project ccbdb10cd505494bad4fadf549bd0473 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:31:38.668828 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-135bbb77-9a4d-494c-9cde-faba8ee004fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:38.669572 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-135bbb77-9a4d-494c-9cde-faba8ee004fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:38.671399 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1116/2214] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:31:38 2022] DELETE /identity/v3/projects/ccbdb10cd505494bad4fadf549bd0473 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:31:38.676371 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135bbb77-9a4d-494c-9cde-faba8ee004fb admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:38.679695 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-135bbb77-9a4d-494c-9cde-faba8ee004fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:38.689089 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb67774d-f1a6-4e9b-812e-e0c9a2a3d284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:38.689813 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb67774d-f1a6-4e9b-812e-e0c9a2a3d284 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:38.690097 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb67774d-f1a6-4e9b-812e-e0c9a2a3d284 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:38.690369 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb67774d-f1a6-4e9b-812e-e0c9a2a3d284 admin admin] PATH_INFO: `/v3/users/f11e0c1d436d48619d6d9f650c567a16` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:38.691652 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb67774d-f1a6-4e9b-812e-e0c9a2a3d284 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f11e0c1d436d48619d6d9f650c567a16)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:38.693663 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb67774d-f1a6-4e9b-812e-e0c9a2a3d284 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:38.706586 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135bbb77-9a4d-494c-9cde-faba8ee004fb admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:38.718734 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f573dd98-77ec-4b7e-b472-bb3d9776b130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:38.720242 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f573dd98-77ec-4b7e-b472-bb3d9776b130 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:38.721392 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f573dd98-77ec-4b7e-b472-bb3d9776b130 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:38.721392 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f573dd98-77ec-4b7e-b472-bb3d9776b130 admin admin] PATH_INFO: `/v3/users/7b4664a2586741099790f8ca93e8e6ad` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:38.724829 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f573dd98-77ec-4b7e-b472-bb3d9776b130 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b4664a2586741099790f8ca93e8e6ad)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:38.730013 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f573dd98-77ec-4b7e-b472-bb3d9776b130 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:38.757922 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-bb67774d-f1a6-4e9b-812e-e0c9a2a3d284 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f11e0c1d436d48619d6d9f650c567a16'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:38.790184 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-bb67774d-f1a6-4e9b-812e-e0c9a2a3d284 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f11e0c1d436d48619d6d9f650c567a16'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:38.793935 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-bb67774d-f1a6-4e9b-812e-e0c9a2a3d284 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f11e0c1d436d48619d6d9f650c567a16'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:38.807330 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-bb67774d-f1a6-4e9b-812e-e0c9a2a3d284 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f11e0c1d436d48619d6d9f650c567a16'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:38.809546 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-bb67774d-f1a6-4e9b-812e-e0c9a2a3d284 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f11e0c1d436d48619d6d9f650c567a16'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:38.830347 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1099/2215] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:31:38 2022] DELETE /identity/v3/users/f11e0c1d436d48619d6d9f650c567a16 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:31:38.836478 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a9a6d9-2ff6-4156-a235-5161b468619d None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:38.837014 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a9a6d9-2ff6-4156-a235-5161b468619d None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:38.837742 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a9a6d9-2ff6-4156-a235-5161b468619d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:38.855904 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-f573dd98-77ec-4b7e-b472-bb3d9776b130 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b4664a2586741099790f8ca93e8e6ad'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:38.865619 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-04a9a6d9-2ff6-4156-a235-5161b468619d None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:31:38.867876 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-04a9a6d9-2ff6-4156-a235-5161b468619d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:38.884359 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-f573dd98-77ec-4b7e-b472-bb3d9776b130 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b4664a2586741099790f8ca93e8e6ad'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:38.896300 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-f573dd98-77ec-4b7e-b472-bb3d9776b130 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b4664a2586741099790f8ca93e8e6ad'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:38.897158 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-f573dd98-77ec-4b7e-b472-bb3d9776b130 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b4664a2586741099790f8ca93e8e6ad'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:38.902470 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:38.912863 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-f573dd98-77ec-4b7e-b472-bb3d9776b130 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b4664a2586741099790f8ca93e8e6ad'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:38.940234 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1117/2216] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:31:38 2022] DELETE /identity/v3/users/7b4664a2586741099790f8ca93e8e6ad => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:31:38.986825 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f573dd98-77ec-4b7e-b472-bb3d9776b130 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:38.998936 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-f573dd98-77ec-4b7e-b472-bb3d9776b130 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:39.019700 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1100/2217] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:31:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:31:39.031943 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a9a6d9-2ff6-4156-a235-5161b468619d None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:39.034445 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-04a9a6d9-2ff6-4156-a235-5161b468619d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:39.054671 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:39.118278 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f573dd98-77ec-4b7e-b472-bb3d9776b130 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:39.129535 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492c5f3f-a3ee-43a3-811c-603e5f1d8e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:39.130682 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c5f3f-a3ee-43a3-811c-603e5f1d8e8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:39.131439 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c5f3f-a3ee-43a3-811c-603e5f1d8e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:39.131945 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c5f3f-a3ee-43a3-811c-603e5f1d8e8a admin admin] PATH_INFO: `/v3/projects/8446d3401d0d496d877b2a20cc9af2a3` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:39.134421 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492c5f3f-a3ee-43a3-811c-603e5f1d8e8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8446d3401d0d496d877b2a20cc9af2a3)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:39.139202 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492c5f3f-a3ee-43a3-811c-603e5f1d8e8a admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:39.147287 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a9a6d9-2ff6-4156-a235-5161b468619d None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:39.219639 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-492c5f3f-a3ee-43a3-811c-603e5f1d8e8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8446d3401d0d496d877b2a20cc9af2a3', 'request_id': 'req-492c5f3f-a3ee-43a3-811c-603e5f1d8e8a'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:39.237638 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fa1b82-b015-4b67-bc24-5e2ba93c8ec2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:39.238555 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa1b82-b015-4b67-bc24-5e2ba93c8ec2 service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:39.238841 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa1b82-b015-4b67-bc24-5e2ba93c8ec2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:39.239141 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-492c5f3f-a3ee-43a3-811c-603e5f1d8e8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8446d3401d0d496d877b2a20cc9af2a3', 'request_id': 'req-492c5f3f-a3ee-43a3-811c-603e5f1d8e8a'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:39.239305 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa1b82-b015-4b67-bc24-5e2ba93c8ec2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:39.254429 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-492c5f3f-a3ee-43a3-811c-603e5f1d8e8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8446d3401d0d496d877b2a20cc9af2a3', 'request_id': 'req-492c5f3f-a3ee-43a3-811c-603e5f1d8e8a'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:39.258703 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fa1b82-b015-4b67-bc24-5e2ba93c8ec2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:39.265653 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fa1b82-b015-4b67-bc24-5e2ba93c8ec2 service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:39.269184 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-492c5f3f-a3ee-43a3-811c-603e5f1d8e8a admin admin] The token cache is being invalidate because project 8446d3401d0d496d877b2a20cc9af2a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:31:39.269575 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-492c5f3f-a3ee-43a3-811c-603e5f1d8e8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:39.270352 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-492c5f3f-a3ee-43a3-811c-603e5f1d8e8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:39.276162 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1118/2218] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:31:38 2022] DELETE /identity/v3/projects/8446d3401d0d496d877b2a20cc9af2a3 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:31:39.280695 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492c5f3f-a3ee-43a3-811c-603e5f1d8e8a admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:39.284129 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-492c5f3f-a3ee-43a3-811c-603e5f1d8e8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:39.297693 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1101/2219] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:31:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:31:39.383006 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492c5f3f-a3ee-43a3-811c-603e5f1d8e8a admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:39.390274 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64d373f-aa55-44f2-b4a7-ca7b674c0765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:39.391075 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d373f-aa55-44f2-b4a7-ca7b674c0765 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:39.391262 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d373f-aa55-44f2-b4a7-ca7b674c0765 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:39.391523 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d373f-aa55-44f2-b4a7-ca7b674c0765 admin admin] PATH_INFO: `/v3/users/d76d39cb8f3a486c80d31694dd503d1e` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:39.393992 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64d373f-aa55-44f2-b4a7-ca7b674c0765 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d76d39cb8f3a486c80d31694dd503d1e)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:39.396114 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64d373f-aa55-44f2-b4a7-ca7b674c0765 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:39.452713 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:39.490555 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-d64d373f-aa55-44f2-b4a7-ca7b674c0765 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd76d39cb8f3a486c80d31694dd503d1e'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:39.511501 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-d64d373f-aa55-44f2-b4a7-ca7b674c0765 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd76d39cb8f3a486c80d31694dd503d1e'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:39.521291 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-d64d373f-aa55-44f2-b4a7-ca7b674c0765 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd76d39cb8f3a486c80d31694dd503d1e'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:39.521568 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-d64d373f-aa55-44f2-b4a7-ca7b674c0765 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd76d39cb8f3a486c80d31694dd503d1e'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:39.533847 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-d64d373f-aa55-44f2-b4a7-ca7b674c0765 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd76d39cb8f3a486c80d31694dd503d1e'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:39.536458 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fa1b82-b015-4b67-bc24-5e2ba93c8ec2 service neutron] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:39.538813 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-11fa1b82-b015-4b67-bc24-5e2ba93c8ec2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:39.546944 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1119/2220] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:31:39 2022] DELETE /identity/v3/users/d76d39cb8f3a486c80d31694dd503d1e => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:31:39.569423 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fa1b82-b015-4b67-bc24-5e2ba93c8ec2 service neutron] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:39.675488 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54936927-bfb3-4513-84df-7c0ec288b85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:39.676205 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54936927-bfb3-4513-84df-7c0ec288b85c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:39.676482 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54936927-bfb3-4513-84df-7c0ec288b85c admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:39.676753 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54936927-bfb3-4513-84df-7c0ec288b85c admin admin] PATH_INFO: `/v3/projects/4fcefc6056a742f991aede377568c605` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:39.678011 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54936927-bfb3-4513-84df-7c0ec288b85c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fcefc6056a742f991aede377568c605)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:39.680077 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54936927-bfb3-4513-84df-7c0ec288b85c admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:39.778997 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-54936927-bfb3-4513-84df-7c0ec288b85c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fcefc6056a742f991aede377568c605', 'request_id': 'req-54936927-bfb3-4513-84df-7c0ec288b85c'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:39.792654 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-54936927-bfb3-4513-84df-7c0ec288b85c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fcefc6056a742f991aede377568c605', 'request_id': 'req-54936927-bfb3-4513-84df-7c0ec288b85c'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:39.799153 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64d373f-aa55-44f2-b4a7-ca7b674c0765 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:39.803098 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-d64d373f-aa55-44f2-b4a7-ca7b674c0765 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:39.813886 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-54936927-bfb3-4513-84df-7c0ec288b85c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fcefc6056a742f991aede377568c605', 'request_id': 'req-54936927-bfb3-4513-84df-7c0ec288b85c'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:39.823918 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:39.828691 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64d373f-aa55-44f2-b4a7-ca7b674c0765 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:39.833923 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-54936927-bfb3-4513-84df-7c0ec288b85c admin admin] The token cache is being invalidate because project 4fcefc6056a742f991aede377568c605 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:31:39.834721 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-54936927-bfb3-4513-84df-7c0ec288b85c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:39.851131 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-54936927-bfb3-4513-84df-7c0ec288b85c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:39.854914 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1102/2221] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:31:39 2022] DELETE /identity/v3/projects/4fcefc6056a742f991aede377568c605 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:31:39.860256 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f810dd0f-73cb-464c-8a11-f029c22e9383 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:39.860989 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f810dd0f-73cb-464c-8a11-f029c22e9383 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:39.861325 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f810dd0f-73cb-464c-8a11-f029c22e9383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:39.890322 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-f810dd0f-73cb-464c-8a11-f029c22e9383 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:31:39.891797 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-f810dd0f-73cb-464c-8a11-f029c22e9383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:39.910207 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c193312e-2538-4384-9be2-813c98dbb609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:39.910901 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c193312e-2538-4384-9be2-813c98dbb609 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:39.911198 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c193312e-2538-4384-9be2-813c98dbb609 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:39.911479 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c193312e-2538-4384-9be2-813c98dbb609 admin admin] PATH_INFO: `/v3/projects/956c1d813a4c46ecaf583c93fe5a1e84` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:39.913030 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c193312e-2538-4384-9be2-813c98dbb609 admin admin] RBAC: Authorizing `identity:delete_project(project_id=956c1d813a4c46ecaf583c93fe5a1e84)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:39.915080 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c193312e-2538-4384-9be2-813c98dbb609 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:40.010187 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1103/2222] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:31:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:31:40.013019 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338967d8-772a-46a8-9a71-b7f96ee1726d None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:40.013316 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338967d8-772a-46a8-9a71-b7f96ee1726d None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:40.013668 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338967d8-772a-46a8-9a71-b7f96ee1726d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:40.015384 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-c193312e-2538-4384-9be2-813c98dbb609 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '956c1d813a4c46ecaf583c93fe5a1e84', 'request_id': 'req-c193312e-2538-4384-9be2-813c98dbb609'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:40.029680 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-c193312e-2538-4384-9be2-813c98dbb609 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '956c1d813a4c46ecaf583c93fe5a1e84', 'request_id': 'req-c193312e-2538-4384-9be2-813c98dbb609'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:40.047976 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-c193312e-2538-4384-9be2-813c98dbb609 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '956c1d813a4c46ecaf583c93fe5a1e84', 'request_id': 'req-c193312e-2538-4384-9be2-813c98dbb609'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:40.049275 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-338967d8-772a-46a8-9a71-b7f96ee1726d None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:31:40.052319 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-338967d8-772a-46a8-9a71-b7f96ee1726d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:40.072452 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-c193312e-2538-4384-9be2-813c98dbb609 admin admin] The token cache is being invalidate because project 956c1d813a4c46ecaf583c93fe5a1e84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:31:40.072914 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-c193312e-2538-4384-9be2-813c98dbb609 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:40.079974 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-c193312e-2538-4384-9be2-813c98dbb609 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:40.081663 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1120/2223] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:31:39 2022] DELETE /identity/v3/projects/956c1d813a4c46ecaf583c93fe5a1e84 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:31:40.082582 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c193312e-2538-4384-9be2-813c98dbb609 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:40.084876 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-c193312e-2538-4384-9be2-813c98dbb609 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:40.166112 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:40.193736 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1104/2224] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:31:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:31:40.195356 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338967d8-772a-46a8-9a71-b7f96ee1726d None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:40.196942 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-338967d8-772a-46a8-9a71-b7f96ee1726d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:40.214589 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c193312e-2538-4384-9be2-813c98dbb609 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:40.214995 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338967d8-772a-46a8-9a71-b7f96ee1726d None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:40.219926 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41413d2d-196c-46b4-b7da-258902ca8b55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e79503178ac54e62ba385467d5617ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:40.220512 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41413d2d-196c-46b4-b7da-258902ca8b55 service cinder] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:40.220798 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41413d2d-196c-46b4-b7da-258902ca8b55 service cinder] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:40.221078 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41413d2d-196c-46b4-b7da-258902ca8b55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:40.223339 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-41413d2d-196c-46b4-b7da-258902ca8b55 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:40.224939 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5269430f-d00a-4bee-b440-6c3fd35570fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:40.226071 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5269430f-d00a-4bee-b440-6c3fd35570fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:40.226569 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5269430f-d00a-4bee-b440-6c3fd35570fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:40.227235 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5269430f-d00a-4bee-b440-6c3fd35570fb admin admin] PATH_INFO: `/v3/projects/f03e90393e11401faf0a6f28bb3546c7` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:40.230113 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5269430f-d00a-4bee-b440-6c3fd35570fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f03e90393e11401faf0a6f28bb3546c7)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:40.234799 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5269430f-d00a-4bee-b440-6c3fd35570fb admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:40.313761 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41413d2d-196c-46b4-b7da-258902ca8b55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:40.315303 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41413d2d-196c-46b4-b7da-258902ca8b55 service cinder] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:40.327800 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1121/2225] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:31:40 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:31:40.330813 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0648fe7-cd80-4148-b5ad-87d964d85d7f None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:40.331139 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0648fe7-cd80-4148-b5ad-87d964d85d7f None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:40.331631 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0648fe7-cd80-4148-b5ad-87d964d85d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:40.348279 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-5269430f-d00a-4bee-b440-6c3fd35570fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f03e90393e11401faf0a6f28bb3546c7', 'request_id': 'req-5269430f-d00a-4bee-b440-6c3fd35570fb'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:40.365334 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-e0648fe7-cd80-4148-b5ad-87d964d85d7f None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:31:40.368160 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-e0648fe7-cd80-4148-b5ad-87d964d85d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:40.369823 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-5269430f-d00a-4bee-b440-6c3fd35570fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f03e90393e11401faf0a6f28bb3546c7', 'request_id': 'req-5269430f-d00a-4bee-b440-6c3fd35570fb'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:40.395089 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-5269430f-d00a-4bee-b440-6c3fd35570fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f03e90393e11401faf0a6f28bb3546c7', 'request_id': 'req-5269430f-d00a-4bee-b440-6c3fd35570fb'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:40.427174 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-5269430f-d00a-4bee-b440-6c3fd35570fb admin admin] The token cache is being invalidate because project f03e90393e11401faf0a6f28bb3546c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:31:40.427464 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-5269430f-d00a-4bee-b440-6c3fd35570fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:40.429109 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-5269430f-d00a-4bee-b440-6c3fd35570fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:40.432051 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1105/2226] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:31:40 2022] DELETE /identity/v3/projects/f03e90393e11401faf0a6f28bb3546c7 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:31:40.434898 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5269430f-d00a-4bee-b440-6c3fd35570fb admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:40.453064 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-5269430f-d00a-4bee-b440-6c3fd35570fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:40.502576 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1122/2227] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:31:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:31:40.502576 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4879241-97eb-4ed6-8cf5-fc9c5a350a19 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:40.502576 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4879241-97eb-4ed6-8cf5-fc9c5a350a19 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:40.502576 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4879241-97eb-4ed6-8cf5-fc9c5a350a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:40.503858 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:40.520658 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-d4879241-97eb-4ed6-8cf5-fc9c5a350a19 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:31:40.522504 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-d4879241-97eb-4ed6-8cf5-fc9c5a350a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:40.538364 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1123/2228] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:31:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:31:40.540983 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f518a2-3bca-4f28-a06c-65bb35c1d92b None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:40.541381 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f518a2-3bca-4f28-a06c-65bb35c1d92b None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:40.541757 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f518a2-3bca-4f28-a06c-65bb35c1d92b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:40.564711 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-19f518a2-3bca-4f28-a06c-65bb35c1d92b None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:31:40.566084 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-19f518a2-3bca-4f28-a06c-65bb35c1d92b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:40.575988 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1124/2229] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:31:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:31:40.576748 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5269430f-d00a-4bee-b440-6c3fd35570fb admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:40.577360 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d50b44-28ea-4bd8-a558-f28a357e6aac None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:40.577652 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d50b44-28ea-4bd8-a558-f28a357e6aac None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:40.577964 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d50b44-28ea-4bd8-a558-f28a357e6aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:40.586674 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a889811-0ba4-4410-81ec-22bf6cbfd2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:40.587847 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a889811-0ba4-4410-81ec-22bf6cbfd2b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:40.588358 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a889811-0ba4-4410-81ec-22bf6cbfd2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:40.589602 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a889811-0ba4-4410-81ec-22bf6cbfd2b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:40.591040 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a889811-0ba4-4410-81ec-22bf6cbfd2b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:31:40.591553 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a889811-0ba4-4410-81ec-22bf6cbfd2b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:40.595305 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a889811-0ba4-4410-81ec-22bf6cbfd2b8 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:40.600737 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-73d50b44-28ea-4bd8-a558-f28a357e6aac None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:31:40.601990 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-73d50b44-28ea-4bd8-a558-f28a357e6aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:40.613705 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1125/2230] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:31:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:31:40.614662 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d50b44-28ea-4bd8-a558-f28a357e6aac None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:40.617604 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1106/2231] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 12:31:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:31:40.620110 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a889811-0ba4-4410-81ec-22bf6cbfd2b8 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:40.634393 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a889811-0ba4-4410-81ec-22bf6cbfd2b8 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:40.635025 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d50b44-28ea-4bd8-a558-f28a357e6aac None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:40.643332 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c1af1d-bf6f-4922-8a6e-9c90193ab287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:40.644350 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c1af1d-bf6f-4922-8a6e-9c90193ab287 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:40.644790 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c1af1d-bf6f-4922-8a6e-9c90193ab287 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:40.645005 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284bdbda-5174-41b3-ba99-69d07a6e49e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:40.645230 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c1af1d-bf6f-4922-8a6e-9c90193ab287 admin admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:40.645962 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284bdbda-5174-41b3-ba99-69d07a6e49e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:40.646320 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c1af1d-bf6f-4922-8a6e-9c90193ab287 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:31:40.646415 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284bdbda-5174-41b3-ba99-69d07a6e49e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:40.646821 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c1af1d-bf6f-4922-8a6e-9c90193ab287 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:40.647123 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284bdbda-5174-41b3-ba99-69d07a6e49e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:40.648217 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284bdbda-5174-41b3-ba99-69d07a6e49e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:31:40.649306 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284bdbda-5174-41b3-ba99-69d07a6e49e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:40.649712 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c1af1d-bf6f-4922-8a6e-9c90193ab287 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:40.653643 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284bdbda-5174-41b3-ba99-69d07a6e49e5 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:40.667658 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1107/2232] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 12:31:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:31:40.672511 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c1af1d-bf6f-4922-8a6e-9c90193ab287 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:40.679564 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1126/2233] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 12:31:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:31:40.679564 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284bdbda-5174-41b3-ba99-69d07a6e49e5 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:40.683099 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c1af1d-bf6f-4922-8a6e-9c90193ab287 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:40.689416 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d21be05-d616-4584-bffd-0a3be5e81078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:40.690053 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d21be05-d616-4584-bffd-0a3be5e81078 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:40.690337 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d21be05-d616-4584-bffd-0a3be5e81078 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:40.690663 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d21be05-d616-4584-bffd-0a3be5e81078 admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:40.691348 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d21be05-d616-4584-bffd-0a3be5e81078 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:40.693584 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d21be05-d616-4584-bffd-0a3be5e81078 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:40.696052 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284bdbda-5174-41b3-ba99-69d07a6e49e5 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:40.705821 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb41900-7116-4bdc-8d33-6917ed499779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:40.706467 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb41900-7116-4bdc-8d33-6917ed499779 admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:40.706756 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb41900-7116-4bdc-8d33-6917ed499779 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:40.707153 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb41900-7116-4bdc-8d33-6917ed499779 admin admin] PATH_INFO: `/v3/projects` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:40.707815 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb41900-7116-4bdc-8d33-6917ed499779 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:40.709791 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb41900-7116-4bdc-8d33-6917ed499779 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:40.725647 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1108/2234] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:31:40 2022] POST /identity/v3/projects => generated 363 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:31:40.725647 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d21be05-d616-4584-bffd-0a3be5e81078 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:40.750965 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1127/2235] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:31:40 2022] POST /identity/v3/projects => generated 389 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:31:40.752318 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb41900-7116-4bdc-8d33-6917ed499779 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:40.799841 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:40.813666 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d21be05-d616-4584-bffd-0a3be5e81078 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:40.834047 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb41900-7116-4bdc-8d33-6917ed499779 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:40.839311 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0814c442-b338-4dd3-adf5-43e58b2fdeda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:40.840261 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0814c442-b338-4dd3-adf5-43e58b2fdeda admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:40.840261 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0814c442-b338-4dd3-adf5-43e58b2fdeda admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:40.840603 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0814c442-b338-4dd3-adf5-43e58b2fdeda admin admin] PATH_INFO: `/v3/users` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:40.840997 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0814c442-b338-4dd3-adf5-43e58b2fdeda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:40.842995 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0814c442-b338-4dd3-adf5-43e58b2fdeda admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:40.872791 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1128/2236] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:31:40 2022] POST /identity/v3/users => generated 282 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:31:40.872791 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0814c442-b338-4dd3-adf5-43e58b2fdeda admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:40.887892 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0814c442-b338-4dd3-adf5-43e58b2fdeda admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:40.899831 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca626b5-bfb1-40c6-aee0-03e94efafdfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:40.900113 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89df14d5-2c68-4814-99db-ad14a39b79b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:40.900492 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df14d5-2c68-4814-99db-ad14a39b79b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:40.900765 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df14d5-2c68-4814-99db-ad14a39b79b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:40.901039 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df14d5-2c68-4814-99db-ad14a39b79b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:40.901475 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca626b5-bfb1-40c6-aee0-03e94efafdfb admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:40.901738 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca626b5-bfb1-40c6-aee0-03e94efafdfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:40.901928 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89df14d5-2c68-4814-99db-ad14a39b79b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:40.902198 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca626b5-bfb1-40c6-aee0-03e94efafdfb admin admin] PATH_INFO: `/v3/users` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:40.902926 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca626b5-bfb1-40c6-aee0-03e94efafdfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:40.903858 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89df14d5-2c68-4814-99db-ad14a39b79b7 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:40.904975 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca626b5-bfb1-40c6-aee0-03e94efafdfb admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:40.932199 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1129/2237] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:31:40 2022] POST /identity/v3/users => generated 295 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:31:40.933900 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca626b5-bfb1-40c6-aee0-03e94efafdfb admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:40.939823 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1109/2238] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:31:40 2022] POST /identity/v3/projects => generated 369 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:31:40.943191 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89df14d5-2c68-4814-99db-ad14a39b79b7 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:40.945708 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca626b5-bfb1-40c6-aee0-03e94efafdfb admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:40.957407 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:41.014488 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a52b49-e025-474a-af14-a9f0f413879e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:41.015154 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a52b49-e025-474a-af14-a9f0f413879e admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:41.015439 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a52b49-e025-474a-af14-a9f0f413879e admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:41.015714 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a52b49-e025-474a-af14-a9f0f413879e admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:41.016376 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a52b49-e025-474a-af14-a9f0f413879e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:41.018037 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a52b49-e025-474a-af14-a9f0f413879e admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:41.030509 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1130/2239] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:31:40 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:31:41.031648 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a52b49-e025-474a-af14-a9f0f413879e admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:41.044935 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89df14d5-2c68-4814-99db-ad14a39b79b7 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:41.045959 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a52b49-e025-474a-af14-a9f0f413879e admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:41.051749 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f526e0-92ea-4353-8c7b-fb28300c7352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:41.052386 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f526e0-92ea-4353-8c7b-fb28300c7352 admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:41.052663 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f526e0-92ea-4353-8c7b-fb28300c7352 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:41.052938 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f526e0-92ea-4353-8c7b-fb28300c7352 admin admin] PATH_INFO: `/v3/users` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:41.053591 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f526e0-92ea-4353-8c7b-fb28300c7352 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:41.055601 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f526e0-92ea-4353-8c7b-fb28300c7352 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:41.055743 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671e19a4-5916-4b81-ae75-1d4aedce1479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:41.056393 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671e19a4-5916-4b81-ae75-1d4aedce1479 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:41.056675 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671e19a4-5916-4b81-ae75-1d4aedce1479 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:41.056947 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671e19a4-5916-4b81-ae75-1d4aedce1479 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:41.057720 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671e19a4-5916-4b81-ae75-1d4aedce1479 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:41.059677 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671e19a4-5916-4b81-ae75-1d4aedce1479 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:41.076142 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1110/2240] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:31:40 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:31:41.077190 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671e19a4-5916-4b81-ae75-1d4aedce1479 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:41.091528 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1131/2241] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:31:41 2022] POST /identity/v3/users => generated 285 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:31:41.093077 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f526e0-92ea-4353-8c7b-fb28300c7352 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:41.100256 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671e19a4-5916-4b81-ae75-1d4aedce1479 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:41.110634 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a982a6-cba5-4096-88ea-3b20a31ebb7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:41.111742 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a982a6-cba5-4096-88ea-3b20a31ebb7b admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:41.112216 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a982a6-cba5-4096-88ea-3b20a31ebb7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:41.112678 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a982a6-cba5-4096-88ea-3b20a31ebb7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:41.113778 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a982a6-cba5-4096-88ea-3b20a31ebb7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:41.114421 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f526e0-92ea-4353-8c7b-fb28300c7352 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:41.116801 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a982a6-cba5-4096-88ea-3b20a31ebb7b admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:41.123889 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3ec957-aa89-4c1d-8b47-f2505d88de3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:41.125458 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3ec957-aa89-4c1d-8b47-f2505d88de3c admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:41.126181 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3ec957-aa89-4c1d-8b47-f2505d88de3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:41.127048 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3ec957-aa89-4c1d-8b47-f2505d88de3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:41.128729 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3ec957-aa89-4c1d-8b47-f2505d88de3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:41.132028 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3ec957-aa89-4c1d-8b47-f2505d88de3c admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:41.138065 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1111/2242] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:31:41 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:31:41.139259 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a982a6-cba5-4096-88ea-3b20a31ebb7b admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:41.152566 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a982a6-cba5-4096-88ea-3b20a31ebb7b admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:41.156135 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1132/2243] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:31:41 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:31:41.157871 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3ec957-aa89-4c1d-8b47-f2505d88de3c admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:41.162808 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6001d697-d1d8-423e-b56a-2939562c3d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:41.163550 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6001d697-d1d8-423e-b56a-2939562c3d23 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:41.164086 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6001d697-d1d8-423e-b56a-2939562c3d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:41.164086 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6001d697-d1d8-423e-b56a-2939562c3d23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:41.164758 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6001d697-d1d8-423e-b56a-2939562c3d23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:41.167504 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6001d697-d1d8-423e-b56a-2939562c3d23 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:41.187529 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1112/2244] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:31:41 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:31:41.188505 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6001d697-d1d8-423e-b56a-2939562c3d23 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:41.190336 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3ec957-aa89-4c1d-8b47-f2505d88de3c admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:41.199914 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6001d697-d1d8-423e-b56a-2939562c3d23 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:41.202965 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d87c63-087f-4a70-86a1-4a404fb2b587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:41.204141 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d87c63-087f-4a70-86a1-4a404fb2b587 admin admin] REQUEST_METHOD: `PUT` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:41.204761 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d87c63-087f-4a70-86a1-4a404fb2b587 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:41.205224 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d87c63-087f-4a70-86a1-4a404fb2b587 admin admin] PATH_INFO: `/v3/projects/7f366c9e1e924cea890b6f119617846c/users/fb017748ffe14af08084b0ef4b2aa3d0/roles/b5cfd7a855a448359e9017f51d32b6fc` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:41.211571 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ec2a72-1b53-4527-8eb9-c7d5b60faaaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:41.213104 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec2a72-1b53-4527-8eb9-c7d5b60faaaa admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:41.213962 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec2a72-1b53-4527-8eb9-c7d5b60faaaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:41.214669 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec2a72-1b53-4527-8eb9-c7d5b60faaaa admin admin] PATH_INFO: `/v3/projects/119c8446c5b245099c44df2cf6e0820e/users/b2c883e8a3dc4d71a2bc05a0a9af0fda/roles/b5cfd7a855a448359e9017f51d32b6fc` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:41.234095 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d87c63-087f-4a70-86a1-4a404fb2b587 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f366c9e1e924cea890b6f119617846c, user_id=fb017748ffe14af08084b0ef4b2aa3d0, role_id=b5cfd7a855a448359e9017f51d32b6fc)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:41.238695 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d87c63-087f-4a70-86a1-4a404fb2b587 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:41.252650 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ec2a72-1b53-4527-8eb9-c7d5b60faaaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=119c8446c5b245099c44df2cf6e0820e, user_id=b2c883e8a3dc4d71a2bc05a0a9af0fda, role_id=b5cfd7a855a448359e9017f51d32b6fc)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:41.257707 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ec2a72-1b53-4527-8eb9-c7d5b60faaaa admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:41.274377 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1133/2245] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:31:41 2022] PUT /identity/v3/projects/7f366c9e1e924cea890b6f119617846c/users/fb017748ffe14af08084b0ef4b2aa3d0/roles/b5cfd7a855a448359e9017f51d32b6fc => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:31:41.282335 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d87c63-087f-4a70-86a1-4a404fb2b587 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:41.290409 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1113/2246] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:31:41 2022] PUT /identity/v3/projects/119c8446c5b245099c44df2cf6e0820e/users/b2c883e8a3dc4d71a2bc05a0a9af0fda/roles/b5cfd7a855a448359e9017f51d32b6fc => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:31:41.293619 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ab92b-a6bb-4d19-ba48-f71fc264bf2e None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:41.294095 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ab92b-a6bb-4d19-ba48-f71fc264bf2e None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:41.294566 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ab92b-a6bb-4d19-ba48-f71fc264bf2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:41.380677 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-f14ab92b-a6bb-4d19-ba48-f71fc264bf2e None None] MFA Rules not processed for user `fb017748ffe14af08084b0ef4b2aa3d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:31:41.382135 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-f14ab92b-a6bb-4d19-ba48-f71fc264bf2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:41.396482 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:41.446782 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d87c63-087f-4a70-86a1-4a404fb2b587 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:41.544491 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5051ee-70c7-43f8-a40b-24b9f473cf20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:41.545559 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5051ee-70c7-43f8-a40b-24b9f473cf20 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:41.545559 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5051ee-70c7-43f8-a40b-24b9f473cf20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:41.545811 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5051ee-70c7-43f8-a40b-24b9f473cf20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:41.546536 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5051ee-70c7-43f8-a40b-24b9f473cf20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:41.548329 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5051ee-70c7-43f8-a40b-24b9f473cf20 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:41.562661 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1134/2247] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:31:41 2022] GET /identity/v3/roles => generated 1420 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:31:41.564830 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c10d469-561a-4ad3-9513-147ee3325037 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:41.565175 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c10d469-561a-4ad3-9513-147ee3325037 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:41.565436 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c10d469-561a-4ad3-9513-147ee3325037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:41.608246 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-7c10d469-561a-4ad3-9513-147ee3325037 None None] MFA Rules not processed for user `b2c883e8a3dc4d71a2bc05a0a9af0fda`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:31:41.609327 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-7c10d469-561a-4ad3-9513-147ee3325037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:41.694133 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1114/2248] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:31:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 403 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:31:41.695259 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14ab92b-a6bb-4d19-ba48-f71fc264bf2e None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:41.741158 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14ab92b-a6bb-4d19-ba48-f71fc264bf2e None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:41.765654 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5630e5f4-822d-41b7-a88f-c36f53b3e84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:41.767569 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5630e5f4-822d-41b7-a88f-c36f53b3e84c admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:41.769275 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5630e5f4-822d-41b7-a88f-c36f53b3e84c admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:41.770033 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5630e5f4-822d-41b7-a88f-c36f53b3e84c admin admin] PATH_INFO: `/v3/projects/dae95cbb53494fc9862da2be3053b179/users/593a439e318c42a98246c80883ed190d/roles/b5cfd7a855a448359e9017f51d32b6fc` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:41.818157 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5630e5f4-822d-41b7-a88f-c36f53b3e84c admin admin] RBAC: Authorizing `identity:create_grant(project_id=dae95cbb53494fc9862da2be3053b179, user_id=593a439e318c42a98246c80883ed190d, role_id=b5cfd7a855a448359e9017f51d32b6fc)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:41.819159 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1135/2249] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:31:41 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:31:41.820989 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5630e5f4-822d-41b7-a88f-c36f53b3e84c admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:41.827315 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c10d469-561a-4ad3-9513-147ee3325037 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:41.840512 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c10d469-561a-4ad3-9513-147ee3325037 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:41.874967 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1115/2250] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:31:41 2022] PUT /identity/v3/projects/dae95cbb53494fc9862da2be3053b179/users/593a439e318c42a98246c80883ed190d/roles/b5cfd7a855a448359e9017f51d32b6fc => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:31:41.874967 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5630e5f4-822d-41b7-a88f-c36f53b3e84c admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:41.886536 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-5630e5f4-822d-41b7-a88f-c36f53b3e84c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:41.916046 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb8d5b-4fac-48b3-b03f-0c99243470cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:41.916730 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb8d5b-4fac-48b3-b03f-0c99243470cd admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:41.918507 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb8d5b-4fac-48b3-b03f-0c99243470cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:41.918507 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb8d5b-4fac-48b3-b03f-0c99243470cd admin admin] PATH_INFO: `/v3/projects` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:41.919437 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdb8d5b-4fac-48b3-b03f-0c99243470cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:41.921381 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdb8d5b-4fac-48b3-b03f-0c99243470cd admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:41.938555 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:41.960430 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1136/2251] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:31:41 2022] POST /identity/v3/projects => generated 389 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:31:41.962211 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4133df0a-e4ab-42d9-b6eb-a779bcfb0dd1 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:41.962498 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4133df0a-e4ab-42d9-b6eb-a779bcfb0dd1 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:41.962826 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4133df0a-e4ab-42d9-b6eb-a779bcfb0dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:41.973357 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:41.994606 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5630e5f4-822d-41b7-a88f-c36f53b3e84c admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:42.000935 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-4133df0a-e4ab-42d9-b6eb-a779bcfb0dd1 None None] MFA Rules not processed for user `593a439e318c42a98246c80883ed190d`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:31:42.002343 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-4133df0a-e4ab-42d9-b6eb-a779bcfb0dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:42.091020 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b597587c-5053-437f-9607-c449d215073a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e79503178ac54e62ba385467d5617ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:42.092253 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b597587c-5053-437f-9607-c449d215073a service cinder] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:42.093077 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b597587c-5053-437f-9607-c449d215073a service cinder] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:42.093789 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b597587c-5053-437f-9607-c449d215073a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:42.109902 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1137/2252] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:31:41 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:31:42.111858 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4133df0a-e4ab-42d9-b6eb-a779bcfb0dd1 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:42.237540 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b597587c-5053-437f-9607-c449d215073a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:42.241526 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b597587c-5053-437f-9607-c449d215073a service cinder] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:42.256675 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4133df0a-e4ab-42d9-b6eb-a779bcfb0dd1 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:42.263706 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1116/2253] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:31:41 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:31:42.268724 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b597587c-5053-437f-9607-c449d215073a service cinder] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:42.270111 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40dd550-924b-45b0-9d1f-4d17c0dadb6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:42.271222 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40dd550-924b-45b0-9d1f-4d17c0dadb6f admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:42.271766 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40dd550-924b-45b0-9d1f-4d17c0dadb6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:42.272457 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-b597587c-5053-437f-9607-c449d215073a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:42.272965 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40dd550-924b-45b0-9d1f-4d17c0dadb6f admin admin] PATH_INFO: `/v3/users` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:42.274332 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40dd550-924b-45b0-9d1f-4d17c0dadb6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:42.279782 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40dd550-924b-45b0-9d1f-4d17c0dadb6f admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:42.326528 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1138/2254] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:31:42 2022] POST /identity/v3/users => generated 301 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:31:42.328310 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40dd550-924b-45b0-9d1f-4d17c0dadb6f admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:42.349958 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40dd550-924b-45b0-9d1f-4d17c0dadb6f admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:42.376970 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bcaede-5f9c-40b9-a9ce-f7e35ee7dc84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:42.376970 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bcaede-5f9c-40b9-a9ce-f7e35ee7dc84 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:42.376970 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bcaede-5f9c-40b9-a9ce-f7e35ee7dc84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:42.377968 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bcaede-5f9c-40b9-a9ce-f7e35ee7dc84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:42.380842 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bcaede-5f9c-40b9-a9ce-f7e35ee7dc84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:42.383486 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bcaede-5f9c-40b9-a9ce-f7e35ee7dc84 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:42.419114 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1139/2255] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:31:42 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:31:42.419114 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bcaede-5f9c-40b9-a9ce-f7e35ee7dc84 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:42.448962 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bcaede-5f9c-40b9-a9ce-f7e35ee7dc84 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:42.466681 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32a6afb-2981-4fbb-a6b5-e7d828e62ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:42.467843 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b597587c-5053-437f-9607-c449d215073a service cinder] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:42.468065 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a6afb-2981-4fbb-a6b5-e7d828e62ea3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:42.468591 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a6afb-2981-4fbb-a6b5-e7d828e62ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:42.469113 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a6afb-2981-4fbb-a6b5-e7d828e62ea3 admin admin] PATH_INFO: `/v3/projects/9f6c51a869dc4cc085b87abad3d06da7/users/4e56d033f681491d8c8dd35fe6b3ac8b/roles/a332ef951db949b0bad7019fbd28a1b9` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:42.474771 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ce73a0-2d77-4a46-9bbb-77fa96bffb6a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8b3bb8f689b45b99ed43f672264a26d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:42.475894 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce73a0-2d77-4a46-9bbb-77fa96bffb6a service glance] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:42.476401 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce73a0-2d77-4a46-9bbb-77fa96bffb6a service glance] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:42.476870 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce73a0-2d77-4a46-9bbb-77fa96bffb6a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:42.506074 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32a6afb-2981-4fbb-a6b5-e7d828e62ea3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f6c51a869dc4cc085b87abad3d06da7, user_id=4e56d033f681491d8c8dd35fe6b3ac8b, role_id=a332ef951db949b0bad7019fbd28a1b9)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:42.512280 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32a6afb-2981-4fbb-a6b5-e7d828e62ea3 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:42.524256 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ce73a0-2d77-4a46-9bbb-77fa96bffb6a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:42.528544 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ce73a0-2d77-4a46-9bbb-77fa96bffb6a service glance] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:42.545584 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1140/2256] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:31:42 2022] PUT /identity/v3/projects/9f6c51a869dc4cc085b87abad3d06da7/users/4e56d033f681491d8c8dd35fe6b3ac8b/roles/a332ef951db949b0bad7019fbd28a1b9 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:31:42.547478 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32a6afb-2981-4fbb-a6b5-e7d828e62ea3 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:42.554335 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1117/2257] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:31:42 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:31:42.661387 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:42.710020 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32a6afb-2981-4fbb-a6b5-e7d828e62ea3 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:42.719688 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fe7a96-e19c-4726-9187-12dc17065314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:42.720829 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fe7a96-e19c-4726-9187-12dc17065314 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:42.721392 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fe7a96-e19c-4726-9187-12dc17065314 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:42.721884 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fe7a96-e19c-4726-9187-12dc17065314 admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:42.723194 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fe7a96-e19c-4726-9187-12dc17065314 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:42.726320 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fe7a96-e19c-4726-9187-12dc17065314 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:42.744122 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1141/2258] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:31:42 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:31:42.749415 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ce73a0-2d77-4a46-9bbb-77fa96bffb6a service glance] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:42.763625 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ce73a0-2d77-4a46-9bbb-77fa96bffb6a service glance] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:42.768375 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08534ad7-21af-47ce-9028-f5ed5a52b831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:42.769091 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08534ad7-21af-47ce-9028-f5ed5a52b831 admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:42.769376 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08534ad7-21af-47ce-9028-f5ed5a52b831 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:42.769657 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08534ad7-21af-47ce-9028-f5ed5a52b831 admin admin] PATH_INFO: `/v3/projects/9f6c51a869dc4cc085b87abad3d06da7/users/4e56d033f681491d8c8dd35fe6b3ac8b/roles/a332ef951db949b0bad7019fbd28a1b9` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:42.773101 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08534ad7-21af-47ce-9028-f5ed5a52b831 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f6c51a869dc4cc085b87abad3d06da7, user_id=4e56d033f681491d8c8dd35fe6b3ac8b, role_id=a332ef951db949b0bad7019fbd28a1b9)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:42.784536 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08534ad7-21af-47ce-9028-f5ed5a52b831 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:42.812789 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1118/2259] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:31:42 2022] PUT /identity/v3/projects/9f6c51a869dc4cc085b87abad3d06da7/users/4e56d033f681491d8c8dd35fe6b3ac8b/roles/a332ef951db949b0bad7019fbd28a1b9 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:31:42.820580 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab24395-98d5-4a96-bc26-c90db3853bb5 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:42.821111 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab24395-98d5-4a96-bc26-c90db3853bb5 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:42.821708 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab24395-98d5-4a96-bc26-c90db3853bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:42.897996 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-cab24395-98d5-4a96-bc26-c90db3853bb5 None None] MFA Rules not processed for user `4e56d033f681491d8c8dd35fe6b3ac8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:31:42.899389 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-cab24395-98d5-4a96-bc26-c90db3853bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:43.073043 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1142/2260] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:31:42 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:31:43.100274 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08534ad7-21af-47ce-9028-f5ed5a52b831 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:43.149572 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:43.189246 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08534ad7-21af-47ce-9028-f5ed5a52b831 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:43.193379 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbabc00d-2498-4a8e-84b1-169bd1f9eb3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e79503178ac54e62ba385467d5617ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:43.194266 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbabc00d-2498-4a8e-84b1-169bd1f9eb3d service cinder] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:43.194648 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbabc00d-2498-4a8e-84b1-169bd1f9eb3d service cinder] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:43.195070 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbabc00d-2498-4a8e-84b1-169bd1f9eb3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:43.209675 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbabc00d-2498-4a8e-84b1-169bd1f9eb3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:43.211713 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbabc00d-2498-4a8e-84b1-169bd1f9eb3d service cinder] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:43.225746 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1119/2261] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:31:43 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:31:43.516895 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab24395-98d5-4a96-bc26-c90db3853bb5 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:43.670174 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab24395-98d5-4a96-bc26-c90db3853bb5 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:43.678426 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e37c87-1118-4b18-8047-2ffd7fc58a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:43.680013 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e37c87-1118-4b18-8047-2ffd7fc58a85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:43.680469 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e37c87-1118-4b18-8047-2ffd7fc58a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:43.681010 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e37c87-1118-4b18-8047-2ffd7fc58a85 admin admin] PATH_INFO: `/v3/users/b2c883e8a3dc4d71a2bc05a0a9af0fda` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:43.684164 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e37c87-1118-4b18-8047-2ffd7fc58a85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2c883e8a3dc4d71a2bc05a0a9af0fda)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:43.688914 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e37c87-1118-4b18-8047-2ffd7fc58a85 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:43.819339 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-a6e37c87-1118-4b18-8047-2ffd7fc58a85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2c883e8a3dc4d71a2bc05a0a9af0fda'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:43.851058 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-a6e37c87-1118-4b18-8047-2ffd7fc58a85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2c883e8a3dc4d71a2bc05a0a9af0fda'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:43.864904 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:43.871226 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-a6e37c87-1118-4b18-8047-2ffd7fc58a85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2c883e8a3dc4d71a2bc05a0a9af0fda'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:43.872572 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-a6e37c87-1118-4b18-8047-2ffd7fc58a85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2c883e8a3dc4d71a2bc05a0a9af0fda'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:43.899874 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-a6e37c87-1118-4b18-8047-2ffd7fc58a85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2c883e8a3dc4d71a2bc05a0a9af0fda'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:43.920073 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1143/2262] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:31:43 2022] DELETE /identity/v3/users/b2c883e8a3dc4d71a2bc05a0a9af0fda => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:31:43.930334 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81409933-345d-403a-9784-97225313f644 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:43.931284 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81409933-345d-403a-9784-97225313f644 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:43.931792 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81409933-345d-403a-9784-97225313f644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:43.957498 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-81409933-345d-403a-9784-97225313f644 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:31:43.959035 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-81409933-345d-403a-9784-97225313f644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:44.088189 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1120/2263] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:31:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:31:44.108717 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e37c87-1118-4b18-8047-2ffd7fc58a85 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:44.111379 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-a6e37c87-1118-4b18-8047-2ffd7fc58a85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:44.255368 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e37c87-1118-4b18-8047-2ffd7fc58a85 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:44.262515 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f66d290-daa4-476a-8b70-bdddf8f120b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:44.263781 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f66d290-daa4-476a-8b70-bdddf8f120b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:44.264679 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f66d290-daa4-476a-8b70-bdddf8f120b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:44.265491 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f66d290-daa4-476a-8b70-bdddf8f120b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:44.299960 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f66d290-daa4-476a-8b70-bdddf8f120b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:44.302827 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f66d290-daa4-476a-8b70-bdddf8f120b8 service neutron] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:44.326938 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1144/2264] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:31:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:31:44.971774 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81409933-345d-403a-9784-97225313f644 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:44.974796 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-81409933-345d-403a-9784-97225313f644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:44.995759 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81409933-345d-403a-9784-97225313f644 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:45.004350 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d397ad67-a29c-46ab-910c-58ece42c2203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:45.006038 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d397ad67-a29c-46ab-910c-58ece42c2203 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:45.006973 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d397ad67-a29c-46ab-910c-58ece42c2203 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:45.007636 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d397ad67-a29c-46ab-910c-58ece42c2203 admin admin] PATH_INFO: `/v3/projects/119c8446c5b245099c44df2cf6e0820e` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:45.010048 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d397ad67-a29c-46ab-910c-58ece42c2203 admin admin] RBAC: Authorizing `identity:delete_project(project_id=119c8446c5b245099c44df2cf6e0820e)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:45.014508 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d397ad67-a29c-46ab-910c-58ece42c2203 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:45.113677 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-d397ad67-a29c-46ab-910c-58ece42c2203 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '119c8446c5b245099c44df2cf6e0820e', 'request_id': 'req-d397ad67-a29c-46ab-910c-58ece42c2203'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:45.133998 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-d397ad67-a29c-46ab-910c-58ece42c2203 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '119c8446c5b245099c44df2cf6e0820e', 'request_id': 'req-d397ad67-a29c-46ab-910c-58ece42c2203'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:45.152229 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-d397ad67-a29c-46ab-910c-58ece42c2203 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '119c8446c5b245099c44df2cf6e0820e', 'request_id': 'req-d397ad67-a29c-46ab-910c-58ece42c2203'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:45.186818 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-d397ad67-a29c-46ab-910c-58ece42c2203 admin admin] The token cache is being invalidate because project 119c8446c5b245099c44df2cf6e0820e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:31:45.187572 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-d397ad67-a29c-46ab-910c-58ece42c2203 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:45.188753 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-d397ad67-a29c-46ab-910c-58ece42c2203 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:45.191758 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1121/2265] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:31:44 2022] DELETE /identity/v3/projects/119c8446c5b245099c44df2cf6e0820e => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:31:45.197021 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f66d290-daa4-476a-8b70-bdddf8f120b8 service neutron] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:45.223667 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f66d290-daa4-476a-8b70-bdddf8f120b8 service neutron] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:45.335548 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e194e30e-b9df-4490-8fd8-844e3e5d1119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:45.336756 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e194e30e-b9df-4490-8fd8-844e3e5d1119 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:45.337265 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e194e30e-b9df-4490-8fd8-844e3e5d1119 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:45.338104 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e194e30e-b9df-4490-8fd8-844e3e5d1119 admin admin] PATH_INFO: `/v3/users/4e56d033f681491d8c8dd35fe6b3ac8b` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:45.340840 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e194e30e-b9df-4490-8fd8-844e3e5d1119 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e56d033f681491d8c8dd35fe6b3ac8b)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:45.342828 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e194e30e-b9df-4490-8fd8-844e3e5d1119 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:45.443976 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-e194e30e-b9df-4490-8fd8-844e3e5d1119 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e56d033f681491d8c8dd35fe6b3ac8b'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:45.490841 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-e194e30e-b9df-4490-8fd8-844e3e5d1119 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e56d033f681491d8c8dd35fe6b3ac8b'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:45.504682 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d397ad67-a29c-46ab-910c-58ece42c2203 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:45.505421 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-e194e30e-b9df-4490-8fd8-844e3e5d1119 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e56d033f681491d8c8dd35fe6b3ac8b'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:45.506620 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-e194e30e-b9df-4490-8fd8-844e3e5d1119 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e56d033f681491d8c8dd35fe6b3ac8b'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:45.508168 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-d397ad67-a29c-46ab-910c-58ece42c2203 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:45.529502 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-e194e30e-b9df-4490-8fd8-844e3e5d1119 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e56d033f681491d8c8dd35fe6b3ac8b'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:45.536886 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1145/2266] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:31:45 2022] DELETE /identity/v3/users/4e56d033f681491d8c8dd35fe6b3ac8b => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:31:45.564422 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d397ad67-a29c-46ab-910c-58ece42c2203 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:45.676467 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:45.687160 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b864c7be-b90b-4625-9113-b54a301a5da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:45.689240 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b864c7be-b90b-4625-9113-b54a301a5da7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:45.690248 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b864c7be-b90b-4625-9113-b54a301a5da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:45.690248 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b864c7be-b90b-4625-9113-b54a301a5da7 admin admin] PATH_INFO: `/v3/users/a75359a06c734021bba849a0c85fe64e` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:45.691743 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b864c7be-b90b-4625-9113-b54a301a5da7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a75359a06c734021bba849a0c85fe64e)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:45.695798 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b864c7be-b90b-4625-9113-b54a301a5da7 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:45.790571 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-b864c7be-b90b-4625-9113-b54a301a5da7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a75359a06c734021bba849a0c85fe64e'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:45.810718 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-b864c7be-b90b-4625-9113-b54a301a5da7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a75359a06c734021bba849a0c85fe64e'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:45.812585 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-b864c7be-b90b-4625-9113-b54a301a5da7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a75359a06c734021bba849a0c85fe64e'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:45.824738 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-b864c7be-b90b-4625-9113-b54a301a5da7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a75359a06c734021bba849a0c85fe64e'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:45.825726 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-b864c7be-b90b-4625-9113-b54a301a5da7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a75359a06c734021bba849a0c85fe64e'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:45.845073 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1122/2267] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:31:45 2022] DELETE /identity/v3/users/a75359a06c734021bba849a0c85fe64e => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:31:45.850335 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c1e9a2-9452-4feb-aa84-d378a24a68e6 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:45.850805 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c1e9a2-9452-4feb-aa84-d378a24a68e6 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:45.851258 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c1e9a2-9452-4feb-aa84-d378a24a68e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:45.879743 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-70c1e9a2-9452-4feb-aa84-d378a24a68e6 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:31:45.881436 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-70c1e9a2-9452-4feb-aa84-d378a24a68e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:45.888577 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:45.928931 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b864c7be-b90b-4625-9113-b54a301a5da7 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:45.930473 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-b864c7be-b90b-4625-9113-b54a301a5da7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:45.984114 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1146/2268] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:31:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:31:45.995602 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c1e9a2-9452-4feb-aa84-d378a24a68e6 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:45.996967 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-70c1e9a2-9452-4feb-aa84-d378a24a68e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:46.012417 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b864c7be-b90b-4625-9113-b54a301a5da7 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:46.018074 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04553db3-5605-4353-882c-a54264e6448c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:46.018754 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04553db3-5605-4353-882c-a54264e6448c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:46.019679 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04553db3-5605-4353-882c-a54264e6448c admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:46.020027 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04553db3-5605-4353-882c-a54264e6448c admin admin] PATH_INFO: `/v3/projects/9f6c51a869dc4cc085b87abad3d06da7` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:46.021724 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04553db3-5605-4353-882c-a54264e6448c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f6c51a869dc4cc085b87abad3d06da7)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:46.025015 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04553db3-5605-4353-882c-a54264e6448c admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:46.065291 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c1e9a2-9452-4feb-aa84-d378a24a68e6 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:46.080053 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-04553db3-5605-4353-882c-a54264e6448c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f6c51a869dc4cc085b87abad3d06da7', 'request_id': 'req-04553db3-5605-4353-882c-a54264e6448c'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:46.092393 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-04553db3-5605-4353-882c-a54264e6448c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f6c51a869dc4cc085b87abad3d06da7', 'request_id': 'req-04553db3-5605-4353-882c-a54264e6448c'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:46.102236 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-04553db3-5605-4353-882c-a54264e6448c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f6c51a869dc4cc085b87abad3d06da7', 'request_id': 'req-04553db3-5605-4353-882c-a54264e6448c'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:46.117801 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-04553db3-5605-4353-882c-a54264e6448c admin admin] The token cache is being invalidate because project 9f6c51a869dc4cc085b87abad3d06da7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:31:46.118520 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-04553db3-5605-4353-882c-a54264e6448c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:46.118885 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-04553db3-5605-4353-882c-a54264e6448c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:46.120500 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1123/2269] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:31:45 2022] DELETE /identity/v3/projects/9f6c51a869dc4cc085b87abad3d06da7 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:31:46.125522 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1404b7-a9c6-4c9e-ba8b-f1bb4d88ccba None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:46.125799 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1404b7-a9c6-4c9e-ba8b-f1bb4d88ccba None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:46.126093 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1404b7-a9c6-4c9e-ba8b-f1bb4d88ccba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:46.134504 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d2234d-549a-4f97-917c-95ff485e74b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:46.135473 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d2234d-549a-4f97-917c-95ff485e74b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:46.135704 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:46.135904 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d2234d-549a-4f97-917c-95ff485e74b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:46.136157 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d2234d-549a-4f97-917c-95ff485e74b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:46.139006 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-99d2234d-549a-4f97-917c-95ff485e74b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:46.148877 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-5a1404b7-a9c6-4c9e-ba8b-f1bb4d88ccba None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:31:46.150238 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-5a1404b7-a9c6-4c9e-ba8b-f1bb4d88ccba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:46.230046 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1124/2270] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:31:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:31:46.232079 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d2234d-549a-4f97-917c-95ff485e74b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:46.233487 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d2234d-549a-4f97-917c-95ff485e74b0 service neutron] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:46.241216 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471afa7-ed3d-48fe-a12a-fbf8717412b0 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:46.241684 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471afa7-ed3d-48fe-a12a-fbf8717412b0 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:46.242143 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471afa7-ed3d-48fe-a12a-fbf8717412b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:46.246282 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1147/2271] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:31:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:31:46.274147 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-8471afa7-ed3d-48fe-a12a-fbf8717412b0 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:31:46.275473 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-8471afa7-ed3d-48fe-a12a-fbf8717412b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:46.291478 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1125/2272] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:31:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:31:46.294510 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d2234d-549a-4f97-917c-95ff485e74b0 service neutron] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:46.315252 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d2234d-549a-4f97-917c-95ff485e74b0 service neutron] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:46.324628 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d130bb35-7edd-48e2-9072-4dd083bab9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:46.325722 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d130bb35-7edd-48e2-9072-4dd083bab9b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:46.326166 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d130bb35-7edd-48e2-9072-4dd083bab9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:46.326637 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d130bb35-7edd-48e2-9072-4dd083bab9b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:46.327722 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d130bb35-7edd-48e2-9072-4dd083bab9b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:31:46.328285 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d130bb35-7edd-48e2-9072-4dd083bab9b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:46.330523 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d130bb35-7edd-48e2-9072-4dd083bab9b3 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:46.356539 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1148/2273] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 12:31:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:31:46.363862 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8471afa7-ed3d-48fe-a12a-fbf8717412b0 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:46.379558 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8471afa7-ed3d-48fe-a12a-fbf8717412b0 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:46.407838 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45474e1-c23a-4e5f-8564-4b39719c2eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:46.408744 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45474e1-c23a-4e5f-8564-4b39719c2eca admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:46.409171 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45474e1-c23a-4e5f-8564-4b39719c2eca admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:46.409732 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45474e1-c23a-4e5f-8564-4b39719c2eca admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:46.410821 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45474e1-c23a-4e5f-8564-4b39719c2eca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:46.414027 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45474e1-c23a-4e5f-8564-4b39719c2eca admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:46.486052 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1126/2274] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:31:46 2022] POST /identity/v3/projects => generated 377 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:31:46.490903 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d130bb35-7edd-48e2-9072-4dd083bab9b3 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:46.498873 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:46.509963 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d130bb35-7edd-48e2-9072-4dd083bab9b3 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:46.522274 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45474e1-c23a-4e5f-8564-4b39719c2eca admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:46.524543 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-b45474e1-c23a-4e5f-8564-4b39719c2eca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:46.696430 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2a89fe-6f67-4666-9901-264b3abb6dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:46.697105 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a89fe-6f67-4666-9901-264b3abb6dda admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:46.697388 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a89fe-6f67-4666-9901-264b3abb6dda admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:46.697712 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a89fe-6f67-4666-9901-264b3abb6dda admin admin] PATH_INFO: `/v3/users` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:46.699170 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2a89fe-6f67-4666-9901-264b3abb6dda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:46.701457 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45474e1-c23a-4e5f-8564-4b39719c2eca admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:46.701708 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2a89fe-6f67-4666-9901-264b3abb6dda admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:46.720541 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c550062e-7e1e-4128-b4ed-c81df9058903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:46.721466 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c550062e-7e1e-4128-b4ed-c81df9058903 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:46.722081 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c550062e-7e1e-4128-b4ed-c81df9058903 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:46.722270 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c550062e-7e1e-4128-b4ed-c81df9058903 admin admin] PATH_INFO: `/v3/users/5d64688f4e6b43e48d3c25a6ef86523d` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:46.724426 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c550062e-7e1e-4128-b4ed-c81df9058903 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d64688f4e6b43e48d3c25a6ef86523d)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:46.739320 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c550062e-7e1e-4128-b4ed-c81df9058903 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:46.761013 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1149/2275] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:31:46 2022] POST /identity/v3/users => generated 289 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:31:46.762250 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2a89fe-6f67-4666-9901-264b3abb6dda admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:46.791277 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2a89fe-6f67-4666-9901-264b3abb6dda admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:46.799144 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87495ad-627d-4582-b5d6-aae9054ca8bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:46.799934 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87495ad-627d-4582-b5d6-aae9054ca8bd admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:46.801116 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87495ad-627d-4582-b5d6-aae9054ca8bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:46.801116 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87495ad-627d-4582-b5d6-aae9054ca8bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:46.801506 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87495ad-627d-4582-b5d6-aae9054ca8bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:46.803419 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87495ad-627d-4582-b5d6-aae9054ca8bd admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:46.820965 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1150/2276] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:31:46 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:31:46.821923 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87495ad-627d-4582-b5d6-aae9054ca8bd admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:46.834601 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87495ad-627d-4582-b5d6-aae9054ca8bd admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:46.841651 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cef571b-2a73-4b9a-b8b4-ca6bbb3475a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:46.842839 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef571b-2a73-4b9a-b8b4-ca6bbb3475a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:46.843214 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef571b-2a73-4b9a-b8b4-ca6bbb3475a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:46.843504 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef571b-2a73-4b9a-b8b4-ca6bbb3475a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:46.844298 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cef571b-2a73-4b9a-b8b4-ca6bbb3475a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:46.847462 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cef571b-2a73-4b9a-b8b4-ca6bbb3475a2 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:46.864629 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1151/2277] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:31:46 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:31:46.868041 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-c550062e-7e1e-4128-b4ed-c81df9058903 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d64688f4e6b43e48d3c25a6ef86523d'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:46.877622 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cef571b-2a73-4b9a-b8b4-ca6bbb3475a2 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:46.886257 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-c550062e-7e1e-4128-b4ed-c81df9058903 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d64688f4e6b43e48d3c25a6ef86523d'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:46.887139 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-c550062e-7e1e-4128-b4ed-c81df9058903 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d64688f4e6b43e48d3c25a6ef86523d'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:46.896457 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-c550062e-7e1e-4128-b4ed-c81df9058903 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d64688f4e6b43e48d3c25a6ef86523d'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:46.897692 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-c550062e-7e1e-4128-b4ed-c81df9058903 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d64688f4e6b43e48d3c25a6ef86523d'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:46.898810 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cef571b-2a73-4b9a-b8b4-ca6bbb3475a2 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:46.902734 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:46.916850 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31d1bc9-ac0d-49e5-b374-5b114b848590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:46.917873 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31d1bc9-ac0d-49e5-b374-5b114b848590 admin admin] REQUEST_METHOD: `PUT` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:46.918380 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31d1bc9-ac0d-49e5-b374-5b114b848590 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:46.922619 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31d1bc9-ac0d-49e5-b374-5b114b848590 admin admin] PATH_INFO: `/v3/projects/57f065ce94f445ee94be3cefa7daeb7d/users/4577751d8cac4c5c80156962d9174087/roles/b5cfd7a855a448359e9017f51d32b6fc` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:46.930976 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1127/2278] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:31:46 2022] DELETE /identity/v3/users/5d64688f4e6b43e48d3c25a6ef86523d => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:31:46.945458 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f909ce15-5c47-4500-a1a1-485ec5bd292d None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:46.945882 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f909ce15-5c47-4500-a1a1-485ec5bd292d None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:46.946229 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f909ce15-5c47-4500-a1a1-485ec5bd292d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:46.972228 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-f909ce15-5c47-4500-a1a1-485ec5bd292d None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:31:46.973006 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31d1bc9-ac0d-49e5-b374-5b114b848590 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57f065ce94f445ee94be3cefa7daeb7d, user_id=4577751d8cac4c5c80156962d9174087, role_id=b5cfd7a855a448359e9017f51d32b6fc)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:46.973502 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-f909ce15-5c47-4500-a1a1-485ec5bd292d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:46.976564 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31d1bc9-ac0d-49e5-b374-5b114b848590 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:47.009191 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1152/2279] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:31:46 2022] PUT /identity/v3/projects/57f065ce94f445ee94be3cefa7daeb7d/users/4577751d8cac4c5c80156962d9174087/roles/b5cfd7a855a448359e9017f51d32b6fc => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:31:47.011517 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef6e2f-6aea-4c1e-891c-e447bdab0e38 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:47.012014 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef6e2f-6aea-4c1e-891c-e447bdab0e38 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:47.012568 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef6e2f-6aea-4c1e-891c-e447bdab0e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:47.053309 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1128/2280] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:31:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:31:47.063440 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-31ef6e2f-6aea-4c1e-891c-e447bdab0e38 None None] MFA Rules not processed for user `4577751d8cac4c5c80156962d9174087`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:31:47.067283 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-31ef6e2f-6aea-4c1e-891c-e447bdab0e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:47.077109 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f909ce15-5c47-4500-a1a1-485ec5bd292d None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:47.080645 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-f909ce15-5c47-4500-a1a1-485ec5bd292d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:47.191366 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1153/2281] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:31:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:31:47.192678 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ef6e2f-6aea-4c1e-891c-e447bdab0e38 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:47.194227 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-31ef6e2f-6aea-4c1e-891c-e447bdab0e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:47.267315 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:47.269131 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f909ce15-5c47-4500-a1a1-485ec5bd292d None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:47.297252 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ef6e2f-6aea-4c1e-891c-e447bdab0e38 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:47.302691 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6474d4f-1efd-4eba-a977-625b430b366a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:47.303399 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6474d4f-1efd-4eba-a977-625b430b366a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:47.303679 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6474d4f-1efd-4eba-a977-625b430b366a admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:47.303953 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6474d4f-1efd-4eba-a977-625b430b366a admin admin] PATH_INFO: `/v3/projects/fbf87357e8374154b26b9b6d726d5269` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:47.305681 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6474d4f-1efd-4eba-a977-625b430b366a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbf87357e8374154b26b9b6d726d5269)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:47.307676 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6474d4f-1efd-4eba-a977-625b430b366a admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:47.373082 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-a6474d4f-1efd-4eba-a977-625b430b366a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbf87357e8374154b26b9b6d726d5269', 'request_id': 'req-a6474d4f-1efd-4eba-a977-625b430b366a'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:47.380835 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f09a6e-2de2-4321-a943-56287c9b8567 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:47.382651 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f09a6e-2de2-4321-a943-56287c9b8567 service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:47.382911 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-a6474d4f-1efd-4eba-a977-625b430b366a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbf87357e8374154b26b9b6d726d5269', 'request_id': 'req-a6474d4f-1efd-4eba-a977-625b430b366a'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:47.383252 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f09a6e-2de2-4321-a943-56287c9b8567 service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:47.383651 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f09a6e-2de2-4321-a943-56287c9b8567 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:47.391980 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-a6474d4f-1efd-4eba-a977-625b430b366a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbf87357e8374154b26b9b6d726d5269', 'request_id': 'req-a6474d4f-1efd-4eba-a977-625b430b366a'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:47.396535 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f09a6e-2de2-4321-a943-56287c9b8567 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:47.398047 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f09a6e-2de2-4321-a943-56287c9b8567 service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:47.409125 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-a6474d4f-1efd-4eba-a977-625b430b366a admin admin] The token cache is being invalidate because project fbf87357e8374154b26b9b6d726d5269 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:31:47.409485 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-a6474d4f-1efd-4eba-a977-625b430b366a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:47.410287 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-a6474d4f-1efd-4eba-a977-625b430b366a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:47.411099 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1129/2282] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:31:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:31:47.412028 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f09a6e-2de2-4321-a943-56287c9b8567 service neutron] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:47.412182 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1154/2283] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:31:47 2022] DELETE /identity/v3/projects/fbf87357e8374154b26b9b6d726d5269 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:31:47.413887 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-a2f09a6e-2de2-4321-a943-56287c9b8567 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:47.416765 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6474d4f-1efd-4eba-a977-625b430b366a admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:47.419377 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-a6474d4f-1efd-4eba-a977-625b430b366a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:47.436689 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f09a6e-2de2-4321-a943-56287c9b8567 service neutron] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:47.533342 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:47.546278 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5967f6-d305-4f8e-bad0-321d6c2e1448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:47.547433 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5967f6-d305-4f8e-bad0-321d6c2e1448 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:47.547943 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5967f6-d305-4f8e-bad0-321d6c2e1448 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:47.548289 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5967f6-d305-4f8e-bad0-321d6c2e1448 admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:47.548947 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5967f6-d305-4f8e-bad0-321d6c2e1448 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:47.550946 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5967f6-d305-4f8e-bad0-321d6c2e1448 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:47.558248 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6474d4f-1efd-4eba-a977-625b430b366a admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:47.563548 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2892b40-1f8c-4f35-b640-3a0193045c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:47.564336 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2892b40-1f8c-4f35-b640-3a0193045c45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:47.564577 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2892b40-1f8c-4f35-b640-3a0193045c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:47.565251 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2892b40-1f8c-4f35-b640-3a0193045c45 admin admin] PATH_INFO: `/v3/users/5ec3809a62b24b41b2620778c99172ec` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:47.566081 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2892b40-1f8c-4f35-b640-3a0193045c45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ec3809a62b24b41b2620778c99172ec)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:47.568088 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2892b40-1f8c-4f35-b640-3a0193045c45 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:47.590348 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1130/2284] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:31:47 2022] POST /identity/v3/projects => generated 379 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:31:47.592242 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5967f6-d305-4f8e-bad0-321d6c2e1448 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:47.595034 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-fd5967f6-d305-4f8e-bad0-321d6c2e1448 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:47.677371 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-f2892b40-1f8c-4f35-b640-3a0193045c45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ec3809a62b24b41b2620778c99172ec'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:47.704581 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-f2892b40-1f8c-4f35-b640-3a0193045c45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ec3809a62b24b41b2620778c99172ec'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:47.722504 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5967f6-d305-4f8e-bad0-321d6c2e1448 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:47.728831 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c91aa0-d4b4-4af4-9cf1-1ca07e2b41e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:47.730004 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c91aa0-d4b4-4af4-9cf1-1ca07e2b41e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:47.730354 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c91aa0-d4b4-4af4-9cf1-1ca07e2b41e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:47.730680 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c91aa0-d4b4-4af4-9cf1-1ca07e2b41e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:47.731903 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c91aa0-d4b4-4af4-9cf1-1ca07e2b41e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:47.733332 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:47.735918 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c91aa0-d4b4-4af4-9cf1-1ca07e2b41e1 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:47.743568 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-f2892b40-1f8c-4f35-b640-3a0193045c45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ec3809a62b24b41b2620778c99172ec'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:47.744527 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-f2892b40-1f8c-4f35-b640-3a0193045c45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ec3809a62b24b41b2620778c99172ec'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:47.760093 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-f2892b40-1f8c-4f35-b640-3a0193045c45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ec3809a62b24b41b2620778c99172ec'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:47.776944 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1131/2285] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:31:47 2022] POST /identity/v3/users => generated 290 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:31:47.778360 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c91aa0-d4b4-4af4-9cf1-1ca07e2b41e1 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:47.781927 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1155/2286] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:31:47 2022] DELETE /identity/v3/users/5ec3809a62b24b41b2620778c99172ec => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:31:47.785432 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-d5c91aa0-d4b4-4af4-9cf1-1ca07e2b41e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:47.822506 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c91aa0-d4b4-4af4-9cf1-1ca07e2b41e1 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:47.953310 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59709439-d914-44db-8464-28ce61fcc1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:47.954089 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59709439-d914-44db-8464-28ce61fcc1df admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:47.954606 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59709439-d914-44db-8464-28ce61fcc1df admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:47.954937 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59709439-d914-44db-8464-28ce61fcc1df admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:47.955815 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59709439-d914-44db-8464-28ce61fcc1df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:47.958005 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59709439-d914-44db-8464-28ce61fcc1df admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:47.971853 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2892b40-1f8c-4f35-b640-3a0193045c45 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:47.974199 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-f2892b40-1f8c-4f35-b640-3a0193045c45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:47.974373 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1132/2287] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:31:47 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:31:47.998324 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59709439-d914-44db-8464-28ce61fcc1df admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:48.001153 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2892b40-1f8c-4f35-b640-3a0193045c45 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:48.015749 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59709439-d914-44db-8464-28ce61fcc1df admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:48.021008 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d695f8e-ec95-4dc0-a0b4-235214ee6038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:48.021788 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d695f8e-ec95-4dc0-a0b4-235214ee6038 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:48.022143 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d695f8e-ec95-4dc0-a0b4-235214ee6038 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:48.022639 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d695f8e-ec95-4dc0-a0b4-235214ee6038 admin admin] PATH_INFO: `/v3/projects/71001425c24a48a2b26d9d45bda9be1b` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:48.024092 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d695f8e-ec95-4dc0-a0b4-235214ee6038 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71001425c24a48a2b26d9d45bda9be1b)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:48.027016 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d695f8e-ec95-4dc0-a0b4-235214ee6038 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:48.027294 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea63b10a-b0c6-48e2-86e9-d64c1abf555b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:48.028341 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea63b10a-b0c6-48e2-86e9-d64c1abf555b admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:48.028827 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea63b10a-b0c6-48e2-86e9-d64c1abf555b admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:48.029358 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea63b10a-b0c6-48e2-86e9-d64c1abf555b admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:48.030981 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea63b10a-b0c6-48e2-86e9-d64c1abf555b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:48.034455 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea63b10a-b0c6-48e2-86e9-d64c1abf555b admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:48.064413 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1133/2288] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:31:47 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 12:31:48.072465 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea63b10a-b0c6-48e2-86e9-d64c1abf555b admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:48.099112 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea63b10a-b0c6-48e2-86e9-d64c1abf555b admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:48.107405 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1def2105-a927-4b9d-8fef-2ae0bc1a4ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:48.108178 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def2105-a927-4b9d-8fef-2ae0bc1a4ae0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:48.108459 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def2105-a927-4b9d-8fef-2ae0bc1a4ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:48.108728 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def2105-a927-4b9d-8fef-2ae0bc1a4ae0 admin admin] PATH_INFO: `/v3/projects/91147c6ae0c1432d814a31d1c87713eb/users/444a7b214e94411295458a36631be1ed/roles/b5cfd7a855a448359e9017f51d32b6fc` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:48.137429 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1def2105-a927-4b9d-8fef-2ae0bc1a4ae0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91147c6ae0c1432d814a31d1c87713eb, user_id=444a7b214e94411295458a36631be1ed, role_id=b5cfd7a855a448359e9017f51d32b6fc)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:48.141665 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1def2105-a927-4b9d-8fef-2ae0bc1a4ae0 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:48.179557 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1134/2289] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:31:48 2022] PUT /identity/v3/projects/91147c6ae0c1432d814a31d1c87713eb/users/444a7b214e94411295458a36631be1ed/roles/b5cfd7a855a448359e9017f51d32b6fc => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:31:48.181817 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-8d695f8e-ec95-4dc0-a0b4-235214ee6038 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71001425c24a48a2b26d9d45bda9be1b', 'request_id': 'req-8d695f8e-ec95-4dc0-a0b4-235214ee6038'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:48.185365 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8de705-5855-44dd-9be9-467db23d8c35 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:48.185588 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8de705-5855-44dd-9be9-467db23d8c35 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:48.187846 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8de705-5855-44dd-9be9-467db23d8c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:48.195705 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-8d695f8e-ec95-4dc0-a0b4-235214ee6038 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71001425c24a48a2b26d9d45bda9be1b', 'request_id': 'req-8d695f8e-ec95-4dc0-a0b4-235214ee6038'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:48.206502 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-8d695f8e-ec95-4dc0-a0b4-235214ee6038 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71001425c24a48a2b26d9d45bda9be1b', 'request_id': 'req-8d695f8e-ec95-4dc0-a0b4-235214ee6038'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:48.223299 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-8d695f8e-ec95-4dc0-a0b4-235214ee6038 admin admin] The token cache is being invalidate because project 71001425c24a48a2b26d9d45bda9be1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:31:48.223955 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-8d695f8e-ec95-4dc0-a0b4-235214ee6038 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:48.224771 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-8d695f8e-ec95-4dc0-a0b4-235214ee6038 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:48.226958 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1156/2290] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:31:47 2022] DELETE /identity/v3/projects/71001425c24a48a2b26d9d45bda9be1b => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:31:48.232428 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-9e8de705-5855-44dd-9be9-467db23d8c35 None None] MFA Rules not processed for user `444a7b214e94411295458a36631be1ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:31:48.233707 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-9e8de705-5855-44dd-9be9-467db23d8c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:48.234713 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547599ae-d311-46e3-879e-8c659fd3bd21 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:48.235779 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547599ae-d311-46e3-879e-8c659fd3bd21 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:48.236507 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547599ae-d311-46e3-879e-8c659fd3bd21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:48.274822 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:48.295570 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-547599ae-d311-46e3-879e-8c659fd3bd21 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:31:48.297556 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-547599ae-d311-46e3-879e-8c659fd3bd21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:48.380620 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1135/2291] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:31:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:31:48.385086 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8de705-5855-44dd-9be9-467db23d8c35 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:48.390111 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-9e8de705-5855-44dd-9be9-467db23d8c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:48.456235 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1157/2292] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:31:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:31:48.457987 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547599ae-d311-46e3-879e-8c659fd3bd21 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:48.460121 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-547599ae-d311-46e3-879e-8c659fd3bd21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:48.475509 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547599ae-d311-46e3-879e-8c659fd3bd21 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:48.480679 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20278361-fe19-4602-be34-c92b8fd7076d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:48.481343 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20278361-fe19-4602-be34-c92b8fd7076d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:48.481876 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20278361-fe19-4602-be34-c92b8fd7076d admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:48.482164 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20278361-fe19-4602-be34-c92b8fd7076d admin admin] PATH_INFO: `/v3/projects/893c5cc2efda4500a202d18408c12d9f` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:48.483577 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20278361-fe19-4602-be34-c92b8fd7076d admin admin] RBAC: Authorizing `identity:delete_project(project_id=893c5cc2efda4500a202d18408c12d9f)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:48.485583 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20278361-fe19-4602-be34-c92b8fd7076d admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:48.529744 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8de705-5855-44dd-9be9-467db23d8c35 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:48.561227 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-20278361-fe19-4602-be34-c92b8fd7076d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '893c5cc2efda4500a202d18408c12d9f', 'request_id': 'req-20278361-fe19-4602-be34-c92b8fd7076d'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:48.572534 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-20278361-fe19-4602-be34-c92b8fd7076d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '893c5cc2efda4500a202d18408c12d9f', 'request_id': 'req-20278361-fe19-4602-be34-c92b8fd7076d'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:48.596984 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-20278361-fe19-4602-be34-c92b8fd7076d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '893c5cc2efda4500a202d18408c12d9f', 'request_id': 'req-20278361-fe19-4602-be34-c92b8fd7076d'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:48.602632 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e543229-0b96-4e77-91d3-be71c5897dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:48.603283 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e543229-0b96-4e77-91d3-be71c5897dff admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:48.603563 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e543229-0b96-4e77-91d3-be71c5897dff admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:48.603835 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e543229-0b96-4e77-91d3-be71c5897dff admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:48.604703 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=83,keystone:INSERT=3,keystone:DELETE=14 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:48.604935 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e543229-0b96-4e77-91d3-be71c5897dff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:48.607350 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e543229-0b96-4e77-91d3-be71c5897dff admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:48.618939 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-20278361-fe19-4602-be34-c92b8fd7076d admin admin] The token cache is being invalidate because project 893c5cc2efda4500a202d18408c12d9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:31:48.619471 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-20278361-fe19-4602-be34-c92b8fd7076d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:48.621340 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-20278361-fe19-4602-be34-c92b8fd7076d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:48.624149 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1158/2293] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:31:48 2022] DELETE /identity/v3/projects/893c5cc2efda4500a202d18408c12d9f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:31:48.628571 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3d427b-0a55-487c-9a07-2fa88d9b4e4d None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:48.628871 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3d427b-0a55-487c-9a07-2fa88d9b4e4d None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:48.629147 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3d427b-0a55-487c-9a07-2fa88d9b4e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:48.638209 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1136/2294] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:31:48 2022] POST /identity/v3/projects => generated 379 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:31:48.640017 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e543229-0b96-4e77-91d3-be71c5897dff admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:48.641919 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-4e543229-0b96-4e77-91d3-be71c5897dff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:48.656426 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-4e3d427b-0a55-487c-9a07-2fa88d9b4e4d None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:31:48.657713 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-4e3d427b-0a55-487c-9a07-2fa88d9b4e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:48.708268 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:48.725401 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e543229-0b96-4e77-91d3-be71c5897dff admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:48.731207 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1159/2295] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:31:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:31:48.732409 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3d427b-0a55-487c-9a07-2fa88d9b4e4d None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:48.734892 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d46909-795c-41cd-b830-d62c7b54a37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:48.735601 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d46909-795c-41cd-b830-d62c7b54a37e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:48.735879 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d46909-795c-41cd-b830-d62c7b54a37e admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:48.736155 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d46909-795c-41cd-b830-d62c7b54a37e admin admin] PATH_INFO: `/v3/users/1b1f128c1d5d4f63a3fa0a1a46e8c5f2` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:48.736610 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-4e3d427b-0a55-487c-9a07-2fa88d9b4e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:48.738239 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d46909-795c-41cd-b830-d62c7b54a37e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b1f128c1d5d4f63a3fa0a1a46e8c5f2)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:48.740259 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d46909-795c-41cd-b830-d62c7b54a37e admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:48.753332 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3d427b-0a55-487c-9a07-2fa88d9b4e4d None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:48.763020 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ad85cd-2296-4cec-a405-7c86726edc4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:48.764161 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad85cd-2296-4cec-a405-7c86726edc4c admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:48.764532 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad85cd-2296-4cec-a405-7c86726edc4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:48.764983 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad85cd-2296-4cec-a405-7c86726edc4c admin admin] PATH_INFO: `/v3/users` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:48.766004 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ad85cd-2296-4cec-a405-7c86726edc4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:48.769419 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ad85cd-2296-4cec-a405-7c86726edc4c admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:48.796705 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1160/2296] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:31:48 2022] POST /identity/v3/users => generated 296 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:31:48.798098 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ad85cd-2296-4cec-a405-7c86726edc4c admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:48.811123 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ad85cd-2296-4cec-a405-7c86726edc4c admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:48.816763 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d59c102-3140-45c6-8d63-7c56e89a8d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:48.817438 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d59c102-3140-45c6-8d63-7c56e89a8d86 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:48.817715 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d59c102-3140-45c6-8d63-7c56e89a8d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:48.817991 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d59c102-3140-45c6-8d63-7c56e89a8d86 admin admin] PATH_INFO: `/v3/domains` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:48.818698 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d59c102-3140-45c6-8d63-7c56e89a8d86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:31:48.819042 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d59c102-3140-45c6-8d63-7c56e89a8d86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:48.820675 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d59c102-3140-45c6-8d63-7c56e89a8d86 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:48.827393 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-d9d46909-795c-41cd-b830-d62c7b54a37e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b1f128c1d5d4f63a3fa0a1a46e8c5f2'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:48.839937 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1161/2297] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 12:31:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:31:48.839937 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d59c102-3140-45c6-8d63-7c56e89a8d86 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:48.842773 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-d9d46909-795c-41cd-b830-d62c7b54a37e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b1f128c1d5d4f63a3fa0a1a46e8c5f2'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:48.843548 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-d9d46909-795c-41cd-b830-d62c7b54a37e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b1f128c1d5d4f63a3fa0a1a46e8c5f2'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:48.853974 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-d9d46909-795c-41cd-b830-d62c7b54a37e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b1f128c1d5d4f63a3fa0a1a46e8c5f2'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:48.855568 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-d9d46909-795c-41cd-b830-d62c7b54a37e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b1f128c1d5d4f63a3fa0a1a46e8c5f2'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:48.859956 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d59c102-3140-45c6-8d63-7c56e89a8d86 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:48.867425 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82dcdab-8820-4170-a61e-89f43548d679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:48.868439 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82dcdab-8820-4170-a61e-89f43548d679 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:48.868912 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82dcdab-8820-4170-a61e-89f43548d679 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:48.869404 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82dcdab-8820-4170-a61e-89f43548d679 admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:48.871110 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82dcdab-8820-4170-a61e-89f43548d679 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:48.873365 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82dcdab-8820-4170-a61e-89f43548d679 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:48.874703 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1137/2298] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:31:48 2022] DELETE /identity/v3/users/1b1f128c1d5d4f63a3fa0a1a46e8c5f2 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:31:48.875258 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d46909-795c-41cd-b830-d62c7b54a37e admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:48.876929 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-d9d46909-795c-41cd-b830-d62c7b54a37e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:48.931357 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1162/2299] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:31:48 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:31:48.933900 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82dcdab-8820-4170-a61e-89f43548d679 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:48.937086 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-b82dcdab-8820-4170-a61e-89f43548d679 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:48.969140 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82dcdab-8820-4170-a61e-89f43548d679 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:49.049023 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d46909-795c-41cd-b830-d62c7b54a37e admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:49.056385 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf1492a-0843-40c9-84c9-61c855b3284a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:49.057021 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf1492a-0843-40c9-84c9-61c855b3284a admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:49.057300 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf1492a-0843-40c9-84c9-61c855b3284a admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:49.058061 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf1492a-0843-40c9-84c9-61c855b3284a admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:49.059112 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf1492a-0843-40c9-84c9-61c855b3284a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:49.061316 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf1492a-0843-40c9-84c9-61c855b3284a admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:49.102174 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e22c88-469e-42c8-8204-ee4139583d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:49.105877 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e22c88-469e-42c8-8204-ee4139583d81 admin admin] REQUEST_METHOD: `PUT` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:49.106293 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1138/2300] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:31:48 2022] POST /identity/v3/projects => generated 373 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:31:49.107287 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e22c88-469e-42c8-8204-ee4139583d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:49.109250 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf1492a-0843-40c9-84c9-61c855b3284a admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:49.110715 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e22c88-469e-42c8-8204-ee4139583d81 admin admin] PATH_INFO: `/v3/projects/23a8f6b89ab24e21b177547e29ec7704/users/4c7ce467db5c467ca66c0475f6773840/roles/a332ef951db949b0bad7019fbd28a1b9` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:49.166325 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e22c88-469e-42c8-8204-ee4139583d81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23a8f6b89ab24e21b177547e29ec7704, user_id=4c7ce467db5c467ca66c0475f6773840, role_id=a332ef951db949b0bad7019fbd28a1b9)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:49.170764 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e22c88-469e-42c8-8204-ee4139583d81 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:49.190284 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1163/2301] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:31:48 2022] PUT /identity/v3/projects/23a8f6b89ab24e21b177547e29ec7704/users/4c7ce467db5c467ca66c0475f6773840/roles/a332ef951db949b0bad7019fbd28a1b9 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:31:49.195771 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e22c88-469e-42c8-8204-ee4139583d81 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:49.275949 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:DELETE=1,keystone:SELECT=95,keystone:INSERT=4 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:49.279654 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:49.287819 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf1492a-0843-40c9-84c9-61c855b3284a admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:49.322227 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e22c88-469e-42c8-8204-ee4139583d81 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:49.331528 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafac50b-3f07-4e9c-9418-1862c529bb58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:49.332288 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafac50b-3f07-4e9c-9418-1862c529bb58 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:49.332581 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafac50b-3f07-4e9c-9418-1862c529bb58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:49.333165 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafac50b-3f07-4e9c-9418-1862c529bb58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:49.333523 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafac50b-3f07-4e9c-9418-1862c529bb58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:49.335239 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafac50b-3f07-4e9c-9418-1862c529bb58 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:49.356064 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1164/2302] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:31:49 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:31:49.364225 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafac50b-3f07-4e9c-9418-1862c529bb58 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:49.402467 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafac50b-3f07-4e9c-9418-1862c529bb58 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:49.420311 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f55fb2-159f-4d2b-bce5-4c7608f1a158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:49.420311 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f55fb2-159f-4d2b-bce5-4c7608f1a158 admin admin] REQUEST_METHOD: `PUT` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:49.420311 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f55fb2-159f-4d2b-bce5-4c7608f1a158 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:49.420311 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f55fb2-159f-4d2b-bce5-4c7608f1a158 admin admin] PATH_INFO: `/v3/projects/23a8f6b89ab24e21b177547e29ec7704/users/4c7ce467db5c467ca66c0475f6773840/roles/a332ef951db949b0bad7019fbd28a1b9` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:49.420790 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f55fb2-159f-4d2b-bce5-4c7608f1a158 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23a8f6b89ab24e21b177547e29ec7704, user_id=4c7ce467db5c467ca66c0475f6773840, role_id=a332ef951db949b0bad7019fbd28a1b9)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:49.439282 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f55fb2-159f-4d2b-bce5-4c7608f1a158 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:49.470713 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb8121f-2b5d-4604-8c77-d6bc0645cde8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:49.470713 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb8121f-2b5d-4604-8c77-d6bc0645cde8 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:49.471333 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb8121f-2b5d-4604-8c77-d6bc0645cde8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:49.471705 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb8121f-2b5d-4604-8c77-d6bc0645cde8 admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:49.473002 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb8121f-2b5d-4604-8c77-d6bc0645cde8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:49.475150 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb8121f-2b5d-4604-8c77-d6bc0645cde8 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:49.489734 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1165/2303] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:31:49 2022] PUT /identity/v3/projects/23a8f6b89ab24e21b177547e29ec7704/users/4c7ce467db5c467ca66c0475f6773840/roles/a332ef951db949b0bad7019fbd28a1b9 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:31:49.491718 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f55fb2-159f-4d2b-bce5-4c7608f1a158 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:49.494656 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-26f55fb2-159f-4d2b-bce5-4c7608f1a158 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:49.514026 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1139/2304] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:31:49 2022] POST /identity/v3/users => generated 287 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:31:49.516131 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398407cf-b7e6-419d-b9a8-597b033126ba None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:49.516459 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398407cf-b7e6-419d-b9a8-597b033126ba None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:49.516936 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398407cf-b7e6-419d-b9a8-597b033126ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:49.560383 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-398407cf-b7e6-419d-b9a8-597b033126ba None None] MFA Rules not processed for user `4c7ce467db5c467ca66c0475f6773840`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:31:49.562274 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-398407cf-b7e6-419d-b9a8-597b033126ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:49.632869 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f55fb2-159f-4d2b-bce5-4c7608f1a158 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:49.639353 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aac79a4-27cb-4cd6-bb87-f54c8ed8ff1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:49.640036 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac79a4-27cb-4cd6-bb87-f54c8ed8ff1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:49.640329 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac79a4-27cb-4cd6-bb87-f54c8ed8ff1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:49.640623 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac79a4-27cb-4cd6-bb87-f54c8ed8ff1f admin admin] PATH_INFO: `/v3/projects/fd986bf22bd344cf805d7a0d089ab18e` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:49.646931 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aac79a4-27cb-4cd6-bb87-f54c8ed8ff1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd986bf22bd344cf805d7a0d089ab18e)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:49.646931 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aac79a4-27cb-4cd6-bb87-f54c8ed8ff1f admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:49.733779 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1140/2305] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:31:49 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:31:49.735090 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398407cf-b7e6-419d-b9a8-597b033126ba None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:49.740432 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-5aac79a4-27cb-4cd6-bb87-f54c8ed8ff1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd986bf22bd344cf805d7a0d089ab18e', 'request_id': 'req-5aac79a4-27cb-4cd6-bb87-f54c8ed8ff1f'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:49.748387 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398407cf-b7e6-419d-b9a8-597b033126ba None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:49.755635 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-5aac79a4-27cb-4cd6-bb87-f54c8ed8ff1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd986bf22bd344cf805d7a0d089ab18e', 'request_id': 'req-5aac79a4-27cb-4cd6-bb87-f54c8ed8ff1f'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:49.764401 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-5aac79a4-27cb-4cd6-bb87-f54c8ed8ff1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd986bf22bd344cf805d7a0d089ab18e', 'request_id': 'req-5aac79a4-27cb-4cd6-bb87-f54c8ed8ff1f'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:49.778877 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-5aac79a4-27cb-4cd6-bb87-f54c8ed8ff1f admin admin] The token cache is being invalidate because project fd986bf22bd344cf805d7a0d089ab18e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:31:49.779347 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-5aac79a4-27cb-4cd6-bb87-f54c8ed8ff1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:49.780309 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-5aac79a4-27cb-4cd6-bb87-f54c8ed8ff1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:49.782045 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1166/2306] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:31:49 2022] DELETE /identity/v3/projects/fd986bf22bd344cf805d7a0d089ab18e => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:31:49.787910 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aac79a4-27cb-4cd6-bb87-f54c8ed8ff1f admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:49.787910 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-5aac79a4-27cb-4cd6-bb87-f54c8ed8ff1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:49.871351 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:49.874911 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a05c2a-3487-49c3-a2b1-c798762a3498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:49.875192 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a05c2a-3487-49c3-a2b1-c798762a3498 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:49.875416 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a05c2a-3487-49c3-a2b1-c798762a3498 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:49.878915 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a05c2a-3487-49c3-a2b1-c798762a3498 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:49.878915 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a05c2a-3487-49c3-a2b1-c798762a3498 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:49.882764 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a05c2a-3487-49c3-a2b1-c798762a3498 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:49.883388 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aac79a4-27cb-4cd6-bb87-f54c8ed8ff1f admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:49.890012 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eb0d49-fdeb-47d5-9196-e7e3c65ecf28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e79503178ac54e62ba385467d5617ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:49.890803 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb0d49-fdeb-47d5-9196-e7e3c65ecf28 service cinder] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:49.891125 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb0d49-fdeb-47d5-9196-e7e3c65ecf28 service cinder] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:49.891438 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb0d49-fdeb-47d5-9196-e7e3c65ecf28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:49.893470 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-10eb0d49-fdeb-47d5-9196-e7e3c65ecf28 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:49.904227 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1141/2307] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:31:49 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:31:49.905723 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452bad11-9b23-4619-9ff6-2cb57880f9e4 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:49.906117 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452bad11-9b23-4619-9ff6-2cb57880f9e4 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:49.906296 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452bad11-9b23-4619-9ff6-2cb57880f9e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:49.930585 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-452bad11-9b23-4619-9ff6-2cb57880f9e4 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:31:49.934192 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-452bad11-9b23-4619-9ff6-2cb57880f9e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:49.952628 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1142/2308] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:31:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:31:49.954285 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452bad11-9b23-4619-9ff6-2cb57880f9e4 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:49.956636 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-452bad11-9b23-4619-9ff6-2cb57880f9e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:49.983714 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452bad11-9b23-4619-9ff6-2cb57880f9e4 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:49.988968 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eff1e5-b775-4d34-becf-982d230473a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:49.989679 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eff1e5-b775-4d34-becf-982d230473a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:49.990029 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eff1e5-b775-4d34-becf-982d230473a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:49.990377 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eff1e5-b775-4d34-becf-982d230473a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:49.991246 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eff1e5-b775-4d34-becf-982d230473a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:49.993348 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eff1e5-b775-4d34-becf-982d230473a9 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:49.999127 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:50.008099 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eb0d49-fdeb-47d5-9196-e7e3c65ecf28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:50.012501 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eb0d49-fdeb-47d5-9196-e7e3c65ecf28 service cinder] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:50.019131 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1143/2309] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:31:49 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:31:50.020505 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25700236-a700-4224-b94b-8f33656f9228 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:50.020805 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25700236-a700-4224-b94b-8f33656f9228 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:50.021074 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25700236-a700-4224-b94b-8f33656f9228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:50.027099 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1167/2310] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:31:49 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:31:50.028117 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eb0d49-fdeb-47d5-9196-e7e3c65ecf28 service cinder] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:50.040932 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eb0d49-fdeb-47d5-9196-e7e3c65ecf28 service cinder] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:50.044646 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-25700236-a700-4224-b94b-8f33656f9228 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:31:50.045891 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-25700236-a700-4224-b94b-8f33656f9228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:50.046357 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02033478-eea4-471c-a075-04cfc24608af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:50.047193 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02033478-eea4-471c-a075-04cfc24608af admin admin] REQUEST_METHOD: `PUT` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:50.047603 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02033478-eea4-471c-a075-04cfc24608af admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:50.047803 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02033478-eea4-471c-a075-04cfc24608af admin admin] PATH_INFO: `/v3/projects/9b60c65197c44d6ea39a4964e43b66b5/users/5936728ffd654091959f22f505cb2162/roles/b5cfd7a855a448359e9017f51d32b6fc` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:50.059406 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1144/2311] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:31:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:31:50.062553 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25700236-a700-4224-b94b-8f33656f9228 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:50.072455 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02033478-eea4-471c-a075-04cfc24608af admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b60c65197c44d6ea39a4964e43b66b5, user_id=5936728ffd654091959f22f505cb2162, role_id=b5cfd7a855a448359e9017f51d32b6fc)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:50.072813 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25700236-a700-4224-b94b-8f33656f9228 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:50.075971 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02033478-eea4-471c-a075-04cfc24608af admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:50.081430 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947c22dc-5575-4f44-a57a-5a2edd916c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:50.082151 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c22dc-5575-4f44-a57a-5a2edd916c25 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:50.082437 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c22dc-5575-4f44-a57a-5a2edd916c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:50.082930 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c22dc-5575-4f44-a57a-5a2edd916c25 admin admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:50.083606 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947c22dc-5575-4f44-a57a-5a2edd916c25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:31:50.083903 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947c22dc-5575-4f44-a57a-5a2edd916c25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:50.085538 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947c22dc-5575-4f44-a57a-5a2edd916c25 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:50.096004 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1168/2312] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:31:50 2022] PUT /identity/v3/projects/9b60c65197c44d6ea39a4964e43b66b5/users/5936728ffd654091959f22f505cb2162/roles/b5cfd7a855a448359e9017f51d32b6fc => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:31:50.097500 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02033478-eea4-471c-a075-04cfc24608af admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:50.099887 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-02033478-eea4-471c-a075-04cfc24608af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:50.111122 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1145/2313] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 12:31:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:31:50.112874 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec1d94-b6b8-445b-8554-a43e7dd99251 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:50.113174 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec1d94-b6b8-445b-8554-a43e7dd99251 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:50.113452 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec1d94-b6b8-445b-8554-a43e7dd99251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:50.160309 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-bdec1d94-b6b8-445b-8554-a43e7dd99251 None None] MFA Rules not processed for user `5936728ffd654091959f22f505cb2162`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:31:50.161447 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-bdec1d94-b6b8-445b-8554-a43e7dd99251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:50.179313 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02033478-eea4-471c-a075-04cfc24608af admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:50.184420 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee50f794-3a61-44f4-a0e8-1965d01fe0f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e79503178ac54e62ba385467d5617ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:50.185062 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50f794-3a61-44f4-a0e8-1965d01fe0f7 service cinder] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:50.185346 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50f794-3a61-44f4-a0e8-1965d01fe0f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:50.185622 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50f794-3a61-44f4-a0e8-1965d01fe0f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:50.187497 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-ee50f794-3a61-44f4-a0e8-1965d01fe0f7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:50.255750 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1146/2314] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:31:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:31:50.257574 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdec1d94-b6b8-445b-8554-a43e7dd99251 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:50.259493 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee50f794-3a61-44f4-a0e8-1965d01fe0f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:50.261940 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee50f794-3a61-44f4-a0e8-1965d01fe0f7 service cinder] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:50.272124 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1169/2315] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:31:50 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:31:50.273002 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee50f794-3a61-44f4-a0e8-1965d01fe0f7 service cinder] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:50.333459 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:50.382691 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdec1d94-b6b8-445b-8554-a43e7dd99251 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:50.390005 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee50f794-3a61-44f4-a0e8-1965d01fe0f7 service cinder] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:50.392132 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b242fa17-8cc2-412d-9044-5edef3687724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:50.393224 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242fa17-8cc2-412d-9044-5edef3687724 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:50.393711 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242fa17-8cc2-412d-9044-5edef3687724 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:50.394196 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242fa17-8cc2-412d-9044-5edef3687724 admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:50.395518 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b242fa17-8cc2-412d-9044-5edef3687724 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:50.398825 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef47dc40-9141-4f0d-9413-b0052cc6060a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:50.399501 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47dc40-9141-4f0d-9413-b0052cc6060a admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:50.399668 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b242fa17-8cc2-412d-9044-5edef3687724 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:50.399878 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47dc40-9141-4f0d-9413-b0052cc6060a admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:50.400138 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47dc40-9141-4f0d-9413-b0052cc6060a admin admin] PATH_INFO: `/v3/projects` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:50.401021 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef47dc40-9141-4f0d-9413-b0052cc6060a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:50.403544 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef47dc40-9141-4f0d-9413-b0052cc6060a admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:50.461755 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1170/2316] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:31:50 2022] POST /identity/v3/projects => generated 375 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:31:50.466364 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef47dc40-9141-4f0d-9413-b0052cc6060a admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:50.467334 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1147/2317] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:31:50 2022] POST /identity/v3/projects => generated 391 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:31:50.472197 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b242fa17-8cc2-412d-9044-5edef3687724 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:50.595844 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:50.602198 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef47dc40-9141-4f0d-9413-b0052cc6060a admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:50.619304 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236b78e6-da57-44bb-a5fe-7a4d59ad3a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:50.619808 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b78e6-da57-44bb-a5fe-7a4d59ad3a40 admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:50.620910 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b78e6-da57-44bb-a5fe-7a4d59ad3a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:50.621198 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b78e6-da57-44bb-a5fe-7a4d59ad3a40 admin admin] PATH_INFO: `/v3/users` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:50.622219 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236b78e6-da57-44bb-a5fe-7a4d59ad3a40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:50.627139 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236b78e6-da57-44bb-a5fe-7a4d59ad3a40 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:50.660574 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1171/2318] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:31:50 2022] POST /identity/v3/users => generated 294 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:31:50.665643 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236b78e6-da57-44bb-a5fe-7a4d59ad3a40 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:50.669015 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b242fa17-8cc2-412d-9044-5edef3687724 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:50.683747 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236b78e6-da57-44bb-a5fe-7a4d59ad3a40 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:50.690603 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8901f35a-aed4-4ab6-89c3-7194c6102eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:50.690890 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90244b4-c96b-45e7-b571-10869f73ee66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:50.691764 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901f35a-aed4-4ab6-89c3-7194c6102eaf admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:50.692177 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90244b4-c96b-45e7-b571-10869f73ee66 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:50.692598 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901f35a-aed4-4ab6-89c3-7194c6102eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:50.693052 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901f35a-aed4-4ab6-89c3-7194c6102eaf admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:50.693219 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90244b4-c96b-45e7-b571-10869f73ee66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:50.694077 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90244b4-c96b-45e7-b571-10869f73ee66 admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:50.694555 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8901f35a-aed4-4ab6-89c3-7194c6102eaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:50.696426 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8901f35a-aed4-4ab6-89c3-7194c6102eaf admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:50.709083 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90244b4-c96b-45e7-b571-10869f73ee66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:50.711859 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1172/2319] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:31:50 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:31:50.718775 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8901f35a-aed4-4ab6-89c3-7194c6102eaf admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:50.721479 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90244b4-c96b-45e7-b571-10869f73ee66 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:50.733978 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8901f35a-aed4-4ab6-89c3-7194c6102eaf admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:50.752261 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67535da-b879-40e3-8586-5678817ba18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:50.756720 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67535da-b879-40e3-8586-5678817ba18e admin admin] REQUEST_METHOD: `PUT` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:50.757225 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67535da-b879-40e3-8586-5678817ba18e admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:50.758426 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67535da-b879-40e3-8586-5678817ba18e admin admin] PATH_INFO: `/v3/projects/1541f7a0c4ee428e8fba1f383fc02994/users/d409ddbe919e42cf8dfe6831f2105544/roles/a332ef951db949b0bad7019fbd28a1b9` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:50.776833 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1148/2320] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:31:50 2022] POST /identity/v3/users => generated 296 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:31:50.782164 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90244b4-c96b-45e7-b571-10869f73ee66 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:50.782562 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67535da-b879-40e3-8586-5678817ba18e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1541f7a0c4ee428e8fba1f383fc02994, user_id=d409ddbe919e42cf8dfe6831f2105544, role_id=a332ef951db949b0bad7019fbd28a1b9)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:50.786291 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67535da-b879-40e3-8586-5678817ba18e admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:50.808116 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1173/2321] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:31:50 2022] PUT /identity/v3/projects/1541f7a0c4ee428e8fba1f383fc02994/users/d409ddbe919e42cf8dfe6831f2105544/roles/a332ef951db949b0bad7019fbd28a1b9 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:31:50.813059 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67535da-b879-40e3-8586-5678817ba18e admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:50.817371 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90244b4-c96b-45e7-b571-10869f73ee66 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:50.945092 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14204fae-551e-4527-bba5-94cf4a76ef41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:50.949396 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14204fae-551e-4527-bba5-94cf4a76ef41 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:50.949947 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14204fae-551e-4527-bba5-94cf4a76ef41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:50.950442 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14204fae-551e-4527-bba5-94cf4a76ef41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:50.967459 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14204fae-551e-4527-bba5-94cf4a76ef41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:50.970380 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14204fae-551e-4527-bba5-94cf4a76ef41 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:50.985858 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67535da-b879-40e3-8586-5678817ba18e admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:51.002427 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dceeb8-9849-4453-ba32-1af2fd6ce6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:51.008134 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dceeb8-9849-4453-ba32-1af2fd6ce6aa admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:51.008134 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dceeb8-9849-4453-ba32-1af2fd6ce6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:51.008134 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dceeb8-9849-4453-ba32-1af2fd6ce6aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:51.008666 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1149/2322] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:31:50 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 12:31:51.010020 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14204fae-551e-4527-bba5-94cf4a76ef41 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:51.010183 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dceeb8-9849-4453-ba32-1af2fd6ce6aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:51.015215 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dceeb8-9849-4453-ba32-1af2fd6ce6aa admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:51.037702 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14204fae-551e-4527-bba5-94cf4a76ef41 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:51.068409 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1174/2323] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:31:50 2022] GET /identity/v3/roles => generated 1420 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:31:51.074915 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce44e92-0c67-49b3-b21b-47164f58cdae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:51.075381 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dceeb8-9849-4453-ba32-1af2fd6ce6aa admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:51.075591 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce44e92-0c67-49b3-b21b-47164f58cdae admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:51.075838 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce44e92-0c67-49b3-b21b-47164f58cdae admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:51.076114 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce44e92-0c67-49b3-b21b-47164f58cdae admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:51.079662 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce44e92-0c67-49b3-b21b-47164f58cdae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:51.083515 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce44e92-0c67-49b3-b21b-47164f58cdae admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:51.107129 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:51.120704 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1150/2324] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:31:51 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:31:51.122166 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dceeb8-9849-4453-ba32-1af2fd6ce6aa admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:51.123029 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce44e92-0c67-49b3-b21b-47164f58cdae admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:51.150261 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce44e92-0c67-49b3-b21b-47164f58cdae admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:51.155335 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380273e1-a634-429f-9440-a7acfd265e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:51.156761 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380273e1-a634-429f-9440-a7acfd265e4d admin admin] REQUEST_METHOD: `PUT` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:51.157111 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0e44ff-09b8-439e-a396-4d48717964a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:51.158106 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0e44ff-09b8-439e-a396-4d48717964a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:51.158516 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380273e1-a634-429f-9440-a7acfd265e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:51.158683 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0e44ff-09b8-439e-a396-4d48717964a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:51.159127 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0e44ff-09b8-439e-a396-4d48717964a3 admin admin] PATH_INFO: `/v3/projects/74df445a1bd9475693c955a15d5d9e75/users/6b9275cd6ff645da8ed435e72d8b4d4d/roles/b5cfd7a855a448359e9017f51d32b6fc` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:51.159563 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380273e1-a634-429f-9440-a7acfd265e4d admin admin] PATH_INFO: `/v3/projects/1541f7a0c4ee428e8fba1f383fc02994/users/d409ddbe919e42cf8dfe6831f2105544/roles/a332ef951db949b0bad7019fbd28a1b9` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:51.166665 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380273e1-a634-429f-9440-a7acfd265e4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1541f7a0c4ee428e8fba1f383fc02994, user_id=d409ddbe919e42cf8dfe6831f2105544, role_id=a332ef951db949b0bad7019fbd28a1b9)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:51.182271 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380273e1-a634-429f-9440-a7acfd265e4d admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:51.193718 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0e44ff-09b8-439e-a396-4d48717964a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74df445a1bd9475693c955a15d5d9e75, user_id=6b9275cd6ff645da8ed435e72d8b4d4d, role_id=b5cfd7a855a448359e9017f51d32b6fc)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:51.199909 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0e44ff-09b8-439e-a396-4d48717964a3 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:51.216639 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1175/2325] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:31:51 2022] PUT /identity/v3/projects/1541f7a0c4ee428e8fba1f383fc02994/users/d409ddbe919e42cf8dfe6831f2105544/roles/a332ef951db949b0bad7019fbd28a1b9 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:31:51.220825 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1151/2326] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:31:51 2022] PUT /identity/v3/projects/74df445a1bd9475693c955a15d5d9e75/users/6b9275cd6ff645da8ed435e72d8b4d4d/roles/b5cfd7a855a448359e9017f51d32b6fc => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:31:51.237202 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfd2911-3815-4d16-94b4-3749ef91a865 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:51.237863 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfd2911-3815-4d16-94b4-3749ef91a865 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:51.238256 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfd2911-3815-4d16-94b4-3749ef91a865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:51.241499 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0435905c-0910-4f3d-90b1-fe42b05c28fd None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:51.242210 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0435905c-0910-4f3d-90b1-fe42b05c28fd None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:51.242779 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0435905c-0910-4f3d-90b1-fe42b05c28fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:51.304109 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-fcfd2911-3815-4d16-94b4-3749ef91a865 None None] MFA Rules not processed for user `d409ddbe919e42cf8dfe6831f2105544`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:31:51.305908 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-fcfd2911-3815-4d16-94b4-3749ef91a865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:51.328301 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-0435905c-0910-4f3d-90b1-fe42b05c28fd None None] MFA Rules not processed for user `6b9275cd6ff645da8ed435e72d8b4d4d`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:31:51.330211 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-0435905c-0910-4f3d-90b1-fe42b05c28fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:51.457905 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1152/2327] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:31:51 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:31:51.459901 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1176/2328] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:31:51 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:31:51.473487 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfd2911-3815-4d16-94b4-3749ef91a865 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:51.474805 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0435905c-0910-4f3d-90b1-fe42b05c28fd None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:51.515404 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:51.554292 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0435905c-0910-4f3d-90b1-fe42b05c28fd None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:51.555883 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfd2911-3815-4d16-94b4-3749ef91a865 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:51.558792 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75467219-8f32-4016-89b9-583e1bd215d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e79503178ac54e62ba385467d5617ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:51.559478 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75467219-8f32-4016-89b9-583e1bd215d9 service cinder] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:51.559764 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75467219-8f32-4016-89b9-583e1bd215d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:51.560037 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75467219-8f32-4016-89b9-583e1bd215d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:51.561596 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12d366a-1bbb-466e-82fd-ac49eba6245a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e79503178ac54e62ba385467d5617ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:51.562483 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d366a-1bbb-466e-82fd-ac49eba6245a service cinder] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:51.562939 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d366a-1bbb-466e-82fd-ac49eba6245a service cinder] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:51.563394 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d366a-1bbb-466e-82fd-ac49eba6245a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:51.578188 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12d366a-1bbb-466e-82fd-ac49eba6245a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:51.580560 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12d366a-1bbb-466e-82fd-ac49eba6245a service cinder] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:51.597495 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1153/2329] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:31:51 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:31:51.654908 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75467219-8f32-4016-89b9-583e1bd215d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:51.656780 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75467219-8f32-4016-89b9-583e1bd215d9 service cinder] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:51.668303 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1177/2330] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:31:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:31:56.072164 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12d366a-1bbb-466e-82fd-ac49eba6245a service cinder] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:56.072164 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-a12d366a-1bbb-466e-82fd-ac49eba6245a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:56.174880 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12d366a-1bbb-466e-82fd-ac49eba6245a service cinder] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:56.182104 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ab5188-3cb2-4387-9bef-9a81fc085e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:56.183423 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab5188-3cb2-4387-9bef-9a81fc085e6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:56.183695 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab5188-3cb2-4387-9bef-9a81fc085e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:56.184072 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab5188-3cb2-4387-9bef-9a81fc085e6e admin admin] PATH_INFO: `/v3/users/4577751d8cac4c5c80156962d9174087` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:56.185166 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ab5188-3cb2-4387-9bef-9a81fc085e6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4577751d8cac4c5c80156962d9174087)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:56.187350 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ab5188-3cb2-4387-9bef-9a81fc085e6e admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:56.265474 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-f1ab5188-3cb2-4387-9bef-9a81fc085e6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4577751d8cac4c5c80156962d9174087'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:56.286250 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-f1ab5188-3cb2-4387-9bef-9a81fc085e6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4577751d8cac4c5c80156962d9174087'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:56.287854 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-f1ab5188-3cb2-4387-9bef-9a81fc085e6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4577751d8cac4c5c80156962d9174087'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:56.297737 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-f1ab5188-3cb2-4387-9bef-9a81fc085e6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4577751d8cac4c5c80156962d9174087'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:56.298876 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-f1ab5188-3cb2-4387-9bef-9a81fc085e6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4577751d8cac4c5c80156962d9174087'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:56.318369 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1154/2331] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:31:56 2022] DELETE /identity/v3/users/4577751d8cac4c5c80156962d9174087 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:31:56.323223 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f8c7d-eeea-445c-adb9-4a9305f70cc0 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:56.323737 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f8c7d-eeea-445c-adb9-4a9305f70cc0 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:56.323737 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f8c7d-eeea-445c-adb9-4a9305f70cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:56.356031 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-e46f8c7d-eeea-445c-adb9-4a9305f70cc0 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:31:56.357997 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-e46f8c7d-eeea-445c-adb9-4a9305f70cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:56.418398 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:56.460664 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1178/2332] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:31:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:31:56.471583 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ab5188-3cb2-4387-9bef-9a81fc085e6e admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:56.473393 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-f1ab5188-3cb2-4387-9bef-9a81fc085e6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:56.551356 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ab5188-3cb2-4387-9bef-9a81fc085e6e admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:56.555657 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb8ee9-f73e-47cd-a9a1-57d7daf4a1db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:56.556287 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb8ee9-f73e-47cd-a9a1-57d7daf4a1db service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:56.556568 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb8ee9-f73e-47cd-a9a1-57d7daf4a1db service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:56.556837 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb8ee9-f73e-47cd-a9a1-57d7daf4a1db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:56.563856 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:56.568064 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fb8ee9-f73e-47cd-a9a1-57d7daf4a1db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:56.570295 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fb8ee9-f73e-47cd-a9a1-57d7daf4a1db service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:56.582739 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1155/2333] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:31:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:31:56.933358 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46f8c7d-eeea-445c-adb9-4a9305f70cc0 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:56.936086 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-e46f8c7d-eeea-445c-adb9-4a9305f70cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:56.960507 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46f8c7d-eeea-445c-adb9-4a9305f70cc0 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:56.967966 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cd5206-2b2a-481c-9d9c-146921a4b208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:56.968775 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd5206-2b2a-481c-9d9c-146921a4b208 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:56.969113 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd5206-2b2a-481c-9d9c-146921a4b208 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:56.969477 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd5206-2b2a-481c-9d9c-146921a4b208 admin admin] PATH_INFO: `/v3/projects/57f065ce94f445ee94be3cefa7daeb7d` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:56.971364 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cd5206-2b2a-481c-9d9c-146921a4b208 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57f065ce94f445ee94be3cefa7daeb7d)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:56.975177 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cd5206-2b2a-481c-9d9c-146921a4b208 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:57.034985 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-15cd5206-2b2a-481c-9d9c-146921a4b208 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57f065ce94f445ee94be3cefa7daeb7d', 'request_id': 'req-15cd5206-2b2a-481c-9d9c-146921a4b208'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:57.044415 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-15cd5206-2b2a-481c-9d9c-146921a4b208 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57f065ce94f445ee94be3cefa7daeb7d', 'request_id': 'req-15cd5206-2b2a-481c-9d9c-146921a4b208'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:57.052140 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-15cd5206-2b2a-481c-9d9c-146921a4b208 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57f065ce94f445ee94be3cefa7daeb7d', 'request_id': 'req-15cd5206-2b2a-481c-9d9c-146921a4b208'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:57.065090 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-15cd5206-2b2a-481c-9d9c-146921a4b208 admin admin] The token cache is being invalidate because project 57f065ce94f445ee94be3cefa7daeb7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:31:57.065427 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-15cd5206-2b2a-481c-9d9c-146921a4b208 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:57.066056 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-15cd5206-2b2a-481c-9d9c-146921a4b208 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:57.067642 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1179/2334] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:31:56 2022] DELETE /identity/v3/projects/57f065ce94f445ee94be3cefa7daeb7d => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:31:57.072168 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb8ee9-f73e-47cd-a9a1-57d7daf4a1db service neutron] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:57.084464 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb8ee9-f73e-47cd-a9a1-57d7daf4a1db service neutron] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:57.173163 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccac2e8-3d23-41fe-ade5-82fdbd514a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:57.173825 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccac2e8-3d23-41fe-ade5-82fdbd514a6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:57.174100 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccac2e8-3d23-41fe-ade5-82fdbd514a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:57.174372 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccac2e8-3d23-41fe-ade5-82fdbd514a6e admin admin] PATH_INFO: `/v3/users/444a7b214e94411295458a36631be1ed` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:57.176100 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccac2e8-3d23-41fe-ade5-82fdbd514a6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=444a7b214e94411295458a36631be1ed)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:57.177653 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccac2e8-3d23-41fe-ade5-82fdbd514a6e admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:57.250146 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-7ccac2e8-3d23-41fe-ade5-82fdbd514a6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '444a7b214e94411295458a36631be1ed'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:57.275756 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-7ccac2e8-3d23-41fe-ade5-82fdbd514a6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '444a7b214e94411295458a36631be1ed'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:57.277915 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-7ccac2e8-3d23-41fe-ade5-82fdbd514a6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '444a7b214e94411295458a36631be1ed'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:57.294833 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-7ccac2e8-3d23-41fe-ade5-82fdbd514a6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '444a7b214e94411295458a36631be1ed'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:57.295632 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-7ccac2e8-3d23-41fe-ade5-82fdbd514a6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '444a7b214e94411295458a36631be1ed'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:57.315116 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1156/2335] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:31:57 2022] DELETE /identity/v3/users/444a7b214e94411295458a36631be1ed => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:31:57.666332 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cd5206-2b2a-481c-9d9c-146921a4b208 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:57.669894 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-15cd5206-2b2a-481c-9d9c-146921a4b208 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:57.697416 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cd5206-2b2a-481c-9d9c-146921a4b208 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:57.813062 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eb5365-7379-4e8a-8ab5-cc248856e6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:57.813715 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb5365-7379-4e8a-8ab5-cc248856e6aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:57.813998 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb5365-7379-4e8a-8ab5-cc248856e6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:57.814275 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb5365-7379-4e8a-8ab5-cc248856e6aa admin admin] PATH_INFO: `/v3/projects/91147c6ae0c1432d814a31d1c87713eb` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:57.815527 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eb5365-7379-4e8a-8ab5-cc248856e6aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=91147c6ae0c1432d814a31d1c87713eb)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:57.817457 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eb5365-7379-4e8a-8ab5-cc248856e6aa admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:57.870899 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-f5eb5365-7379-4e8a-8ab5-cc248856e6aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91147c6ae0c1432d814a31d1c87713eb', 'request_id': 'req-f5eb5365-7379-4e8a-8ab5-cc248856e6aa'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:57.879569 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-f5eb5365-7379-4e8a-8ab5-cc248856e6aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91147c6ae0c1432d814a31d1c87713eb', 'request_id': 'req-f5eb5365-7379-4e8a-8ab5-cc248856e6aa'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:57.890518 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-f5eb5365-7379-4e8a-8ab5-cc248856e6aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91147c6ae0c1432d814a31d1c87713eb', 'request_id': 'req-f5eb5365-7379-4e8a-8ab5-cc248856e6aa'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:57.892000 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:57.907408 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-f5eb5365-7379-4e8a-8ab5-cc248856e6aa admin admin] The token cache is being invalidate because project 91147c6ae0c1432d814a31d1c87713eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:31:57.907710 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-f5eb5365-7379-4e8a-8ab5-cc248856e6aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:57.908262 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-f5eb5365-7379-4e8a-8ab5-cc248856e6aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:57.909797 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1180/2336] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:31:57 2022] DELETE /identity/v3/projects/91147c6ae0c1432d814a31d1c87713eb => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:31:57.914345 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccac2e8-3d23-41fe-ade5-82fdbd514a6e admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:57.916246 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-7ccac2e8-3d23-41fe-ade5-82fdbd514a6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:57.931918 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccac2e8-3d23-41fe-ade5-82fdbd514a6e admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:58.013376 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fddda58-cf6e-4dcb-82d8-cf8387a08b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:58.014018 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fddda58-cf6e-4dcb-82d8-cf8387a08b1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:58.014443 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fddda58-cf6e-4dcb-82d8-cf8387a08b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:58.014725 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fddda58-cf6e-4dcb-82d8-cf8387a08b1e admin admin] PATH_INFO: `/v3/users/4c7ce467db5c467ca66c0475f6773840` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:58.015973 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fddda58-cf6e-4dcb-82d8-cf8387a08b1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c7ce467db5c467ca66c0475f6773840)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:58.017918 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fddda58-cf6e-4dcb-82d8-cf8387a08b1e admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:58.033887 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:58.074417 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-0fddda58-cf6e-4dcb-82d8-cf8387a08b1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c7ce467db5c467ca66c0475f6773840'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:58.089127 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-0fddda58-cf6e-4dcb-82d8-cf8387a08b1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c7ce467db5c467ca66c0475f6773840'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:58.090085 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-0fddda58-cf6e-4dcb-82d8-cf8387a08b1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c7ce467db5c467ca66c0475f6773840'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:58.098305 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-0fddda58-cf6e-4dcb-82d8-cf8387a08b1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c7ce467db5c467ca66c0475f6773840'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:58.099136 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-0fddda58-cf6e-4dcb-82d8-cf8387a08b1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c7ce467db5c467ca66c0475f6773840'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:58.115129 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1157/2337] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:31:57 2022] DELETE /identity/v3/users/4c7ce467db5c467ca66c0475f6773840 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:31:58.556557 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eb5365-7379-4e8a-8ab5-cc248856e6aa admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:58.558935 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-f5eb5365-7379-4e8a-8ab5-cc248856e6aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:58.628954 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eb5365-7379-4e8a-8ab5-cc248856e6aa admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:58.737525 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e415a3-7059-4faa-a4a7-ce4971a586f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:58.738268 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e415a3-7059-4faa-a4a7-ce4971a586f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:58.738656 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e415a3-7059-4faa-a4a7-ce4971a586f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:58.739083 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e415a3-7059-4faa-a4a7-ce4971a586f0 admin admin] PATH_INFO: `/v3/projects/23a8f6b89ab24e21b177547e29ec7704` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:58.740778 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e415a3-7059-4faa-a4a7-ce4971a586f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23a8f6b89ab24e21b177547e29ec7704)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:58.743811 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e415a3-7059-4faa-a4a7-ce4971a586f0 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:58.831900 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-75e415a3-7059-4faa-a4a7-ce4971a586f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23a8f6b89ab24e21b177547e29ec7704', 'request_id': 'req-75e415a3-7059-4faa-a4a7-ce4971a586f0'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:58.845861 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-75e415a3-7059-4faa-a4a7-ce4971a586f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23a8f6b89ab24e21b177547e29ec7704', 'request_id': 'req-75e415a3-7059-4faa-a4a7-ce4971a586f0'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:58.856026 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-75e415a3-7059-4faa-a4a7-ce4971a586f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23a8f6b89ab24e21b177547e29ec7704', 'request_id': 'req-75e415a3-7059-4faa-a4a7-ce4971a586f0'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:58.874943 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-75e415a3-7059-4faa-a4a7-ce4971a586f0 admin admin] The token cache is being invalidate because project 23a8f6b89ab24e21b177547e29ec7704 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:31:58.875485 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-75e415a3-7059-4faa-a4a7-ce4971a586f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:58.876785 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-75e415a3-7059-4faa-a4a7-ce4971a586f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:58.879710 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1181/2338] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:31:58 2022] DELETE /identity/v3/projects/23a8f6b89ab24e21b177547e29ec7704 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:31:58.890617 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f728f0-447c-4368-8cfb-0ea690d5f590 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:58.891790 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f728f0-447c-4368-8cfb-0ea690d5f590 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:58.892081 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f728f0-447c-4368-8cfb-0ea690d5f590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:58.914568 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-e5f728f0-447c-4368-8cfb-0ea690d5f590 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:31:58.915920 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-e5f728f0-447c-4368-8cfb-0ea690d5f590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:59.022639 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1158/2339] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:31:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:31:59.036641 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6094291-79de-4ce5-936d-8828d3820ea2 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:59.037030 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6094291-79de-4ce5-936d-8828d3820ea2 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:59.037449 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6094291-79de-4ce5-936d-8828d3820ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:59.045549 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f728f0-447c-4368-8cfb-0ea690d5f590 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:59.047256 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-e5f728f0-447c-4368-8cfb-0ea690d5f590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:59.062742 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f728f0-447c-4368-8cfb-0ea690d5f590 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:59.066425 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-a6094291-79de-4ce5-936d-8828d3820ea2 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:31:59.068064 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-a6094291-79de-4ce5-936d-8828d3820ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:59.068763 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6827b964-d5fc-4c51-9ae3-ff1dc542484c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:59.069915 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6827b964-d5fc-4c51-9ae3-ff1dc542484c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:59.069915 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6827b964-d5fc-4c51-9ae3-ff1dc542484c admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:59.070386 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6827b964-d5fc-4c51-9ae3-ff1dc542484c admin admin] PATH_INFO: `/v3/users/5936728ffd654091959f22f505cb2162` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:59.071512 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6827b964-d5fc-4c51-9ae3-ff1dc542484c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5936728ffd654091959f22f505cb2162)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:59.076845 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6827b964-d5fc-4c51-9ae3-ff1dc542484c admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:59.080822 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1182/2340] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:31:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:31:59.096319 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6094291-79de-4ce5-936d-8828d3820ea2 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:59.113626 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6094291-79de-4ce5-936d-8828d3820ea2 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:59.121227 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a422ced-36b5-4edb-8612-94521f8cbd12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:59.122110 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a422ced-36b5-4edb-8612-94521f8cbd12 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:59.122460 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a422ced-36b5-4edb-8612-94521f8cbd12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:59.122937 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a422ced-36b5-4edb-8612-94521f8cbd12 admin admin] PATH_INFO: `/v3/domains` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:59.124370 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a422ced-36b5-4edb-8612-94521f8cbd12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:31:59.124741 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a422ced-36b5-4edb-8612-94521f8cbd12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:59.127107 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a422ced-36b5-4edb-8612-94521f8cbd12 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:59.148185 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1183/2341] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 12:31:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:31:59.149625 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a422ced-36b5-4edb-8612-94521f8cbd12 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:59.169347 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a422ced-36b5-4edb-8612-94521f8cbd12 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:59.173746 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-6827b964-d5fc-4c51-9ae3-ff1dc542484c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5936728ffd654091959f22f505cb2162'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:59.186500 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5164b8d3-10a3-4f9a-a67b-f452126550a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:59.187161 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5164b8d3-10a3-4f9a-a67b-f452126550a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:59.187561 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5164b8d3-10a3-4f9a-a67b-f452126550a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:59.187736 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5164b8d3-10a3-4f9a-a67b-f452126550a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:59.189801 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5164b8d3-10a3-4f9a-a67b-f452126550a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:59.193256 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5164b8d3-10a3-4f9a-a67b-f452126550a6 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:59.207836 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-6827b964-d5fc-4c51-9ae3-ff1dc542484c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5936728ffd654091959f22f505cb2162'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:59.209345 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-6827b964-d5fc-4c51-9ae3-ff1dc542484c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5936728ffd654091959f22f505cb2162'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:59.224462 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-6827b964-d5fc-4c51-9ae3-ff1dc542484c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5936728ffd654091959f22f505cb2162'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:59.225421 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-6827b964-d5fc-4c51-9ae3-ff1dc542484c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5936728ffd654091959f22f505cb2162'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:59.253785 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1184/2342] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:31:59 2022] POST /identity/v3/projects => generated 375 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:31:59.257273 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1159/2343] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:31:59 2022] DELETE /identity/v3/users/5936728ffd654091959f22f505cb2162 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:31:59.259466 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5164b8d3-10a3-4f9a-a67b-f452126550a6 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:59.264595 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-5164b8d3-10a3-4f9a-a67b-f452126550a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:59.265000 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674cadb1-7da1-4057-8746-961e2bf506c8 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:59.265531 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674cadb1-7da1-4057-8746-961e2bf506c8 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:59.266140 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674cadb1-7da1-4057-8746-961e2bf506c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:59.280798 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:59.306219 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-674cadb1-7da1-4057-8746-961e2bf506c8 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:31:59.309493 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-674cadb1-7da1-4057-8746-961e2bf506c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:59.363756 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:59.409059 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1160/2344] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:31:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:31:59.417454 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5164b8d3-10a3-4f9a-a67b-f452126550a6 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:59.424207 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674cadb1-7da1-4057-8746-961e2bf506c8 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:59.425729 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd01c81-8755-4a2d-ad64-6df3c5721085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:59.426276 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-674cadb1-7da1-4057-8746-961e2bf506c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:59.426957 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd01c81-8755-4a2d-ad64-6df3c5721085 admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:59.427445 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd01c81-8755-4a2d-ad64-6df3c5721085 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:59.427890 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd01c81-8755-4a2d-ad64-6df3c5721085 admin admin] PATH_INFO: `/v3/users` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:59.428699 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd01c81-8755-4a2d-ad64-6df3c5721085 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:59.431260 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd01c81-8755-4a2d-ad64-6df3c5721085 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:59.473413 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1185/2345] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:31:59 2022] POST /identity/v3/users => generated 288 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:31:59.475971 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd01c81-8755-4a2d-ad64-6df3c5721085 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:59.487736 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd01c81-8755-4a2d-ad64-6df3c5721085 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:59.492779 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e32be-01f4-484a-8d1b-9247a8a9a037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:59.493412 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e32be-01f4-484a-8d1b-9247a8a9a037 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:59.493696 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e32be-01f4-484a-8d1b-9247a8a9a037 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:59.493970 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e32be-01f4-484a-8d1b-9247a8a9a037 admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:59.494631 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3e32be-01f4-484a-8d1b-9247a8a9a037 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:59.496544 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3e32be-01f4-484a-8d1b-9247a8a9a037 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:59.512849 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1186/2346] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:31:59 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:31:59.516081 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674cadb1-7da1-4057-8746-961e2bf506c8 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:59.516766 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e32be-01f4-484a-8d1b-9247a8a9a037 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:59.521072 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f6a43f-3986-4325-b50a-7492e4c81ec9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:59.522004 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f6a43f-3986-4325-b50a-7492e4c81ec9 service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:59.522388 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f6a43f-3986-4325-b50a-7492e4c81ec9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:59.522769 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f6a43f-3986-4325-b50a-7492e4c81ec9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:59.536830 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e32be-01f4-484a-8d1b-9247a8a9a037 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:59.537690 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f6a43f-3986-4325-b50a-7492e4c81ec9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:59.539456 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f6a43f-3986-4325-b50a-7492e4c81ec9 service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:59.543618 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f32f5a-984d-4a07-b3e3-8962e3dfae37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:59.544452 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f32f5a-984d-4a07-b3e3-8962e3dfae37 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:59.544743 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f32f5a-984d-4a07-b3e3-8962e3dfae37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:59.545026 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f32f5a-984d-4a07-b3e3-8962e3dfae37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:59.545706 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f32f5a-984d-4a07-b3e3-8962e3dfae37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:59.547574 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f32f5a-984d-4a07-b3e3-8962e3dfae37 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:59.560762 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1161/2347] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:31:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:31:59.573238 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1187/2348] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:31:59 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:31:59.575135 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f6a43f-3986-4325-b50a-7492e4c81ec9 service neutron] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:59.587666 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f6a43f-3986-4325-b50a-7492e4c81ec9 service neutron] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:59.594204 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704a7615-a06c-4a52-9238-9114d4f33659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:59.595111 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a7615-a06c-4a52-9238-9114d4f33659 admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:59.595479 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a7615-a06c-4a52-9238-9114d4f33659 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:59.595882 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a7615-a06c-4a52-9238-9114d4f33659 admin admin] PATH_INFO: `/v3/projects/21f19f1dc2b44f4f9edb5e54431bad8a/users/c181ebe5013e4524be47ca785cd29a1f/roles/b5cfd7a855a448359e9017f51d32b6fc` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:59.618071 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704a7615-a06c-4a52-9238-9114d4f33659 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21f19f1dc2b44f4f9edb5e54431bad8a, user_id=c181ebe5013e4524be47ca785cd29a1f, role_id=b5cfd7a855a448359e9017f51d32b6fc)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:59.621249 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704a7615-a06c-4a52-9238-9114d4f33659 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:59.648407 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1162/2349] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:31:59 2022] PUT /identity/v3/projects/21f19f1dc2b44f4f9edb5e54431bad8a/users/c181ebe5013e4524be47ca785cd29a1f/roles/b5cfd7a855a448359e9017f51d32b6fc => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:31:59.665275 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e159d-68e5-4721-845d-f9e8e2fbc300 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:59.666246 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e159d-68e5-4721-845d-f9e8e2fbc300 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:59.666246 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e159d-68e5-4721-845d-f9e8e2fbc300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:59.716936 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-139e159d-68e5-4721-845d-f9e8e2fbc300 None None] MFA Rules not processed for user `c181ebe5013e4524be47ca785cd29a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:31:59.718178 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-139e159d-68e5-4721-845d-f9e8e2fbc300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:59.827283 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1188/2350] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:31:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:31:59.952997 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704a7615-a06c-4a52-9238-9114d4f33659 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:59.958310 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-704a7615-a06c-4a52-9238-9114d4f33659 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:32:00.084744 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704a7615-a06c-4a52-9238-9114d4f33659 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:32:00.088969 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6ea989-1f9a-4158-a1c9-464c76851049 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e79503178ac54e62ba385467d5617ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:32:00.089608 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6ea989-1f9a-4158-a1c9-464c76851049 service cinder] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:32:00.089886 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6ea989-1f9a-4158-a1c9-464c76851049 service cinder] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:32:00.090152 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6ea989-1f9a-4158-a1c9-464c76851049 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:32:00.112260 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6ea989-1f9a-4158-a1c9-464c76851049 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:32:00.113424 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6ea989-1f9a-4158-a1c9-464c76851049 service cinder] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:32:00.127270 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1163/2351] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:31:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:32:00.143563 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139e159d-68e5-4721-845d-f9e8e2fbc300 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:32:00.145007 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-139e159d-68e5-4721-845d-f9e8e2fbc300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:32:00.272622 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139e159d-68e5-4721-845d-f9e8e2fbc300 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:32:00.278109 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaec9af5-4fea-488b-999a-478cdb4aa48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:32:00.278762 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec9af5-4fea-488b-999a-478cdb4aa48c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:32:00.279652 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec9af5-4fea-488b-999a-478cdb4aa48c admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:32:00.279652 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec9af5-4fea-488b-999a-478cdb4aa48c admin admin] PATH_INFO: `/v3/projects/9b60c65197c44d6ea39a4964e43b66b5` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:32:00.280495 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaec9af5-4fea-488b-999a-478cdb4aa48c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b60c65197c44d6ea39a4964e43b66b5)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:32:00.282489 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaec9af5-4fea-488b-999a-478cdb4aa48c admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:32:00.332318 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:32:00.355131 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-eaec9af5-4fea-488b-999a-478cdb4aa48c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b60c65197c44d6ea39a4964e43b66b5', 'request_id': 'req-eaec9af5-4fea-488b-999a-478cdb4aa48c'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:32:00.367953 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-eaec9af5-4fea-488b-999a-478cdb4aa48c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b60c65197c44d6ea39a4964e43b66b5', 'request_id': 'req-eaec9af5-4fea-488b-999a-478cdb4aa48c'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:32:00.378032 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-eaec9af5-4fea-488b-999a-478cdb4aa48c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b60c65197c44d6ea39a4964e43b66b5', 'request_id': 'req-eaec9af5-4fea-488b-999a-478cdb4aa48c'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:32:00.392578 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-eaec9af5-4fea-488b-999a-478cdb4aa48c admin admin] The token cache is being invalidate because project 9b60c65197c44d6ea39a4964e43b66b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:32:00.393251 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-eaec9af5-4fea-488b-999a-478cdb4aa48c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:32:00.393946 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-eaec9af5-4fea-488b-999a-478cdb4aa48c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:32:00.395688 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1189/2352] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:32:00 2022] DELETE /identity/v3/projects/9b60c65197c44d6ea39a4964e43b66b5 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:32:00.399876 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6ea989-1f9a-4158-a1c9-464c76851049 service cinder] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:32:00.413772 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6ea989-1f9a-4158-a1c9-464c76851049 service cinder] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:32:00.459734 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:32:00.501709 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed4bf8d-d7d8-44b0-8e14-95b3cd6493b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:32:00.502380 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed4bf8d-d7d8-44b0-8e14-95b3cd6493b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:32:00.502819 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed4bf8d-d7d8-44b0-8e14-95b3cd6493b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:32:00.503031 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed4bf8d-d7d8-44b0-8e14-95b3cd6493b0 admin admin] PATH_INFO: `/v3/users/d409ddbe919e42cf8dfe6831f2105544` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:32:00.504402 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed4bf8d-d7d8-44b0-8e14-95b3cd6493b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d409ddbe919e42cf8dfe6831f2105544)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:32:00.506447 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed4bf8d-d7d8-44b0-8e14-95b3cd6493b0 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:32:00.570377 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-3ed4bf8d-d7d8-44b0-8e14-95b3cd6493b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd409ddbe919e42cf8dfe6831f2105544'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:32:00.598034 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-3ed4bf8d-d7d8-44b0-8e14-95b3cd6493b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd409ddbe919e42cf8dfe6831f2105544'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:32:00.598800 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-3ed4bf8d-d7d8-44b0-8e14-95b3cd6493b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd409ddbe919e42cf8dfe6831f2105544'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:32:00.607165 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-3ed4bf8d-d7d8-44b0-8e14-95b3cd6493b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd409ddbe919e42cf8dfe6831f2105544'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:32:00.608070 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-3ed4bf8d-d7d8-44b0-8e14-95b3cd6493b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd409ddbe919e42cf8dfe6831f2105544'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:32:00.623166 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1164/2353] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:32:00 2022] DELETE /identity/v3/users/d409ddbe919e42cf8dfe6831f2105544 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:32:00.917620 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaec9af5-4fea-488b-999a-478cdb4aa48c admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:32:00.919256 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-eaec9af5-4fea-488b-999a-478cdb4aa48c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:32:00.945309 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaec9af5-4fea-488b-999a-478cdb4aa48c admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:32:01.027740 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef22368-84ca-4d9e-ba3f-59e3abd1345e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:32:01.028384 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef22368-84ca-4d9e-ba3f-59e3abd1345e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:32:01.028668 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef22368-84ca-4d9e-ba3f-59e3abd1345e admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:32:01.028937 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef22368-84ca-4d9e-ba3f-59e3abd1345e admin admin] PATH_INFO: `/v3/projects/1541f7a0c4ee428e8fba1f383fc02994` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:32:01.030089 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef22368-84ca-4d9e-ba3f-59e3abd1345e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1541f7a0c4ee428e8fba1f383fc02994)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:32:01.032353 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef22368-84ca-4d9e-ba3f-59e3abd1345e admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:32:01.112890 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-bef22368-84ca-4d9e-ba3f-59e3abd1345e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1541f7a0c4ee428e8fba1f383fc02994', 'request_id': 'req-bef22368-84ca-4d9e-ba3f-59e3abd1345e'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:32:01.140646 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-bef22368-84ca-4d9e-ba3f-59e3abd1345e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1541f7a0c4ee428e8fba1f383fc02994', 'request_id': 'req-bef22368-84ca-4d9e-ba3f-59e3abd1345e'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:32:01.161402 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-bef22368-84ca-4d9e-ba3f-59e3abd1345e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1541f7a0c4ee428e8fba1f383fc02994', 'request_id': 'req-bef22368-84ca-4d9e-ba3f-59e3abd1345e'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:32:01.194164 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-bef22368-84ca-4d9e-ba3f-59e3abd1345e admin admin] The token cache is being invalidate because project 1541f7a0c4ee428e8fba1f383fc02994 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:32:01.194465 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-bef22368-84ca-4d9e-ba3f-59e3abd1345e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:32:01.195203 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-bef22368-84ca-4d9e-ba3f-59e3abd1345e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:32:01.197596 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1190/2354] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:32:00 2022] DELETE /identity/v3/projects/1541f7a0c4ee428e8fba1f383fc02994 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:32:01.203083 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3cfe2d-a3da-4849-8270-8318a96f55fb None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:32:01.203889 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3cfe2d-a3da-4849-8270-8318a96f55fb None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:32:01.203889 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3cfe2d-a3da-4849-8270-8318a96f55fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:32:01.226376 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-5c3cfe2d-a3da-4849-8270-8318a96f55fb None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:32:01.227883 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-5c3cfe2d-a3da-4849-8270-8318a96f55fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:32:01.309740 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1165/2355] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:32:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:32:01.319558 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23d3642-6c08-45b7-b4e6-8aaa53b66840 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:32:01.319926 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23d3642-6c08-45b7-b4e6-8aaa53b66840 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:32:01.320284 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23d3642-6c08-45b7-b4e6-8aaa53b66840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:32:01.344330 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-f23d3642-6c08-45b7-b4e6-8aaa53b66840 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:32:01.345821 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-f23d3642-6c08-45b7-b4e6-8aaa53b66840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:32:01.365354 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1191/2356] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:32:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:32:01.372517 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3cfe2d-a3da-4849-8270-8318a96f55fb None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:32:01.383821 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3cfe2d-a3da-4849-8270-8318a96f55fb None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:32:01.390414 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbcb301-47fc-448b-af34-f911535a0c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:32:01.391094 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbcb301-47fc-448b-af34-f911535a0c9c admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:32:01.391377 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbcb301-47fc-448b-af34-f911535a0c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:32:01.391652 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbcb301-47fc-448b-af34-f911535a0c9c admin admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:32:01.392343 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbcb301-47fc-448b-af34-f911535a0c9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:32:01.392650 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbcb301-47fc-448b-af34-f911535a0c9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:32:01.394282 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbcb301-47fc-448b-af34-f911535a0c9c admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:32:01.408502 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1166/2357] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 12:32:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:32:01.413105 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23d3642-6c08-45b7-b4e6-8aaa53b66840 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:32:01.425599 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23d3642-6c08-45b7-b4e6-8aaa53b66840 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:32:01.430457 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0af5a9-9c94-4806-b57a-90e65b39c294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:32:01.431123 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0af5a9-9c94-4806-b57a-90e65b39c294 admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:32:01.431409 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0af5a9-9c94-4806-b57a-90e65b39c294 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:32:01.431679 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0af5a9-9c94-4806-b57a-90e65b39c294 admin admin] PATH_INFO: `/v3/projects` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:32:01.432410 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0af5a9-9c94-4806-b57a-90e65b39c294 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:32:01.435590 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0af5a9-9c94-4806-b57a-90e65b39c294 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:32:01.469349 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1192/2358] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:32:01 2022] POST /identity/v3/projects => generated 375 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:32:01.473733 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbcb301-47fc-448b-af34-f911535a0c9c admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:32:01.486283 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbcb301-47fc-448b-af34-f911535a0c9c admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:32:01.540419 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:32:01.582023 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1b253f-2f55-463f-baf3-c35d41df9ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:32:01.582669 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1b253f-2f55-463f-baf3-c35d41df9ae0 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:32:01.583009 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1b253f-2f55-463f-baf3-c35d41df9ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:32:01.583266 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1b253f-2f55-463f-baf3-c35d41df9ae0 admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:32:01.583919 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1b253f-2f55-463f-baf3-c35d41df9ae0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:32:01.585974 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1b253f-2f55-463f-baf3-c35d41df9ae0 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:32:01.618802 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1167/2359] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:32:01 2022] POST /identity/v3/users => generated 288 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:32:01.623796 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0af5a9-9c94-4806-b57a-90e65b39c294 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:32:01.640234 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0af5a9-9c94-4806-b57a-90e65b39c294 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:32:01.648860 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59c1aad-8b0a-440c-b949-89a6a2b09722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:32:01.650243 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c1aad-8b0a-440c-b949-89a6a2b09722 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:32:01.650881 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c1aad-8b0a-440c-b949-89a6a2b09722 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:32:01.651732 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c1aad-8b0a-440c-b949-89a6a2b09722 admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:32:01.653083 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59c1aad-8b0a-440c-b949-89a6a2b09722 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:32:01.656680 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59c1aad-8b0a-440c-b949-89a6a2b09722 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:32:01.677708 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1193/2360] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:32:01 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:32:01.679627 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1b253f-2f55-463f-baf3-c35d41df9ae0 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:32:01.690723 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1b253f-2f55-463f-baf3-c35d41df9ae0 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:32:01.695842 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dd3fcf-2c5c-4f56-bb12-1f6ff2555cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:32:01.696479 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd3fcf-2c5c-4f56-bb12-1f6ff2555cd3 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:32:01.696761 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd3fcf-2c5c-4f56-bb12-1f6ff2555cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:32:01.697036 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd3fcf-2c5c-4f56-bb12-1f6ff2555cd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:32:01.697698 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dd3fcf-2c5c-4f56-bb12-1f6ff2555cd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:32:01.700276 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dd3fcf-2c5c-4f56-bb12-1f6ff2555cd3 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:32:01.711266 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1168/2361] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:32:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 12:32:01.717064 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59c1aad-8b0a-440c-b949-89a6a2b09722 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:32:01.736440 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59c1aad-8b0a-440c-b949-89a6a2b09722 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:32:01.745679 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5d8249-ff03-4a5a-8452-e2c354782491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:32:01.746840 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d8249-ff03-4a5a-8452-e2c354782491 admin admin] REQUEST_METHOD: `PUT` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:32:01.747381 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d8249-ff03-4a5a-8452-e2c354782491 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:32:01.747870 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d8249-ff03-4a5a-8452-e2c354782491 admin admin] PATH_INFO: `/v3/projects/b364169c30154cc8af7c9a37bebc8040/users/2e77671c123f434489d82da79212d0ab/roles/b5cfd7a855a448359e9017f51d32b6fc` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:32:01.764714 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:32:01.769043 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5d8249-ff03-4a5a-8452-e2c354782491 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b364169c30154cc8af7c9a37bebc8040, user_id=2e77671c123f434489d82da79212d0ab, role_id=b5cfd7a855a448359e9017f51d32b6fc)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:32:01.772920 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5d8249-ff03-4a5a-8452-e2c354782491 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:32:01.791137 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1194/2362] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:32:01 2022] PUT /identity/v3/projects/b364169c30154cc8af7c9a37bebc8040/users/2e77671c123f434489d82da79212d0ab/roles/b5cfd7a855a448359e9017f51d32b6fc => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:32:01.796219 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e69994-edfc-4d13-a514-725794e1023b None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:32:01.796504 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e69994-edfc-4d13-a514-725794e1023b None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:32:01.796822 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e69994-edfc-4d13-a514-725794e1023b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:32:01.819587 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-77e69994-edfc-4d13-a514-725794e1023b None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:32:01.820806 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-77e69994-edfc-4d13-a514-725794e1023b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:32:01.891516 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1169/2363] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:32:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:32:01.903963 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5d8249-ff03-4a5a-8452-e2c354782491 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:32:01.906068 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-9e5d8249-ff03-4a5a-8452-e2c354782491 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:32:01.971717 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5d8249-ff03-4a5a-8452-e2c354782491 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:32:01.977639 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5131764-826a-4c31-b5c2-166f73bf9b6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:32:01.978645 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5131764-826a-4c31-b5c2-166f73bf9b6c service neutron] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:32:01.979226 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5131764-826a-4c31-b5c2-166f73bf9b6c service neutron] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:32:01.979568 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5131764-826a-4c31-b5c2-166f73bf9b6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:32:01.989988 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5131764-826a-4c31-b5c2-166f73bf9b6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:32:01.991492 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5131764-826a-4c31-b5c2-166f73bf9b6c service neutron] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:32:02.002090 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1195/2364] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:32:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:32:10.642191 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaedcfd-3fa6-41e4-b4e7-9a75733f9ed3 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:32:10.643124 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaedcfd-3fa6-41e4-b4e7-9a75733f9ed3 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:32:10.643567 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaedcfd-3fa6-41e4-b4e7-9a75733f9ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:32:10.678661 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-dcaedcfd-3fa6-41e4-b4e7-9a75733f9ed3 None None] MFA Rules not processed for user `2e77671c123f434489d82da79212d0ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:32:10.680706 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-dcaedcfd-3fa6-41e4-b4e7-9a75733f9ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:32:10.808703 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5131764-826a-4c31-b5c2-166f73bf9b6c service neutron] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:32:10.811093 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1170/2365] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:32:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:32:10.820586 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5131764-826a-4c31-b5c2-166f73bf9b6c service neutron] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:32:10.827680 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b39d9b5-0a75-4c4f-a663-249df893e599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:32:10.828777 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b39d9b5-0a75-4c4f-a663-249df893e599 admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:32:10.829522 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b39d9b5-0a75-4c4f-a663-249df893e599 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:32:10.830010 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b39d9b5-0a75-4c4f-a663-249df893e599 admin admin] PATH_INFO: `/v3/projects` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:32:10.830699 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b39d9b5-0a75-4c4f-a663-249df893e599 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:32:10.832876 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b39d9b5-0a75-4c4f-a663-249df893e599 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:32:10.874586 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1196/2366] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:32:10 2022] POST /identity/v3/projects => generated 377 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:32:10.879644 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaedcfd-3fa6-41e4-b4e7-9a75733f9ed3 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:32:10.896440 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaedcfd-3fa6-41e4-b4e7-9a75733f9ed3 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:32:10.984252 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:32:11.011941 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488fab56-7b8f-4841-99de-46bde1e2a1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:32:11.013199 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488fab56-7b8f-4841-99de-46bde1e2a1bb admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:32:11.013659 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488fab56-7b8f-4841-99de-46bde1e2a1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:32:11.014088 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488fab56-7b8f-4841-99de-46bde1e2a1bb admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:32:11.015372 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488fab56-7b8f-4841-99de-46bde1e2a1bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:32:11.017921 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488fab56-7b8f-4841-99de-46bde1e2a1bb admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:32:11.045694 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1171/2367] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:32:10 2022] POST /identity/v3/users => generated 295 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:32:11.052147 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b39d9b5-0a75-4c4f-a663-249df893e599 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:32:11.066923 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b39d9b5-0a75-4c4f-a663-249df893e599 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:32:11.072208 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ef4f51-f0c8-4451-9179-49c79710928b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:32:11.073711 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef4f51-f0c8-4451-9179-49c79710928b admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:32:11.074223 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef4f51-f0c8-4451-9179-49c79710928b admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:32:11.074695 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef4f51-f0c8-4451-9179-49c79710928b admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:32:11.077447 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ef4f51-f0c8-4451-9179-49c79710928b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:32:11.079573 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ef4f51-f0c8-4451-9179-49c79710928b admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:32:11.101749 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1197/2368] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:32:11 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:32:11.113318 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488fab56-7b8f-4841-99de-46bde1e2a1bb admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:32:11.128928 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488fab56-7b8f-4841-99de-46bde1e2a1bb admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:32:11.141838 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc58af9b-6f52-4d1a-92fa-f83f644ee78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:32:11.142480 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc58af9b-6f52-4d1a-92fa-f83f644ee78b admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:32:11.142761 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc58af9b-6f52-4d1a-92fa-f83f644ee78b admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:32:11.143080 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc58af9b-6f52-4d1a-92fa-f83f644ee78b admin admin] PATH_INFO: `/v3/projects/10514b67cfa543949fa29fcc752f7b51/users/93b517b50ee34de492e7b30795dee1f6/roles/a332ef951db949b0bad7019fbd28a1b9` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:32:11.167271 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc58af9b-6f52-4d1a-92fa-f83f644ee78b admin admin] RBAC: Authorizing `identity:create_grant(project_id=10514b67cfa543949fa29fcc752f7b51, user_id=93b517b50ee34de492e7b30795dee1f6, role_id=a332ef951db949b0bad7019fbd28a1b9)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:32:11.170268 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc58af9b-6f52-4d1a-92fa-f83f644ee78b admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:32:11.208648 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1172/2369] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:32:11 2022] PUT /identity/v3/projects/10514b67cfa543949fa29fcc752f7b51/users/93b517b50ee34de492e7b30795dee1f6/roles/a332ef951db949b0bad7019fbd28a1b9 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:32:11.212759 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ef4f51-f0c8-4451-9179-49c79710928b admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:32:11.230128 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ef4f51-f0c8-4451-9179-49c79710928b admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:32:11.429265 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cb97a1-3e81-434b-8a13-f6e6258a7dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:32:11.429900 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb97a1-3e81-434b-8a13-f6e6258a7dca admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:32:11.430179 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb97a1-3e81-434b-8a13-f6e6258a7dca admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:32:11.430455 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb97a1-3e81-434b-8a13-f6e6258a7dca admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:32:11.432019 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cb97a1-3e81-434b-8a13-f6e6258a7dca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:32:11.433080 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cb97a1-3e81-434b-8a13-f6e6258a7dca admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:32:11.466020 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1198/2370] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:32:11 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:32:11.471668 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc58af9b-6f52-4d1a-92fa-f83f644ee78b admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:32:11.486184 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc58af9b-6f52-4d1a-92fa-f83f644ee78b admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:32:11.505407 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4a81a5-f74a-450c-9e2e-c3cbc5216c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:32:11.506408 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a81a5-f74a-450c-9e2e-c3cbc5216c55 admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:32:11.506881 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a81a5-f74a-450c-9e2e-c3cbc5216c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:32:11.507512 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a81a5-f74a-450c-9e2e-c3cbc5216c55 admin admin] PATH_INFO: `/v3/projects/10514b67cfa543949fa29fcc752f7b51/users/93b517b50ee34de492e7b30795dee1f6/roles/a332ef951db949b0bad7019fbd28a1b9` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:32:11.525680 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4a81a5-f74a-450c-9e2e-c3cbc5216c55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10514b67cfa543949fa29fcc752f7b51, user_id=93b517b50ee34de492e7b30795dee1f6, role_id=a332ef951db949b0bad7019fbd28a1b9)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:32:11.540979 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4a81a5-f74a-450c-9e2e-c3cbc5216c55 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:32:11.584270 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1173/2371] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:32:11 2022] PUT /identity/v3/projects/10514b67cfa543949fa29fcc752f7b51/users/93b517b50ee34de492e7b30795dee1f6/roles/a332ef951db949b0bad7019fbd28a1b9 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:32:13.356800 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7925d12c-ad72-47a2-b77e-9e0bf10c1656 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:32:13.356800 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7925d12c-ad72-47a2-b77e-9e0bf10c1656 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:32:13.356800 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7925d12c-ad72-47a2-b77e-9e0bf10c1656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:32:13.378249 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-7925d12c-ad72-47a2-b77e-9e0bf10c1656 None None] MFA Rules not processed for user `149aa48acd504354a1d021885ca51334`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:32:13.379542 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-7925d12c-ad72-47a2-b77e-9e0bf10c1656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:32:13.481777 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1199/2372] 10.222.0.79 () {58 vars in 1009 bytes} [Wed Aug 31 12:32:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:32:13.552181 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4a81a5-f74a-450c-9e2e-c3cbc5216c55 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:32:13.564447 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-fd4a81a5-f74a-450c-9e2e-c3cbc5216c55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:32:13.898363 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4a81a5-f74a-450c-9e2e-c3cbc5216c55 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:32:13.915084 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a78b24-3c0b-4404-be64-739e52b9c254 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896540cc14f40b08d05ade32cfd0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:32:13.916158 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a78b24-3c0b-4404-be64-739e52b9c254 service swift] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:32:13.916655 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a78b24-3c0b-4404-be64-739e52b9c254 service swift] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:32:13.917120 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a78b24-3c0b-4404-be64-739e52b9c254 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:32:13.950176 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a78b24-3c0b-4404-be64-739e52b9c254 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:32:13.952101 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a78b24-3c0b-4404-be64-739e52b9c254 service swift] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:32:13.963144 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1174/2373] 10.222.0.79 () {60 vars in 1384 bytes} [Wed Aug 31 12:32:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 12:32:14.715709 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7925d12c-ad72-47a2-b77e-9e0bf10c1656 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:32:14.717795 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-7925d12c-ad72-47a2-b77e-9e0bf10c1656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:32:14.725377 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:32:15.002862 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7925d12c-ad72-47a2-b77e-9e0bf10c1656 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:32:15.017039 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60088c6-c942-42e2-8354-275475bc844e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:32:15.017994 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60088c6-c942-42e2-8354-275475bc844e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:32:15.018275 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60088c6-c942-42e2-8354-275475bc844e admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:32:15.018543 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60088c6-c942-42e2-8354-275475bc844e admin admin] PATH_INFO: `/v3/users/6b9275cd6ff645da8ed435e72d8b4d4d` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:32:15.021439 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60088c6-c942-42e2-8354-275475bc844e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b9275cd6ff645da8ed435e72d8b4d4d)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:32:15.037694 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60088c6-c942-42e2-8354-275475bc844e admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:32:15.257954 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-c60088c6-c942-42e2-8354-275475bc844e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b9275cd6ff645da8ed435e72d8b4d4d'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:32:15.357547 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-c60088c6-c942-42e2-8354-275475bc844e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b9275cd6ff645da8ed435e72d8b4d4d'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:32:15.440223 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-c60088c6-c942-42e2-8354-275475bc844e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b9275cd6ff645da8ed435e72d8b4d4d'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:32:15.447632 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-c60088c6-c942-42e2-8354-275475bc844e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b9275cd6ff645da8ed435e72d8b4d4d'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:32:15.488064 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-c60088c6-c942-42e2-8354-275475bc844e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b9275cd6ff645da8ed435e72d8b4d4d'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:32:15.552215 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1200/2374] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:32:14 2022] DELETE /identity/v3/users/6b9275cd6ff645da8ed435e72d8b4d4d => generated 0 bytes in 837 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:32:15.558740 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ad4a6-9046-440e-919b-8eafe5ae388a None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:32:15.560275 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ad4a6-9046-440e-919b-8eafe5ae388a None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:32:15.560907 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ad4a6-9046-440e-919b-8eafe5ae388a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:32:15.610219 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-b02ad4a6-9046-440e-919b-8eafe5ae388a None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:32:15.613253 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-b02ad4a6-9046-440e-919b-8eafe5ae388a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:32:15.758006 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1175/2375] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:32:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:32:15.774544 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60088c6-c942-42e2-8354-275475bc844e admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:32:15.782561 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-c60088c6-c942-42e2-8354-275475bc844e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:32:15.952393 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60088c6-c942-42e2-8354-275475bc844e admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:32:15.970687 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1424e4bf-09fe-4dab-afbf-dbba06faf068 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:32:15.972351 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424e4bf-09fe-4dab-afbf-dbba06faf068 service neutron] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:32:15.973578 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424e4bf-09fe-4dab-afbf-dbba06faf068 service neutron] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:32:15.974154 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424e4bf-09fe-4dab-afbf-dbba06faf068 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:32:16.025321 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1424e4bf-09fe-4dab-afbf-dbba06faf068 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:32:16.033841 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1424e4bf-09fe-4dab-afbf-dbba06faf068 service neutron] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:32:16.102185 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1201/2376] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:32:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:32:16.845249 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02ad4a6-9046-440e-919b-8eafe5ae388a None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:32:16.849160 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-b02ad4a6-9046-440e-919b-8eafe5ae388a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:32:16.906805 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02ad4a6-9046-440e-919b-8eafe5ae388a None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:32:16.919327 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9b111e-ed81-4d6b-9c17-415d17f6db3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:32:16.919912 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b111e-ed81-4d6b-9c17-415d17f6db3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:32:16.920369 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b111e-ed81-4d6b-9c17-415d17f6db3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:32:16.920643 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b111e-ed81-4d6b-9c17-415d17f6db3f admin admin] PATH_INFO: `/v3/projects/74df445a1bd9475693c955a15d5d9e75` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:32:16.922646 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9b111e-ed81-4d6b-9c17-415d17f6db3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=74df445a1bd9475693c955a15d5d9e75)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:32:16.926890 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9b111e-ed81-4d6b-9c17-415d17f6db3f admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:32:16.984616 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:32:17.027576 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-bc9b111e-ed81-4d6b-9c17-415d17f6db3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74df445a1bd9475693c955a15d5d9e75', 'request_id': 'req-bc9b111e-ed81-4d6b-9c17-415d17f6db3f'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:32:17.053652 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-bc9b111e-ed81-4d6b-9c17-415d17f6db3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74df445a1bd9475693c955a15d5d9e75', 'request_id': 'req-bc9b111e-ed81-4d6b-9c17-415d17f6db3f'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:32:17.074883 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-bc9b111e-ed81-4d6b-9c17-415d17f6db3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74df445a1bd9475693c955a15d5d9e75', 'request_id': 'req-bc9b111e-ed81-4d6b-9c17-415d17f6db3f'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:32:17.094721 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-bc9b111e-ed81-4d6b-9c17-415d17f6db3f admin admin] The token cache is being invalidate because project 74df445a1bd9475693c955a15d5d9e75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:32:17.095342 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-bc9b111e-ed81-4d6b-9c17-415d17f6db3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:32:17.096536 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-bc9b111e-ed81-4d6b-9c17-415d17f6db3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:32:17.099129 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1176/2377] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:32:16 2022] DELETE /identity/v3/projects/74df445a1bd9475693c955a15d5d9e75 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:32:21.497424 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1424e4bf-09fe-4dab-afbf-dbba06faf068 service neutron] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:32:21.500697 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-1424e4bf-09fe-4dab-afbf-dbba06faf068 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:32:21.529017 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1424e4bf-09fe-4dab-afbf-dbba06faf068 service neutron] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:32:21.617641 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:32:21.814347 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee095660-773c-44ed-afd8-5cfb80a64901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:32:21.814824 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee095660-773c-44ed-afd8-5cfb80a64901 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:32:21.815125 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee095660-773c-44ed-afd8-5cfb80a64901 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:32:21.815403 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee095660-773c-44ed-afd8-5cfb80a64901 admin admin] PATH_INFO: `/v3/users/c181ebe5013e4524be47ca785cd29a1f` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:32:21.816751 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee095660-773c-44ed-afd8-5cfb80a64901 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c181ebe5013e4524be47ca785cd29a1f)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:32:21.818789 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee095660-773c-44ed-afd8-5cfb80a64901 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:32:21.910271 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-ee095660-773c-44ed-afd8-5cfb80a64901 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c181ebe5013e4524be47ca785cd29a1f'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:32:21.949377 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-ee095660-773c-44ed-afd8-5cfb80a64901 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c181ebe5013e4524be47ca785cd29a1f'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:32:21.966271 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-ee095660-773c-44ed-afd8-5cfb80a64901 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c181ebe5013e4524be47ca785cd29a1f'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:32:21.967091 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-ee095660-773c-44ed-afd8-5cfb80a64901 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c181ebe5013e4524be47ca785cd29a1f'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:32:21.977791 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-ee095660-773c-44ed-afd8-5cfb80a64901 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c181ebe5013e4524be47ca785cd29a1f'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:32:21.999598 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1202/2378] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:32:21 2022] DELETE /identity/v3/users/c181ebe5013e4524be47ca785cd29a1f => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:32:22.031906 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d7f24-48b6-463a-97e5-ddcdcf363ff5 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:32:22.033893 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d7f24-48b6-463a-97e5-ddcdcf363ff5 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:32:22.036375 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d7f24-48b6-463a-97e5-ddcdcf363ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:32:22.111749 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-5e3d7f24-48b6-463a-97e5-ddcdcf363ff5 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:32:22.113097 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-5e3d7f24-48b6-463a-97e5-ddcdcf363ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:32:22.259161 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1177/2379] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:32:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:32:22.286442 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee095660-773c-44ed-afd8-5cfb80a64901 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:32:22.288318 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-ee095660-773c-44ed-afd8-5cfb80a64901 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:32:22.423514 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee095660-773c-44ed-afd8-5cfb80a64901 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:32:22.427606 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4dadb5-519b-46aa-b2e7-28f3040e59d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:32:22.428248 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4dadb5-519b-46aa-b2e7-28f3040e59d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:32:22.428658 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4dadb5-519b-46aa-b2e7-28f3040e59d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:32:22.429128 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4dadb5-519b-46aa-b2e7-28f3040e59d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:32:22.453007 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4dadb5-519b-46aa-b2e7-28f3040e59d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:32:22.455078 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4dadb5-519b-46aa-b2e7-28f3040e59d6 service neutron] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:32:22.488406 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1203/2380] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:32:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:32:23.067426 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d7f24-48b6-463a-97e5-ddcdcf363ff5 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:32:23.069953 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-5e3d7f24-48b6-463a-97e5-ddcdcf363ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:32:23.099336 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d7f24-48b6-463a-97e5-ddcdcf363ff5 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:32:23.113542 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b5e973-f440-4656-aac7-c60304929514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:32:23.114283 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b5e973-f440-4656-aac7-c60304929514 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:32:23.114575 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b5e973-f440-4656-aac7-c60304929514 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:32:23.114841 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b5e973-f440-4656-aac7-c60304929514 admin admin] PATH_INFO: `/v3/projects/21f19f1dc2b44f4f9edb5e54431bad8a` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:32:23.116839 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b5e973-f440-4656-aac7-c60304929514 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21f19f1dc2b44f4f9edb5e54431bad8a)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:32:23.121879 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b5e973-f440-4656-aac7-c60304929514 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:32:23.320280 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-41b5e973-f440-4656-aac7-c60304929514 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21f19f1dc2b44f4f9edb5e54431bad8a', 'request_id': 'req-41b5e973-f440-4656-aac7-c60304929514'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:32:23.340236 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-41b5e973-f440-4656-aac7-c60304929514 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21f19f1dc2b44f4f9edb5e54431bad8a', 'request_id': 'req-41b5e973-f440-4656-aac7-c60304929514'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:32:23.371322 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-41b5e973-f440-4656-aac7-c60304929514 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21f19f1dc2b44f4f9edb5e54431bad8a', 'request_id': 'req-41b5e973-f440-4656-aac7-c60304929514'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:32:23.412695 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-41b5e973-f440-4656-aac7-c60304929514 admin admin] The token cache is being invalidate because project 21f19f1dc2b44f4f9edb5e54431bad8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:32:23.412991 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-41b5e973-f440-4656-aac7-c60304929514 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:32:23.419706 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-41b5e973-f440-4656-aac7-c60304929514 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:32:23.435106 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1178/2381] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:32:23 2022] DELETE /identity/v3/projects/21f19f1dc2b44f4f9edb5e54431bad8a => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:32:24.024356 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4dadb5-519b-46aa-b2e7-28f3040e59d6 service neutron] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:32:24.028639 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-7e4dadb5-519b-46aa-b2e7-28f3040e59d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:32:24.065774 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4dadb5-519b-46aa-b2e7-28f3040e59d6 service neutron] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:32:24.122136 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b4e85a-8c8a-484b-af50-454a7cd3f132 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:32:24.123165 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b4e85a-8c8a-484b-af50-454a7cd3f132 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:32:24.123915 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b4e85a-8c8a-484b-af50-454a7cd3f132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:32:24.227417 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:32:24.237968 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-85b4e85a-8c8a-484b-af50-454a7cd3f132 None None] MFA Rules not processed for user `93b517b50ee34de492e7b30795dee1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:32:24.240375 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-85b4e85a-8c8a-484b-af50-454a7cd3f132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:32:24.287468 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:32:24.291597 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c0185a-42ae-4408-b7aa-fe81ad68ad8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:32:24.292571 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c0185a-42ae-4408-b7aa-fe81ad68ad8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:32:24.293017 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c0185a-42ae-4408-b7aa-fe81ad68ad8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:32:24.293303 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c0185a-42ae-4408-b7aa-fe81ad68ad8e admin admin] PATH_INFO: `/v3/users/593a439e318c42a98246c80883ed190d` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:32:24.300596 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c0185a-42ae-4408-b7aa-fe81ad68ad8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=593a439e318c42a98246c80883ed190d)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:32:24.302884 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c0185a-42ae-4408-b7aa-fe81ad68ad8e admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:32:24.469023 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-06c0185a-42ae-4408-b7aa-fe81ad68ad8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '593a439e318c42a98246c80883ed190d'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:32:24.504833 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-06c0185a-42ae-4408-b7aa-fe81ad68ad8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '593a439e318c42a98246c80883ed190d'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:32:24.521017 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1179/2382] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:32:24 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:32:24.523448 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a9cb7-42b9-4039-a503-9f3979cd4e6f None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:32:24.524319 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a9cb7-42b9-4039-a503-9f3979cd4e6f None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:32:24.524829 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a9cb7-42b9-4039-a503-9f3979cd4e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:32:24.541223 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-06c0185a-42ae-4408-b7aa-fe81ad68ad8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '593a439e318c42a98246c80883ed190d'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:32:24.543298 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-06c0185a-42ae-4408-b7aa-fe81ad68ad8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '593a439e318c42a98246c80883ed190d'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:32:24.563427 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-06c0185a-42ae-4408-b7aa-fe81ad68ad8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '593a439e318c42a98246c80883ed190d'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:32:24.565450 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-f11a9cb7-42b9-4039-a503-9f3979cd4e6f None None] MFA Rules not processed for user `64886d73c79649d1a824170a33f53fcb`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:32:24.567388 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-f11a9cb7-42b9-4039-a503-9f3979cd4e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:32:24.584061 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1204/2383] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:32:24 2022] DELETE /identity/v3/users/593a439e318c42a98246c80883ed190d => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:32:24.584061 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c0185a-42ae-4408-b7aa-fe81ad68ad8e admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:32:24.585673 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-06c0185a-42ae-4408-b7aa-fe81ad68ad8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:32:24.671489 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1180/2384] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:32:24 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:32:24.683571 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ce743-185a-4850-b7b6-fb6d1e3b68d1 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:32:24.683860 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ce743-185a-4850-b7b6-fb6d1e3b68d1 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:32:24.687543 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ce743-185a-4850-b7b6-fb6d1e3b68d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:32:24.740886 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-c01ce743-185a-4850-b7b6-fb6d1e3b68d1 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:32:24.745606 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-c01ce743-185a-4850-b7b6-fb6d1e3b68d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:32:24.757053 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c0185a-42ae-4408-b7aa-fe81ad68ad8e admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:32:24.769737 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a16059f-d06c-4ec2-b1ee-1f30dd58ef51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62401c8e1457450590f4147e0665265a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:32:24.771172 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a16059f-d06c-4ec2-b1ee-1f30dd58ef51 service nova] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:32:24.771373 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a16059f-d06c-4ec2-b1ee-1f30dd58ef51 service nova] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:32:24.771811 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a16059f-d06c-4ec2-b1ee-1f30dd58ef51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:32:24.774056 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-4a16059f-d06c-4ec2-b1ee-1f30dd58ef51 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:32:24.942890 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1181/2385] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:32:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:32:24.944526 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a16059f-d06c-4ec2-b1ee-1f30dd58ef51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:32:24.955839 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01ce743-185a-4850-b7b6-fb6d1e3b68d1 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:32:24.957112 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a16059f-d06c-4ec2-b1ee-1f30dd58ef51 service nova] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:32:24.957290 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-c01ce743-185a-4850-b7b6-fb6d1e3b68d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:32:24.980260 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1205/2386] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:32:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:32:25.113531 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01ce743-185a-4850-b7b6-fb6d1e3b68d1 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:32:25.127880 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8471fa-a066-4a00-8971-f6878150cc76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:32:25.128860 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8471fa-a066-4a00-8971-f6878150cc76 service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:32:25.129025 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8471fa-a066-4a00-8971-f6878150cc76 service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:32:25.129446 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8471fa-a066-4a00-8971-f6878150cc76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:32:25.165200 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8471fa-a066-4a00-8971-f6878150cc76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:32:25.167393 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8471fa-a066-4a00-8971-f6878150cc76 service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:32:25.194131 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1182/2387] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:32:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:32:26.028387 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a16059f-d06c-4ec2-b1ee-1f30dd58ef51 service nova] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:32:26.032023 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-4a16059f-d06c-4ec2-b1ee-1f30dd58ef51 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:32:26.042231 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:32:26.050551 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a16059f-d06c-4ec2-b1ee-1f30dd58ef51 service nova] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:32:26.075635 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d51618-d857-4a51-875e-74b7cdd97619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:32:26.076906 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d51618-d857-4a51-875e-74b7cdd97619 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:32:26.077285 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d51618-d857-4a51-875e-74b7cdd97619 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:32:26.077650 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d51618-d857-4a51-875e-74b7cdd97619 admin admin] PATH_INFO: `/v3/projects/dae95cbb53494fc9862da2be3053b179` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:32:26.081723 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d51618-d857-4a51-875e-74b7cdd97619 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dae95cbb53494fc9862da2be3053b179)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:32:26.085508 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d51618-d857-4a51-875e-74b7cdd97619 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:32:26.178483 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-d7d51618-d857-4a51-875e-74b7cdd97619 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dae95cbb53494fc9862da2be3053b179', 'request_id': 'req-d7d51618-d857-4a51-875e-74b7cdd97619'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:32:26.194444 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-d7d51618-d857-4a51-875e-74b7cdd97619 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dae95cbb53494fc9862da2be3053b179', 'request_id': 'req-d7d51618-d857-4a51-875e-74b7cdd97619'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:32:26.230989 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-d7d51618-d857-4a51-875e-74b7cdd97619 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dae95cbb53494fc9862da2be3053b179', 'request_id': 'req-d7d51618-d857-4a51-875e-74b7cdd97619'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:32:26.266400 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-d7d51618-d857-4a51-875e-74b7cdd97619 admin admin] The token cache is being invalidate because project dae95cbb53494fc9862da2be3053b179 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:32:26.267392 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-d7d51618-d857-4a51-875e-74b7cdd97619 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:32:26.268320 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-d7d51618-d857-4a51-875e-74b7cdd97619 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:32:26.283578 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1206/2388] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:32:26 2022] DELETE /identity/v3/projects/dae95cbb53494fc9862da2be3053b179 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:32:34.438962 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8471fa-a066-4a00-8971-f6878150cc76 service neutron] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:32:34.443564 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-5a8471fa-a066-4a00-8971-f6878150cc76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:32:34.464397 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:32:34.475808 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8471fa-a066-4a00-8971-f6878150cc76 service neutron] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:32:34.603691 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f401e3fd-287c-44d1-99de-670533be4651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:32:34.605325 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f401e3fd-287c-44d1-99de-670533be4651 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:32:34.605625 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f401e3fd-287c-44d1-99de-670533be4651 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:32:34.605912 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f401e3fd-287c-44d1-99de-670533be4651 admin admin] PATH_INFO: `/v3/users/fb017748ffe14af08084b0ef4b2aa3d0` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:32:34.614472 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f401e3fd-287c-44d1-99de-670533be4651 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb017748ffe14af08084b0ef4b2aa3d0)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:32:34.616115 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f401e3fd-287c-44d1-99de-670533be4651 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:32:34.699776 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-f401e3fd-287c-44d1-99de-670533be4651 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb017748ffe14af08084b0ef4b2aa3d0'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:32:34.725268 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-f401e3fd-287c-44d1-99de-670533be4651 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb017748ffe14af08084b0ef4b2aa3d0'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:32:34.726060 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-f401e3fd-287c-44d1-99de-670533be4651 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb017748ffe14af08084b0ef4b2aa3d0'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:32:34.739984 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-f401e3fd-287c-44d1-99de-670533be4651 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb017748ffe14af08084b0ef4b2aa3d0'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:32:34.740734 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-f401e3fd-287c-44d1-99de-670533be4651 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb017748ffe14af08084b0ef4b2aa3d0'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:32:34.766915 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1183/2389] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:32:34 2022] DELETE /identity/v3/users/fb017748ffe14af08084b0ef4b2aa3d0 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:32:34.771980 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8852021a-328d-4b07-a9d5-11905130d099 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:32:34.772469 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8852021a-328d-4b07-a9d5-11905130d099 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:32:34.772469 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8852021a-328d-4b07-a9d5-11905130d099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:32:34.798344 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-8852021a-328d-4b07-a9d5-11905130d099 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:32:34.799777 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-8852021a-328d-4b07-a9d5-11905130d099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:32:34.872953 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1207/2390] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:32:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:32:34.882328 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f401e3fd-287c-44d1-99de-670533be4651 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:32:34.884336 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-f401e3fd-287c-44d1-99de-670533be4651 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:32:34.991496 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f401e3fd-287c-44d1-99de-670533be4651 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:32:34.997591 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ef3e54-54a2-4762-bed5-356327ca2861 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:32:34.998312 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ef3e54-54a2-4762-bed5-356327ca2861 service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:32:34.998661 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ef3e54-54a2-4762-bed5-356327ca2861 service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:32:34.999087 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ef3e54-54a2-4762-bed5-356327ca2861 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:32:35.019287 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ef3e54-54a2-4762-bed5-356327ca2861 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:32:35.020917 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ef3e54-54a2-4762-bed5-356327ca2861 service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:32:35.037181 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1184/2391] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:32:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:32:35.525640 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8852021a-328d-4b07-a9d5-11905130d099 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:32:35.528765 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-8852021a-328d-4b07-a9d5-11905130d099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:32:35.581323 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8852021a-328d-4b07-a9d5-11905130d099 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:32:35.600437 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15df313f-dfd6-4d76-91d9-0a1080ab7253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:32:35.601589 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df313f-dfd6-4d76-91d9-0a1080ab7253 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:32:35.602407 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df313f-dfd6-4d76-91d9-0a1080ab7253 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:32:35.603737 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df313f-dfd6-4d76-91d9-0a1080ab7253 admin admin] PATH_INFO: `/v3/projects/7f366c9e1e924cea890b6f119617846c` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:32:35.608295 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15df313f-dfd6-4d76-91d9-0a1080ab7253 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f366c9e1e924cea890b6f119617846c)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:32:35.612414 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15df313f-dfd6-4d76-91d9-0a1080ab7253 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:32:35.684852 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-15df313f-dfd6-4d76-91d9-0a1080ab7253 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f366c9e1e924cea890b6f119617846c', 'request_id': 'req-15df313f-dfd6-4d76-91d9-0a1080ab7253'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:32:35.702944 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-15df313f-dfd6-4d76-91d9-0a1080ab7253 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f366c9e1e924cea890b6f119617846c', 'request_id': 'req-15df313f-dfd6-4d76-91d9-0a1080ab7253'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:32:35.710934 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-15df313f-dfd6-4d76-91d9-0a1080ab7253 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f366c9e1e924cea890b6f119617846c', 'request_id': 'req-15df313f-dfd6-4d76-91d9-0a1080ab7253'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:32:35.737356 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-15df313f-dfd6-4d76-91d9-0a1080ab7253 admin admin] The token cache is being invalidate because project 7f366c9e1e924cea890b6f119617846c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:32:35.738725 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-15df313f-dfd6-4d76-91d9-0a1080ab7253 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:32:35.739879 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-15df313f-dfd6-4d76-91d9-0a1080ab7253 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:32:35.749209 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1208/2392] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:32:35 2022] DELETE /identity/v3/projects/7f366c9e1e924cea890b6f119617846c => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:32:35.765844 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ffcfc-2206-455b-8f9d-43233a7b35d6 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:32:35.767716 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ffcfc-2206-455b-8f9d-43233a7b35d6 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:32:35.768433 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ffcfc-2206-455b-8f9d-43233a7b35d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:32:35.815081 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-f14ffcfc-2206-455b-8f9d-43233a7b35d6 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:32:35.816677 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-f14ffcfc-2206-455b-8f9d-43233a7b35d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:32:35.847368 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:32:35.935837 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1185/2393] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:32:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:32:35.949292 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e106c7c9-dac0-4d04-8922-6a422d277c4a None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:32:35.949751 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e106c7c9-dac0-4d04-8922-6a422d277c4a None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:32:35.950029 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e106c7c9-dac0-4d04-8922-6a422d277c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:32:35.991810 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-e106c7c9-dac0-4d04-8922-6a422d277c4a None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:32:35.993504 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-e106c7c9-dac0-4d04-8922-6a422d277c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:32:36.016854 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1209/2394] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:32:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:32:36.021791 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14ffcfc-2206-455b-8f9d-43233a7b35d6 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:32:36.044420 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14ffcfc-2206-455b-8f9d-43233a7b35d6 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:32:36.052121 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a7ec2c-f6d9-42b1-8b27-7825fafd0410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:32:36.052925 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a7ec2c-f6d9-42b1-8b27-7825fafd0410 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:32:36.053474 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a7ec2c-f6d9-42b1-8b27-7825fafd0410 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:32:36.053855 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a7ec2c-f6d9-42b1-8b27-7825fafd0410 admin admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:32:36.055609 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a7ec2c-f6d9-42b1-8b27-7825fafd0410 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:32:36.056079 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a7ec2c-f6d9-42b1-8b27-7825fafd0410 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:32:36.058603 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a7ec2c-f6d9-42b1-8b27-7825fafd0410 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:32:36.083270 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1186/2395] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 12:32:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:32:36.085445 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e106c7c9-dac0-4d04-8922-6a422d277c4a None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:32:36.121142 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:32:36.129963 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e106c7c9-dac0-4d04-8922-6a422d277c4a None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:32:36.147330 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf0c252-217c-4930-8b18-500db1253173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:32:36.147877 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf0c252-217c-4930-8b18-500db1253173 admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:32:36.148165 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf0c252-217c-4930-8b18-500db1253173 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:32:36.148501 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf0c252-217c-4930-8b18-500db1253173 admin admin] PATH_INFO: `/v3/projects` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:32:36.149188 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf0c252-217c-4930-8b18-500db1253173 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:32:36.151930 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf0c252-217c-4930-8b18-500db1253173 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:32:36.210979 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1210/2396] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:32:36 2022] POST /identity/v3/projects => generated 399 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:32:36.215930 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a7ec2c-f6d9-42b1-8b27-7825fafd0410 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:32:36.227927 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a7ec2c-f6d9-42b1-8b27-7825fafd0410 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:32:36.310067 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71f9202-e91e-42e5-864c-9a7cb35b8c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:32:36.310882 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f9202-e91e-42e5-864c-9a7cb35b8c4b admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:32:36.311266 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f9202-e91e-42e5-864c-9a7cb35b8c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:32:36.311615 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f9202-e91e-42e5-864c-9a7cb35b8c4b admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:32:36.312384 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71f9202-e91e-42e5-864c-9a7cb35b8c4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:32:36.314486 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71f9202-e91e-42e5-864c-9a7cb35b8c4b admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:32:36.358232 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1187/2397] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:32:36 2022] POST /identity/v3/users => generated 300 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:32:36.365326 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf0c252-217c-4930-8b18-500db1253173 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:32:36.391172 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf0c252-217c-4930-8b18-500db1253173 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:32:36.400234 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf85d6b-3737-4bfb-8bbb-d8aac5fd4f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:32:36.402558 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf85d6b-3737-4bfb-8bbb-d8aac5fd4f7a admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:32:36.407224 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf85d6b-3737-4bfb-8bbb-d8aac5fd4f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:32:36.407224 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf85d6b-3737-4bfb-8bbb-d8aac5fd4f7a admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:32:36.407224 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf85d6b-3737-4bfb-8bbb-d8aac5fd4f7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:32:36.411258 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf85d6b-3737-4bfb-8bbb-d8aac5fd4f7a admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:32:36.427794 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1211/2398] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:32:36 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:32:36.434931 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71f9202-e91e-42e5-864c-9a7cb35b8c4b admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:32:36.445820 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71f9202-e91e-42e5-864c-9a7cb35b8c4b admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:32:36.455238 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3381c50-9b54-43e2-83c3-398ff60a4f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:32:36.456014 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3381c50-9b54-43e2-83c3-398ff60a4f37 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:32:36.456369 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3381c50-9b54-43e2-83c3-398ff60a4f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:32:36.456718 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3381c50-9b54-43e2-83c3-398ff60a4f37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:32:36.457614 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3381c50-9b54-43e2-83c3-398ff60a4f37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:32:36.459490 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3381c50-9b54-43e2-83c3-398ff60a4f37 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:32:36.476844 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1188/2399] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:32:36 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:32:36.481709 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf85d6b-3737-4bfb-8bbb-d8aac5fd4f7a admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:32:36.498489 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf85d6b-3737-4bfb-8bbb-d8aac5fd4f7a admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:32:36.504412 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca12a73-34a6-4c46-acd4-7618a3b587fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:32:36.505495 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca12a73-34a6-4c46-acd4-7618a3b587fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:32:36.505883 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca12a73-34a6-4c46-acd4-7618a3b587fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:32:36.506275 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca12a73-34a6-4c46-acd4-7618a3b587fd admin admin] PATH_INFO: `/v3/projects/d747d7b045b944ec85d591613e6d4bac/users/73532978c45e4e8c911424921864a313/roles/b5cfd7a855a448359e9017f51d32b6fc` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:32:36.532183 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca12a73-34a6-4c46-acd4-7618a3b587fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d747d7b045b944ec85d591613e6d4bac, user_id=73532978c45e4e8c911424921864a313, role_id=b5cfd7a855a448359e9017f51d32b6fc)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:32:36.535510 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca12a73-34a6-4c46-acd4-7618a3b587fd admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:32:36.559831 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1212/2400] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:32:36 2022] PUT /identity/v3/projects/d747d7b045b944ec85d591613e6d4bac/users/73532978c45e4e8c911424921864a313/roles/b5cfd7a855a448359e9017f51d32b6fc => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:32:36.574887 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0b4105-25b3-4266-b32a-131793811c69 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:32:36.574887 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0b4105-25b3-4266-b32a-131793811c69 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:32:36.574887 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0b4105-25b3-4266-b32a-131793811c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:32:36.616273 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-6f0b4105-25b3-4266-b32a-131793811c69 None None] MFA Rules not processed for user `73532978c45e4e8c911424921864a313`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:32:36.618232 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-6f0b4105-25b3-4266-b32a-131793811c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:32:36.754190 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1189/2401] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:32:36 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:32:36.770053 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca12a73-34a6-4c46-acd4-7618a3b587fd admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:32:36.773199 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-fca12a73-34a6-4c46-acd4-7618a3b587fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:32:36.848733 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca12a73-34a6-4c46-acd4-7618a3b587fd admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:32:36.855680 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8b817e-d364-4404-b53a-56f93e8fc4d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e79503178ac54e62ba385467d5617ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:32:36.856693 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b817e-d364-4404-b53a-56f93e8fc4d6 service cinder] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:32:36.857040 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b817e-d364-4404-b53a-56f93e8fc4d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:32:36.857254 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b817e-d364-4404-b53a-56f93e8fc4d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:32:36.868109 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8b817e-d364-4404-b53a-56f93e8fc4d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:32:36.870294 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8b817e-d364-4404-b53a-56f93e8fc4d6 service cinder] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:32:36.881996 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1213/2402] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:32:36 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:32:38.676553 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0b4105-25b3-4266-b32a-131793811c69 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:32:38.678102 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-6f0b4105-25b3-4266-b32a-131793811c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:32:38.729145 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:32:38.811744 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0b4105-25b3-4266-b32a-131793811c69 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:32:38.833111 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abc76d7-b24d-4e2e-801d-132e4f10bdbf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6deab40ae6244d4b9affa47b274aea3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:32:38.834274 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc76d7-b24d-4e2e-801d-132e4f10bdbf service placement] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:32:38.834775 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc76d7-b24d-4e2e-801d-132e4f10bdbf service placement] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:32:38.835528 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc76d7-b24d-4e2e-801d-132e4f10bdbf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:32:38.841275 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-5abc76d7-b24d-4e2e-801d-132e4f10bdbf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:32:38.865598 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abc76d7-b24d-4e2e-801d-132e4f10bdbf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:32:38.868987 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abc76d7-b24d-4e2e-801d-132e4f10bdbf service placement] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:32:38.891257 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1190/2403] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:32:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:32:41.315723 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79470789-dc10-4dff-83d3-b00ff58c92ca None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:32:41.316523 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79470789-dc10-4dff-83d3-b00ff58c92ca None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:32:41.316523 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79470789-dc10-4dff-83d3-b00ff58c92ca None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:32:41.317938 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1214/2404] 10.222.0.79 () {54 vars in 921 bytes} [Wed Aug 31 12:32:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:32:41.326145 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d5dd5-84c3-4086-80f8-2c07a537907a None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:32:41.327063 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d5dd5-84c3-4086-80f8-2c07a537907a None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:32:41.327243 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d5dd5-84c3-4086-80f8-2c07a537907a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:32:41.356402 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-fc5d5dd5-84c3-4086-80f8-2c07a537907a None None] MFA Rules not processed for user `62401c8e1457450590f4147e0665265a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:32:41.358549 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-fc5d5dd5-84c3-4086-80f8-2c07a537907a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:32:41.441356 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1191/2405] 10.222.0.79 () {58 vars in 1018 bytes} [Wed Aug 31 12:32:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:32:41.453716 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79470789-dc10-4dff-83d3-b00ff58c92ca None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:32:41.455517 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-79470789-dc10-4dff-83d3-b00ff58c92ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:32:41.527058 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79470789-dc10-4dff-83d3-b00ff58c92ca None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:32:41.532784 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbce5d70-47c8-43a0-807c-77c2ad93b8ae service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8b3bb8f689b45b99ed43f672264a26d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:32:41.533733 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbce5d70-47c8-43a0-807c-77c2ad93b8ae service glance] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:32:41.534243 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbce5d70-47c8-43a0-807c-77c2ad93b8ae service glance] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:32:41.534630 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbce5d70-47c8-43a0-807c-77c2ad93b8ae service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:32:41.547611 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbce5d70-47c8-43a0-807c-77c2ad93b8ae service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:32:41.549712 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbce5d70-47c8-43a0-807c-77c2ad93b8ae service glance] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:32:41.565041 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1215/2406] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:32:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:32:41.661297 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee06f71-546e-467f-97e5-8b5efcca0dda None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:32:41.661584 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee06f71-546e-467f-97e5-8b5efcca0dda None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:32:41.661848 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee06f71-546e-467f-97e5-8b5efcca0dda None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:32:41.663301 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1192/2407] 10.222.0.79 () {54 vars in 921 bytes} [Wed Aug 31 12:32:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:32:41.670785 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447fa7e8-7b70-4aa0-a494-71143de9a6b7 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:32:41.671469 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447fa7e8-7b70-4aa0-a494-71143de9a6b7 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:32:41.671960 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447fa7e8-7b70-4aa0-a494-71143de9a6b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:32:41.706751 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-447fa7e8-7b70-4aa0-a494-71143de9a6b7 None None] MFA Rules not processed for user `1569b43c774c45ff80577d879ba9d819`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:32:41.708953 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-447fa7e8-7b70-4aa0-a494-71143de9a6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:32:41.777255 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:32:41.785985 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1216/2408] 10.222.0.79 () {58 vars in 1018 bytes} [Wed Aug 31 12:32:41 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:32:41.800113 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee06f71-546e-467f-97e5-8b5efcca0dda None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:32:41.801862 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-1ee06f71-546e-467f-97e5-8b5efcca0dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:32:41.817913 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee06f71-546e-467f-97e5-8b5efcca0dda None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:32:41.823631 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cf85dd-5622-4270-a260-7b580a875732 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:32:41.824230 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf85dd-5622-4270-a260-7b580a875732 service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:32:41.824546 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf85dd-5622-4270-a260-7b580a875732 service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:32:41.824859 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf85dd-5622-4270-a260-7b580a875732 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:32:41.833385 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cf85dd-5622-4270-a260-7b580a875732 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:32:41.834879 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cf85dd-5622-4270-a260-7b580a875732 service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:32:41.845532 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1193/2409] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:32:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:32:41.938897 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431087cf-fbde-4a0e-8402-18005ed48404 None None] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:32:41.939268 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431087cf-fbde-4a0e-8402-18005ed48404 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:32:41.939594 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431087cf-fbde-4a0e-8402-18005ed48404 None None] PATH_INFO: `/` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:32:41.941082 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1217/2410] 10.222.0.79 () {54 vars in 921 bytes} [Wed Aug 31 12:32:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:32:41.947620 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd639d-9c8a-4605-ae94-976eef92ed5d None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:32:41.948533 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd639d-9c8a-4605-ae94-976eef92ed5d None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:32:41.948905 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd639d-9c8a-4605-ae94-976eef92ed5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:32:41.972179 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-56cd639d-9c8a-4605-ae94-976eef92ed5d None None] MFA Rules not processed for user `62401c8e1457450590f4147e0665265a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:32:41.973446 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-56cd639d-9c8a-4605-ae94-976eef92ed5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:32:41.984343 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1194/2411] 10.222.0.79 () {58 vars in 1018 bytes} [Wed Aug 31 12:32:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:32:41.996445 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431087cf-fbde-4a0e-8402-18005ed48404 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:32:42.012349 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431087cf-fbde-4a0e-8402-18005ed48404 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:32:42.018470 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aba7747-e6c1-4bfe-9110-e5b17ec903fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:32:42.019524 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba7747-e6c1-4bfe-9110-e5b17ec903fd service neutron] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:32:42.019988 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba7747-e6c1-4bfe-9110-e5b17ec903fd service neutron] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:32:42.020444 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba7747-e6c1-4bfe-9110-e5b17ec903fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:32:42.039680 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aba7747-e6c1-4bfe-9110-e5b17ec903fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:32:42.041089 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aba7747-e6c1-4bfe-9110-e5b17ec903fd service neutron] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:32:42.056134 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1218/2412] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:32:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:32:45.605724 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cd639d-9c8a-4605-ae94-976eef92ed5d None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:32:45.727990 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cd639d-9c8a-4605-ae94-976eef92ed5d None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:32:45.735672 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e413c3a1-59a9-4c04-b3ff-3d4acb31b6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:32:45.736680 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e413c3a1-59a9-4c04-b3ff-3d4acb31b6dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:32:45.737820 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e413c3a1-59a9-4c04-b3ff-3d4acb31b6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:32:45.737820 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e413c3a1-59a9-4c04-b3ff-3d4acb31b6dc admin admin] PATH_INFO: `/v3/users/73532978c45e4e8c911424921864a313` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:32:45.739575 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e413c3a1-59a9-4c04-b3ff-3d4acb31b6dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=73532978c45e4e8c911424921864a313)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:32:45.742084 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e413c3a1-59a9-4c04-b3ff-3d4acb31b6dc admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:32:45.798465 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:32:45.832391 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-e413c3a1-59a9-4c04-b3ff-3d4acb31b6dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73532978c45e4e8c911424921864a313'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:32:45.851036 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-e413c3a1-59a9-4c04-b3ff-3d4acb31b6dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73532978c45e4e8c911424921864a313'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:32:45.851936 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-e413c3a1-59a9-4c04-b3ff-3d4acb31b6dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73532978c45e4e8c911424921864a313'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:32:45.862605 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-e413c3a1-59a9-4c04-b3ff-3d4acb31b6dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73532978c45e4e8c911424921864a313'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:32:45.863831 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-e413c3a1-59a9-4c04-b3ff-3d4acb31b6dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73532978c45e4e8c911424921864a313'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:32:45.881225 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1195/2413] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:32:45 2022] DELETE /identity/v3/users/73532978c45e4e8c911424921864a313 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:32:45.888215 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99010b-5d22-4c23-b4f5-e07c90f1b6d0 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:32:45.889133 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99010b-5d22-4c23-b4f5-e07c90f1b6d0 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:32:45.889456 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99010b-5d22-4c23-b4f5-e07c90f1b6d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:32:45.916080 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-da99010b-5d22-4c23-b4f5-e07c90f1b6d0 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:32:45.918091 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-da99010b-5d22-4c23-b4f5-e07c90f1b6d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:32:46.008191 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1219/2414] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:32:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:32:46.024150 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e413c3a1-59a9-4c04-b3ff-3d4acb31b6dc admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:32:46.027256 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-e413c3a1-59a9-4c04-b3ff-3d4acb31b6dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:32:46.140726 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e413c3a1-59a9-4c04-b3ff-3d4acb31b6dc admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:32:46.147873 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2260cbf4-0f29-4cf0-a91d-8a185cf077e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:32:46.148694 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260cbf4-0f29-4cf0-a91d-8a185cf077e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:32:46.149398 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260cbf4-0f29-4cf0-a91d-8a185cf077e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:32:46.149990 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260cbf4-0f29-4cf0-a91d-8a185cf077e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:32:46.169764 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2260cbf4-0f29-4cf0-a91d-8a185cf077e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:32:46.172859 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2260cbf4-0f29-4cf0-a91d-8a185cf077e0 service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:32:46.191926 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1196/2415] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:32:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:32:46.663147 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da99010b-5d22-4c23-b4f5-e07c90f1b6d0 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:32:46.667636 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-da99010b-5d22-4c23-b4f5-e07c90f1b6d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:32:46.697429 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da99010b-5d22-4c23-b4f5-e07c90f1b6d0 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:32:46.711914 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d215778-80d7-4f4b-8d32-2ac495005d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:32:46.713950 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d215778-80d7-4f4b-8d32-2ac495005d3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:32:46.714658 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d215778-80d7-4f4b-8d32-2ac495005d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:32:46.715546 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d215778-80d7-4f4b-8d32-2ac495005d3a admin admin] PATH_INFO: `/v3/projects/d747d7b045b944ec85d591613e6d4bac` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:32:46.719052 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d215778-80d7-4f4b-8d32-2ac495005d3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d747d7b045b944ec85d591613e6d4bac)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:32:46.724665 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d215778-80d7-4f4b-8d32-2ac495005d3a admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:32:46.844502 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-4d215778-80d7-4f4b-8d32-2ac495005d3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd747d7b045b944ec85d591613e6d4bac', 'request_id': 'req-4d215778-80d7-4f4b-8d32-2ac495005d3a'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:32:46.867907 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-4d215778-80d7-4f4b-8d32-2ac495005d3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd747d7b045b944ec85d591613e6d4bac', 'request_id': 'req-4d215778-80d7-4f4b-8d32-2ac495005d3a'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:32:46.884907 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-4d215778-80d7-4f4b-8d32-2ac495005d3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd747d7b045b944ec85d591613e6d4bac', 'request_id': 'req-4d215778-80d7-4f4b-8d32-2ac495005d3a'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:32:46.899531 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-4d215778-80d7-4f4b-8d32-2ac495005d3a admin admin] The token cache is being invalidate because project d747d7b045b944ec85d591613e6d4bac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:32:46.900579 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-4d215778-80d7-4f4b-8d32-2ac495005d3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:32:46.900579 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-4d215778-80d7-4f4b-8d32-2ac495005d3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:32:46.911125 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1220/2416] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:32:46 2022] DELETE /identity/v3/projects/d747d7b045b944ec85d591613e6d4bac => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:32:47.280990 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234bf22f-f51c-4324-b7ec-0c8143375a82 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:32:47.281844 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234bf22f-f51c-4324-b7ec-0c8143375a82 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:32:47.281844 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234bf22f-f51c-4324-b7ec-0c8143375a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:32:47.306344 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-234bf22f-f51c-4324-b7ec-0c8143375a82 None None] MFA Rules not processed for user `2e77671c123f434489d82da79212d0ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:32:47.310503 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-234bf22f-f51c-4324-b7ec-0c8143375a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:32:47.415489 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1197/2417] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:32:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:32:48.164066 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78937acb-123d-445f-87d7-a994b87b31dc None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:32:48.164839 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78937acb-123d-445f-87d7-a994b87b31dc None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:32:48.164839 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78937acb-123d-445f-87d7-a994b87b31dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:32:48.197721 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-78937acb-123d-445f-87d7-a994b87b31dc None None] MFA Rules not processed for user `149aa48acd504354a1d021885ca51334`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:32:48.199211 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-78937acb-123d-445f-87d7-a994b87b31dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:32:48.300650 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1221/2418] 10.222.0.79 () {58 vars in 1009 bytes} [Wed Aug 31 12:32:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:32:48.324861 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234bf22f-f51c-4324-b7ec-0c8143375a82 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:32:48.327266 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-234bf22f-f51c-4324-b7ec-0c8143375a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:32:48.412936 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:32:48.442321 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234bf22f-f51c-4324-b7ec-0c8143375a82 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:32:48.451245 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70e022d-bff4-431d-8421-90f159913ff3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896540cc14f40b08d05ade32cfd0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:32:48.451817 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e022d-bff4-431d-8421-90f159913ff3 service swift] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:32:48.452103 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e022d-bff4-431d-8421-90f159913ff3 service swift] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:32:48.452374 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e022d-bff4-431d-8421-90f159913ff3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:32:48.461961 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70e022d-bff4-431d-8421-90f159913ff3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:32:48.464834 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70e022d-bff4-431d-8421-90f159913ff3 service swift] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:32:48.474231 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1198/2419] 10.222.0.79 () {60 vars in 1384 bytes} [Wed Aug 31 12:32:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 12:32:58.291353 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=85,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:32:58.470580 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=9 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:33:11.113562 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5753d64b-732e-47b2-9e57-aa1327c835c9 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:33:11.114143 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5753d64b-732e-47b2-9e57-aa1327c835c9 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:33:11.114143 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5753d64b-732e-47b2-9e57-aa1327c835c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:33:11.136262 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-5753d64b-732e-47b2-9e57-aa1327c835c9 None None] MFA Rules not processed for user `149aa48acd504354a1d021885ca51334`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:33:11.137502 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-5753d64b-732e-47b2-9e57-aa1327c835c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:33:11.145536 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1222/2420] 10.222.0.79 () {58 vars in 967 bytes} [Wed Aug 31 12:33:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:33:11.160040 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70e022d-bff4-431d-8421-90f159913ff3 service swift] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:33:11.173396 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70e022d-bff4-431d-8421-90f159913ff3 service swift] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:33:11.178654 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56af3fea-721d-4385-a208-e54c370e9d34 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896540cc14f40b08d05ade32cfd0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:33:11.179312 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af3fea-721d-4385-a208-e54c370e9d34 service swift] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:33:11.179594 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af3fea-721d-4385-a208-e54c370e9d34 service swift] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:33:11.179920 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af3fea-721d-4385-a208-e54c370e9d34 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:33:11.190227 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56af3fea-721d-4385-a208-e54c370e9d34 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:33:11.192041 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56af3fea-721d-4385-a208-e54c370e9d34 service swift] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:33:11.202658 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1199/2421] 10.222.0.79 () {60 vars in 1384 bytes} [Wed Aug 31 12:33:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 12:33:15.423058 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5753d64b-732e-47b2-9e57-aa1327c835c9 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:33:15.424500 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-5753d64b-732e-47b2-9e57-aa1327c835c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:33:15.486551 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5753d64b-732e-47b2-9e57-aa1327c835c9 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:33:15.490490 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e363b2-a4d8-4846-9af6-aa19c3d61544 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:33:15.491136 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e363b2-a4d8-4846-9af6-aa19c3d61544 service neutron] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:33:15.491704 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e363b2-a4d8-4846-9af6-aa19c3d61544 service neutron] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:33:15.491704 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e363b2-a4d8-4846-9af6-aa19c3d61544 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:33:15.493474 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-20e363b2-a4d8-4846-9af6-aa19c3d61544 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:33:15.571829 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e363b2-a4d8-4846-9af6-aa19c3d61544 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:33:15.574131 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e363b2-a4d8-4846-9af6-aa19c3d61544 service neutron] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:33:15.584404 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1223/2422] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:33:15 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:33:21.199874 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=6 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:33:25.579798 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=53 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:34:02.019324 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b610c-143d-4282-88cd-a2fa6f1e2851 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:34:02.019973 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b610c-143d-4282-88cd-a2fa6f1e2851 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:34:02.019973 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b610c-143d-4282-88cd-a2fa6f1e2851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:34:02.038877 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-d10b610c-143d-4282-88cd-a2fa6f1e2851 None None] MFA Rules not processed for user `ee19faf2a2c54b19a9dc01d28f045b3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:34:02.040080 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-d10b610c-143d-4282-88cd-a2fa6f1e2851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:34:02.094144 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1200/2423] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:34:02 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:34:04.180071 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15de5c8-706f-4bdc-8fbd-4b19c3f780c5 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:34:04.180546 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15de5c8-706f-4bdc-8fbd-4b19c3f780c5 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:34:04.180659 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15de5c8-706f-4bdc-8fbd-4b19c3f780c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:34:04.200694 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-e15de5c8-706f-4bdc-8fbd-4b19c3f780c5 None None] MFA Rules not processed for user `64886d73c79649d1a824170a33f53fcb`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:34:04.201951 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-e15de5c8-706f-4bdc-8fbd-4b19c3f780c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:34:04.267961 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1224/2424] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:34:04 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:34:12.087630 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=25 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:34:14.260222 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=25 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:34:29.091894 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f4d4cd-72c0-4a72-8805-83c382880b4d None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:34:29.092448 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f4d4cd-72c0-4a72-8805-83c382880b4d None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:34:29.092448 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f4d4cd-72c0-4a72-8805-83c382880b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:34:29.112183 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-98f4d4cd-72c0-4a72-8805-83c382880b4d None None] MFA Rules not processed for user `937aa5c23271467f83b05f570fde7468`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:34:29.113763 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-98f4d4cd-72c0-4a72-8805-83c382880b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:34:29.172219 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1201/2425] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:34:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:34:30.929979 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15de5c8-706f-4bdc-8fbd-4b19c3f780c5 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:34:30.942206 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15de5c8-706f-4bdc-8fbd-4b19c3f780c5 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:34:30.945784 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a0c75e-8d5d-4ec9-b386-bc4420f68098 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:34:30.946444 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a0c75e-8d5d-4ec9-b386-bc4420f68098 service neutron] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:34:30.946811 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a0c75e-8d5d-4ec9-b386-bc4420f68098 service neutron] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:34:30.947127 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a0c75e-8d5d-4ec9-b386-bc4420f68098 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:34:30.948928 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-72a0c75e-8d5d-4ec9-b386-bc4420f68098 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:34:31.029267 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a0c75e-8d5d-4ec9-b386-bc4420f68098 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:34:31.030720 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a0c75e-8d5d-4ec9-b386-bc4420f68098 service neutron] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:34:31.046349 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1225/2426] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:34:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:34:32.170956 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f4d4cd-72c0-4a72-8805-83c382880b4d None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:34:32.172458 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-98f4d4cd-72c0-4a72-8805-83c382880b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:34:32.185869 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f4d4cd-72c0-4a72-8805-83c382880b4d None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:34:32.190583 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d41a1e-28fe-47d4-992b-f7c46930a0e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:34:32.191052 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d41a1e-28fe-47d4-992b-f7c46930a0e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:34:32.191370 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d41a1e-28fe-47d4-992b-f7c46930a0e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:34:32.191587 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d41a1e-28fe-47d4-992b-f7c46930a0e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:34:32.193512 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-b3d41a1e-28fe-47d4-992b-f7c46930a0e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:34:32.209549 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d41a1e-28fe-47d4-992b-f7c46930a0e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:34:32.211069 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d41a1e-28fe-47d4-992b-f7c46930a0e3 service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:34:32.223611 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1202/2427] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:34:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:34:41.039906 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=34 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:34:42.217743 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=31 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:34:48.661516 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a0c75e-8d5d-4ec9-b386-bc4420f68098 service neutron] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:34:48.662827 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-72a0c75e-8d5d-4ec9-b386-bc4420f68098 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:34:48.676867 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a0c75e-8d5d-4ec9-b386-bc4420f68098 service neutron] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:34:48.682426 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400c6852-136d-4287-8691-6618241b39fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62401c8e1457450590f4147e0665265a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:34:48.683068 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c6852-136d-4287-8691-6618241b39fb service nova] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:34:48.683347 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c6852-136d-4287-8691-6618241b39fb service nova] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:34:48.683615 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c6852-136d-4287-8691-6618241b39fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:34:48.685329 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-400c6852-136d-4287-8691-6618241b39fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:34:48.696268 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400c6852-136d-4287-8691-6618241b39fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:34:48.697848 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400c6852-136d-4287-8691-6618241b39fb service nova] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:34:48.707523 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1226/2428] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:34:48 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:34:53.558462 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d41a1e-28fe-47d4-992b-f7c46930a0e3 service neutron] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:34:53.560041 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-b3d41a1e-28fe-47d4-992b-f7c46930a0e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:34:53.573960 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d41a1e-28fe-47d4-992b-f7c46930a0e3 service neutron] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:34:53.579610 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5307c5f8-bcc8-45aa-9508-9dc94034c05a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62401c8e1457450590f4147e0665265a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:34:53.580216 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5307c5f8-bcc8-45aa-9508-9dc94034c05a service nova] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:34:53.580493 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5307c5f8-bcc8-45aa-9508-9dc94034c05a service nova] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:34:53.580762 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5307c5f8-bcc8-45aa-9508-9dc94034c05a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:34:53.582949 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-5307c5f8-bcc8-45aa-9508-9dc94034c05a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:34:53.593690 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5307c5f8-bcc8-45aa-9508-9dc94034c05a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:34:53.595376 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5307c5f8-bcc8-45aa-9508-9dc94034c05a service nova] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:34:53.605226 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1203/2429] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:34:53 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:34:58.702640 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=6 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:35:02.733633 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400c6852-136d-4287-8691-6618241b39fb service nova] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:35:02.743612 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400c6852-136d-4287-8691-6618241b39fb service nova] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:35:02.747132 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83154614-b24b-4d24-9622-06cb1cfc326c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:35:02.747841 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83154614-b24b-4d24-9622-06cb1cfc326c service neutron] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:35:02.748148 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83154614-b24b-4d24-9622-06cb1cfc326c service neutron] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:35:02.748444 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83154614-b24b-4d24-9622-06cb1cfc326c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:35:02.750744 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-83154614-b24b-4d24-9622-06cb1cfc326c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:35:02.814624 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83154614-b24b-4d24-9622-06cb1cfc326c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:35:02.816113 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83154614-b24b-4d24-9622-06cb1cfc326c service neutron] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:35:02.825730 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1227/2430] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:35:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:35:03.600790 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=6 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:35:06.559301 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5307c5f8-bcc8-45aa-9508-9dc94034c05a service nova] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:35:06.560782 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-5307c5f8-bcc8-45aa-9508-9dc94034c05a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:35:06.585146 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5307c5f8-bcc8-45aa-9508-9dc94034c05a service nova] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:35:06.589817 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c1d7b4-dcd0-48e2-9798-5704271d79d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:35:06.590450 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1d7b4-dcd0-48e2-9798-5704271d79d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:35:06.590733 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1d7b4-dcd0-48e2-9798-5704271d79d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:35:06.591038 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1d7b4-dcd0-48e2-9798-5704271d79d8 admin admin] PATH_INFO: `/v3/users/64886d73c79649d1a824170a33f53fcb` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:35:06.592177 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c1d7b4-dcd0-48e2-9798-5704271d79d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64886d73c79649d1a824170a33f53fcb)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:35:06.594123 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c1d7b4-dcd0-48e2-9798-5704271d79d8 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:35:06.646333 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-f1c1d7b4-dcd0-48e2-9798-5704271d79d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64886d73c79649d1a824170a33f53fcb'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:35:06.665053 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-f1c1d7b4-dcd0-48e2-9798-5704271d79d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64886d73c79649d1a824170a33f53fcb'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:35:06.665688 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-f1c1d7b4-dcd0-48e2-9798-5704271d79d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64886d73c79649d1a824170a33f53fcb'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:35:06.672779 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-f1c1d7b4-dcd0-48e2-9798-5704271d79d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64886d73c79649d1a824170a33f53fcb'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:35:06.673442 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-f1c1d7b4-dcd0-48e2-9798-5704271d79d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64886d73c79649d1a824170a33f53fcb'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:35:06.686947 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1204/2431] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:35:06 2022] DELETE /identity/v3/users/64886d73c79649d1a824170a33f53fcb => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:35:06.885734 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83154614-b24b-4d24-9622-06cb1cfc326c service neutron] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:35:06.896941 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83154614-b24b-4d24-9622-06cb1cfc326c service neutron] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:35:06.962001 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a4d6bc-6ce6-40f2-98ad-6d78116b4c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:35:06.962661 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a4d6bc-6ce6-40f2-98ad-6d78116b4c08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:35:06.962990 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a4d6bc-6ce6-40f2-98ad-6d78116b4c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:35:06.963245 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a4d6bc-6ce6-40f2-98ad-6d78116b4c08 admin admin] PATH_INFO: `/v3/projects/7327d2f6422e4bdb9e250e44987dace3` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:35:06.964372 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a4d6bc-6ce6-40f2-98ad-6d78116b4c08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7327d2f6422e4bdb9e250e44987dace3)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:35:06.966299 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a4d6bc-6ce6-40f2-98ad-6d78116b4c08 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:35:07.013818 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-c4a4d6bc-6ce6-40f2-98ad-6d78116b4c08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7327d2f6422e4bdb9e250e44987dace3', 'request_id': 'req-c4a4d6bc-6ce6-40f2-98ad-6d78116b4c08'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:35:07.022016 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-c4a4d6bc-6ce6-40f2-98ad-6d78116b4c08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7327d2f6422e4bdb9e250e44987dace3', 'request_id': 'req-c4a4d6bc-6ce6-40f2-98ad-6d78116b4c08'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:35:07.028220 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-c4a4d6bc-6ce6-40f2-98ad-6d78116b4c08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7327d2f6422e4bdb9e250e44987dace3', 'request_id': 'req-c4a4d6bc-6ce6-40f2-98ad-6d78116b4c08'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:35:07.038943 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-c4a4d6bc-6ce6-40f2-98ad-6d78116b4c08 admin admin] The token cache is being invalidate because project 7327d2f6422e4bdb9e250e44987dace3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:35:07.039239 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-c4a4d6bc-6ce6-40f2-98ad-6d78116b4c08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:35:07.039885 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-c4a4d6bc-6ce6-40f2-98ad-6d78116b4c08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:35:07.041422 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1228/2432] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:35:06 2022] DELETE /identity/v3/projects/7327d2f6422e4bdb9e250e44987dace3 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:35:07.046421 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf12245-b56f-4824-9a5f-3f50c50110cf None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:35:07.046709 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf12245-b56f-4824-9a5f-3f50c50110cf None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:35:07.047014 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf12245-b56f-4824-9a5f-3f50c50110cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:35:07.067107 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-ebf12245-b56f-4824-9a5f-3f50c50110cf None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:35:07.068467 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-ebf12245-b56f-4824-9a5f-3f50c50110cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:35:07.126352 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1205/2433] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:35:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:35:07.134719 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980aeb92-8c99-4a5b-8c27-f1a3c6b87164 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:35:07.135073 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980aeb92-8c99-4a5b-8c27-f1a3c6b87164 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:35:07.135359 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980aeb92-8c99-4a5b-8c27-f1a3c6b87164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:35:07.158543 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-980aeb92-8c99-4a5b-8c27-f1a3c6b87164 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:35:07.159780 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-980aeb92-8c99-4a5b-8c27-f1a3c6b87164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:35:07.168132 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1229/2434] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:35:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:35:07.172403 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf12245-b56f-4824-9a5f-3f50c50110cf None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:35:07.182741 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf12245-b56f-4824-9a5f-3f50c50110cf None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:35:07.187348 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7245fac3-afbc-4b12-8a90-fbdd8198f141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:35:07.187952 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7245fac3-afbc-4b12-8a90-fbdd8198f141 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:35:07.188234 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7245fac3-afbc-4b12-8a90-fbdd8198f141 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:35:07.188502 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7245fac3-afbc-4b12-8a90-fbdd8198f141 admin admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:35:07.189141 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7245fac3-afbc-4b12-8a90-fbdd8198f141 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:35:07.189439 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7245fac3-afbc-4b12-8a90-fbdd8198f141 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:35:07.191762 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7245fac3-afbc-4b12-8a90-fbdd8198f141 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:35:07.204267 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1206/2435] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 12:35:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:35:07.208868 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980aeb92-8c99-4a5b-8c27-f1a3c6b87164 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:35:07.218105 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980aeb92-8c99-4a5b-8c27-f1a3c6b87164 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:35:07.222841 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179c17d0-2169-4ec4-8df5-518210204b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:35:07.223465 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179c17d0-2169-4ec4-8df5-518210204b23 admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:35:07.223745 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179c17d0-2169-4ec4-8df5-518210204b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:35:07.224016 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179c17d0-2169-4ec4-8df5-518210204b23 admin admin] PATH_INFO: `/v3/projects` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:35:07.224644 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179c17d0-2169-4ec4-8df5-518210204b23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:35:07.226530 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179c17d0-2169-4ec4-8df5-518210204b23 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:35:07.242753 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:35:07.258455 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1230/2436] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:35:07 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:35:07.263395 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7245fac3-afbc-4b12-8a90-fbdd8198f141 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:35:07.274355 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7245fac3-afbc-4b12-8a90-fbdd8198f141 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:35:07.333213 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec55725-71d6-4bc8-9144-1a6148c7d7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:35:07.333832 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec55725-71d6-4bc8-9144-1a6148c7d7c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:35:07.334103 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec55725-71d6-4bc8-9144-1a6148c7d7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:35:07.334374 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec55725-71d6-4bc8-9144-1a6148c7d7c8 admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:35:07.335049 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec55725-71d6-4bc8-9144-1a6148c7d7c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:35:07.336958 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec55725-71d6-4bc8-9144-1a6148c7d7c8 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:35:07.345363 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:35:07.363008 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1207/2437] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:35:07 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:35:07.367059 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179c17d0-2169-4ec4-8df5-518210204b23 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:35:07.377411 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179c17d0-2169-4ec4-8df5-518210204b23 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:35:07.382932 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781e40b5-fe17-4be9-b8ac-076146d692b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:35:07.383780 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e40b5-fe17-4be9-b8ac-076146d692b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:35:07.383918 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e40b5-fe17-4be9-b8ac-076146d692b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:35:07.384081 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e40b5-fe17-4be9-b8ac-076146d692b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:35:07.384725 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781e40b5-fe17-4be9-b8ac-076146d692b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:35:07.387600 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781e40b5-fe17-4be9-b8ac-076146d692b2 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:35:07.398028 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1231/2438] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:35:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:35:07.402316 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec55725-71d6-4bc8-9144-1a6148c7d7c8 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:35:07.412792 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec55725-71d6-4bc8-9144-1a6148c7d7c8 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:35:07.417572 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c584ae7-e01d-4609-9314-77e9f6ae2fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:35:07.418177 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c584ae7-e01d-4609-9314-77e9f6ae2fd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:35:07.418457 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c584ae7-e01d-4609-9314-77e9f6ae2fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:35:07.418727 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c584ae7-e01d-4609-9314-77e9f6ae2fd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:35:07.419403 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c584ae7-e01d-4609-9314-77e9f6ae2fd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:35:07.421015 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c584ae7-e01d-4609-9314-77e9f6ae2fd0 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:35:07.432389 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1208/2439] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:35:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:35:07.436648 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781e40b5-fe17-4be9-b8ac-076146d692b2 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:35:07.447811 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781e40b5-fe17-4be9-b8ac-076146d692b2 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:35:07.452173 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ee8f88-bca6-4af8-85a0-72be645ea4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:35:07.452831 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee8f88-bca6-4af8-85a0-72be645ea4e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:35:07.453109 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee8f88-bca6-4af8-85a0-72be645ea4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:35:07.453644 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee8f88-bca6-4af8-85a0-72be645ea4e2 admin admin] PATH_INFO: `/v3/projects/8f6da846ab4f45a6ac4b2e34bf52abfc/users/d277532df42244c693b5e51e9fd0c459/roles/b5cfd7a855a448359e9017f51d32b6fc` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:35:07.470246 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ee8f88-bca6-4af8-85a0-72be645ea4e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f6da846ab4f45a6ac4b2e34bf52abfc, user_id=d277532df42244c693b5e51e9fd0c459, role_id=b5cfd7a855a448359e9017f51d32b6fc)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:35:07.473807 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ee8f88-bca6-4af8-85a0-72be645ea4e2 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:35:07.492513 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1232/2440] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:35:07 2022] PUT /identity/v3/projects/8f6da846ab4f45a6ac4b2e34bf52abfc/users/d277532df42244c693b5e51e9fd0c459/roles/b5cfd7a855a448359e9017f51d32b6fc => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:35:07.497651 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e367cc-d906-42e7-9a87-7671f0a8cb33 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:35:07.497936 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e367cc-d906-42e7-9a87-7671f0a8cb33 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:35:07.498207 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e367cc-d906-42e7-9a87-7671f0a8cb33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:35:07.520103 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-d0e367cc-d906-42e7-9a87-7671f0a8cb33 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:35:07.521313 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-d0e367cc-d906-42e7-9a87-7671f0a8cb33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:35:07.582618 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1209/2441] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:35:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:35:07.592853 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ee8f88-bca6-4af8-85a0-72be645ea4e2 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:35:07.595470 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-a5ee8f88-bca6-4af8-85a0-72be645ea4e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:35:07.654164 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ee8f88-bca6-4af8-85a0-72be645ea4e2 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:35:07.657916 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b9c482-4cad-4eaa-ac0b-6158cbb5382b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:35:07.658529 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b9c482-4cad-4eaa-ac0b-6158cbb5382b service neutron] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:35:07.658814 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b9c482-4cad-4eaa-ac0b-6158cbb5382b service neutron] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:35:07.659124 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b9c482-4cad-4eaa-ac0b-6158cbb5382b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:35:07.668306 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b9c482-4cad-4eaa-ac0b-6158cbb5382b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:35:07.669770 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b9c482-4cad-4eaa-ac0b-6158cbb5382b service neutron] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:35:07.679497 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1233/2442] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:35:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:35:12.538153 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18397046-d663-47da-b36f-073e1b46ed04 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:35:12.538962 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18397046-d663-47da-b36f-073e1b46ed04 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:35:12.539477 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18397046-d663-47da-b36f-073e1b46ed04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:35:12.603642 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-18397046-d663-47da-b36f-073e1b46ed04 None None] MFA Rules not processed for user `d277532df42244c693b5e51e9fd0c459`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:35:12.605955 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-18397046-d663-47da-b36f-073e1b46ed04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:35:12.695051 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1210/2443] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:35:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:35:12.712144 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b9c482-4cad-4eaa-ac0b-6158cbb5382b service neutron] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:35:12.713631 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-d4b9c482-4cad-4eaa-ac0b-6158cbb5382b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:35:12.803902 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b9c482-4cad-4eaa-ac0b-6158cbb5382b service neutron] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:35:12.809734 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fae450-c4c0-41c2-a933-e1c874459a93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62401c8e1457450590f4147e0665265a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:35:12.810377 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fae450-c4c0-41c2-a933-e1c874459a93 service nova] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:35:12.810666 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fae450-c4c0-41c2-a933-e1c874459a93 service nova] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:35:12.810982 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fae450-c4c0-41c2-a933-e1c874459a93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:35:12.821201 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fae450-c4c0-41c2-a933-e1c874459a93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:35:12.822879 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fae450-c4c0-41c2-a933-e1c874459a93 service nova] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:35:12.835728 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1234/2444] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:35:12 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:35:14.522198 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef90cf-4bea-4779-b7a9-1fc504fbaec4 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:35:14.523612 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef90cf-4bea-4779-b7a9-1fc504fbaec4 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:35:14.524239 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef90cf-4bea-4779-b7a9-1fc504fbaec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:35:14.551374 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-e1ef90cf-4bea-4779-b7a9-1fc504fbaec4 None None] MFA Rules not processed for user `d277532df42244c693b5e51e9fd0c459`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:35:14.553006 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-e1ef90cf-4bea-4779-b7a9-1fc504fbaec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:35:14.561744 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1211/2445] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:35:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:35:14.937591 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fae450-c4c0-41c2-a933-e1c874459a93 service nova] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:35:14.947464 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fae450-c4c0-41c2-a933-e1c874459a93 service nova] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:35:14.951275 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6028b0-7e54-48a2-b309-92fcbf56e908 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:35:14.951885 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6028b0-7e54-48a2-b309-92fcbf56e908 service neutron] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:35:14.952156 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6028b0-7e54-48a2-b309-92fcbf56e908 service neutron] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:35:14.952430 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6028b0-7e54-48a2-b309-92fcbf56e908 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:35:14.954210 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-bf6028b0-7e54-48a2-b309-92fcbf56e908 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:35:14.965703 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6028b0-7e54-48a2-b309-92fcbf56e908 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:35:14.967195 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6028b0-7e54-48a2-b309-92fcbf56e908 service neutron] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:35:14.977140 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1235/2446] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:35:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:35:15.317146 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ef90cf-4bea-4779-b7a9-1fc504fbaec4 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:35:15.318754 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-e1ef90cf-4bea-4779-b7a9-1fc504fbaec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:35:15.401745 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:35:15.406616 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ef90cf-4bea-4779-b7a9-1fc504fbaec4 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:35:15.422289 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a23ccf-0b8d-48d6-b313-946958296e80 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6deab40ae6244d4b9affa47b274aea3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:35:15.422870 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a23ccf-0b8d-48d6-b313-946958296e80 service placement] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:35:15.423151 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a23ccf-0b8d-48d6-b313-946958296e80 service placement] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:35:15.423510 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a23ccf-0b8d-48d6-b313-946958296e80 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:35:15.425279 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-47a23ccf-0b8d-48d6-b313-946958296e80 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:35:15.438084 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a23ccf-0b8d-48d6-b313-946958296e80 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:35:15.439770 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a23ccf-0b8d-48d6-b313-946958296e80 service placement] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:35:15.452208 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1212/2447] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:35:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:35:17.639814 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6028b0-7e54-48a2-b309-92fcbf56e908 service neutron] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:35:17.652434 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6028b0-7e54-48a2-b309-92fcbf56e908 service neutron] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:35:17.657314 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd26ed4-be20-4da9-b748-cf356b775ed6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:35:17.657970 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd26ed4-be20-4da9-b748-cf356b775ed6 service neutron] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:35:17.658252 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd26ed4-be20-4da9-b748-cf356b775ed6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:35:17.658524 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd26ed4-be20-4da9-b748-cf356b775ed6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:35:17.662304 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-7dd26ed4-be20-4da9-b748-cf356b775ed6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:35:17.673737 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd26ed4-be20-4da9-b748-cf356b775ed6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:35:17.676072 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd26ed4-be20-4da9-b748-cf356b775ed6 service neutron] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:35:17.689316 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1236/2448] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:35:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:35:18.064160 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a23ccf-0b8d-48d6-b313-946958296e80 service placement] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:35:18.077753 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a23ccf-0b8d-48d6-b313-946958296e80 service placement] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:35:18.084622 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef6b0f1-479b-41b6-ad5b-98182710cf6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62401c8e1457450590f4147e0665265a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:35:18.085441 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef6b0f1-479b-41b6-ad5b-98182710cf6e service nova] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:35:18.085791 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef6b0f1-479b-41b6-ad5b-98182710cf6e service nova] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:35:18.086137 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef6b0f1-479b-41b6-ad5b-98182710cf6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:35:18.088070 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-cef6b0f1-479b-41b6-ad5b-98182710cf6e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:35:18.161177 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef6b0f1-479b-41b6-ad5b-98182710cf6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:35:18.162800 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef6b0f1-479b-41b6-ad5b-98182710cf6e service nova] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:35:18.173573 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1213/2449] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:35:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:35:20.484089 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8c46ca-3ce3-4a40-9e58-c05e79e43919 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:35:20.484636 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8c46ca-3ce3-4a40-9e58-c05e79e43919 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:35:20.484636 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8c46ca-3ce3-4a40-9e58-c05e79e43919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:35:20.507309 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-cf8c46ca-3ce3-4a40-9e58-c05e79e43919 None None] MFA Rules not processed for user `149aa48acd504354a1d021885ca51334`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:35:20.508604 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-cf8c46ca-3ce3-4a40-9e58-c05e79e43919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:35:20.531022 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:35:20.579558 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1237/2450] 10.222.0.79 () {58 vars in 1009 bytes} [Wed Aug 31 12:35:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:35:20.638262 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef6b0f1-479b-41b6-ad5b-98182710cf6e service nova] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:35:20.640395 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-cef6b0f1-479b-41b6-ad5b-98182710cf6e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:35:20.727090 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef6b0f1-479b-41b6-ad5b-98182710cf6e service nova] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:35:20.732120 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0677edf0-6ae4-4d92-bca1-c01ba8a47663 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896540cc14f40b08d05ade32cfd0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:35:20.732744 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0677edf0-6ae4-4d92-bca1-c01ba8a47663 service swift] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:35:20.733026 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0677edf0-6ae4-4d92-bca1-c01ba8a47663 service swift] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:35:20.733309 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0677edf0-6ae4-4d92-bca1-c01ba8a47663 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:35:20.743252 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0677edf0-6ae4-4d92-bca1-c01ba8a47663 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:35:20.744856 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0677edf0-6ae4-4d92-bca1-c01ba8a47663 service swift] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:35:20.755489 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1214/2451] 10.222.0.79 () {60 vars in 1384 bytes} [Wed Aug 31 12:35:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 31 12:35:25.745905 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8c46ca-3ce3-4a40-9e58-c05e79e43919 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:35:25.782237 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8c46ca-3ce3-4a40-9e58-c05e79e43919 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:35:25.796968 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc91e71-4f33-4110-ba35-863ee302578f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62401c8e1457450590f4147e0665265a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:35:25.797611 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc91e71-4f33-4110-ba35-863ee302578f service nova] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:35:25.797899 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc91e71-4f33-4110-ba35-863ee302578f service nova] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:35:25.801399 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc91e71-4f33-4110-ba35-863ee302578f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:35:25.807611 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-bdc91e71-4f33-4110-ba35-863ee302578f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:35:25.841166 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc91e71-4f33-4110-ba35-863ee302578f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:35:25.842802 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc91e71-4f33-4110-ba35-863ee302578f service nova] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:35:25.884012 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1238/2452] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:35:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:35:28.949291 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b0896-00f2-4e4e-898e-471b010623e9 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:35:28.952377 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b0896-00f2-4e4e-898e-471b010623e9 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:35:28.952974 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b0896-00f2-4e4e-898e-471b010623e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:35:28.982091 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-7f1b0896-00f2-4e4e-898e-471b010623e9 None None] MFA Rules not processed for user `2e77671c123f434489d82da79212d0ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:35:28.983771 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-7f1b0896-00f2-4e4e-898e-471b010623e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:35:29.088420 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1215/2453] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:35:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:35:35.862864 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=21 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:35:39.074220 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=89 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:35:39.395950 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e60cad7-1488-464e-8d0b-52a5fa8f7c56 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:35:39.396419 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e60cad7-1488-464e-8d0b-52a5fa8f7c56 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:35:39.396532 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e60cad7-1488-464e-8d0b-52a5fa8f7c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:35:39.416428 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-2e60cad7-1488-464e-8d0b-52a5fa8f7c56 None None] MFA Rules not processed for user `149aa48acd504354a1d021885ca51334`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:35:39.417629 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-2e60cad7-1488-464e-8d0b-52a5fa8f7c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:35:39.424758 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1239/2454] 10.222.0.79 () {58 vars in 1009 bytes} [Wed Aug 31 12:35:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:35:39.437861 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1b0896-00f2-4e4e-898e-471b010623e9 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:35:39.449923 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1b0896-00f2-4e4e-898e-471b010623e9 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:35:39.455195 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4aaad4-0708-4b01-b869-026b1c33c94b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896540cc14f40b08d05ade32cfd0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:35:39.455800 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4aaad4-0708-4b01-b869-026b1c33c94b service swift] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:35:39.456075 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4aaad4-0708-4b01-b869-026b1c33c94b service swift] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:35:39.456874 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4aaad4-0708-4b01-b869-026b1c33c94b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:35:39.465062 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4aaad4-0708-4b01-b869-026b1c33c94b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:35:39.466625 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4aaad4-0708-4b01-b869-026b1c33c94b service swift] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:35:39.475133 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1216/2455] 10.222.0.79 () {60 vars in 1384 bytes} [Wed Aug 31 12:35:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 12:35:49.411428 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=3 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:35:49.471326 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=6 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:35:53.677011 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e60cad7-1488-464e-8d0b-52a5fa8f7c56 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:35:53.692664 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e60cad7-1488-464e-8d0b-52a5fa8f7c56 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:35:53.698789 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b87c4c-5ab1-4856-8361-c1dc37413929 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62401c8e1457450590f4147e0665265a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:35:53.699481 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b87c4c-5ab1-4856-8361-c1dc37413929 service nova] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:35:53.699911 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b87c4c-5ab1-4856-8361-c1dc37413929 service nova] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:35:53.700187 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b87c4c-5ab1-4856-8361-c1dc37413929 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:35:53.701942 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-36b87c4c-5ab1-4856-8361-c1dc37413929 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:35:53.716081 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b87c4c-5ab1-4856-8361-c1dc37413929 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:35:53.717972 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b87c4c-5ab1-4856-8361-c1dc37413929 service nova] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:35:53.729876 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1240/2456] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:35:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:35:55.359923 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de368d-00fe-4a9a-a51a-c3dd059e3044 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:35:55.360443 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de368d-00fe-4a9a-a51a-c3dd059e3044 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:35:55.360443 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de368d-00fe-4a9a-a51a-c3dd059e3044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:35:55.383487 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-08de368d-00fe-4a9a-a51a-c3dd059e3044 None None] MFA Rules not processed for user `149aa48acd504354a1d021885ca51334`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:35:55.384726 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-08de368d-00fe-4a9a-a51a-c3dd059e3044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:35:55.392774 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1217/2457] 10.222.0.79 () {58 vars in 967 bytes} [Wed Aug 31 12:35:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:35:55.407184 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b87c4c-5ab1-4856-8361-c1dc37413929 service nova] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:35:55.421450 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b87c4c-5ab1-4856-8361-c1dc37413929 service nova] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:35:55.426834 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29797a05-d26a-4de4-8bd2-bda67a5ae455 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896540cc14f40b08d05ade32cfd0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:35:55.428032 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29797a05-d26a-4de4-8bd2-bda67a5ae455 service swift] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:35:55.428310 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29797a05-d26a-4de4-8bd2-bda67a5ae455 service swift] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:35:55.428579 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29797a05-d26a-4de4-8bd2-bda67a5ae455 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:35:55.437918 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29797a05-d26a-4de4-8bd2-bda67a5ae455 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:35:55.439599 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29797a05-d26a-4de4-8bd2-bda67a5ae455 service swift] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:35:55.454006 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1241/2458] 10.222.0.79 () {60 vars in 1384 bytes} [Wed Aug 31 12:35:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 12:36:00.609850 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de368d-00fe-4a9a-a51a-c3dd059e3044 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:00.622383 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de368d-00fe-4a9a-a51a-c3dd059e3044 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:00.626956 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4dd12d-1499-48c1-84e6-8068abd85af9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:00.627592 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4dd12d-1499-48c1-84e6-8068abd85af9 service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:00.627868 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4dd12d-1499-48c1-84e6-8068abd85af9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:00.628135 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4dd12d-1499-48c1-84e6-8068abd85af9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:00.630186 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-5a4dd12d-1499-48c1-84e6-8068abd85af9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:36:00.644156 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4dd12d-1499-48c1-84e6-8068abd85af9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:00.645636 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4dd12d-1499-48c1-84e6-8068abd85af9 service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:00.662526 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1218/2459] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:36:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:36:04.023046 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29797a05-d26a-4de4-8bd2-bda67a5ae455 service swift] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:04.024548 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-29797a05-d26a-4de4-8bd2-bda67a5ae455 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:36:04.039341 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29797a05-d26a-4de4-8bd2-bda67a5ae455 service swift] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:04.044438 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dbb897-a642-4477-bb0f-38cd0d6b3042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:04.045078 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dbb897-a642-4477-bb0f-38cd0d6b3042 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:04.045354 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dbb897-a642-4477-bb0f-38cd0d6b3042 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:04.045626 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dbb897-a642-4477-bb0f-38cd0d6b3042 admin admin] PATH_INFO: `/v3/users/937aa5c23271467f83b05f570fde7468` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:04.046815 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dbb897-a642-4477-bb0f-38cd0d6b3042 admin admin] RBAC: Authorizing `identity:delete_user(user_id=937aa5c23271467f83b05f570fde7468)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:04.048768 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dbb897-a642-4477-bb0f-38cd0d6b3042 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:04.097259 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-f7dbb897-a642-4477-bb0f-38cd0d6b3042 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '937aa5c23271467f83b05f570fde7468'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:04.110402 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-f7dbb897-a642-4477-bb0f-38cd0d6b3042 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '937aa5c23271467f83b05f570fde7468'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:04.117635 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-f7dbb897-a642-4477-bb0f-38cd0d6b3042 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '937aa5c23271467f83b05f570fde7468'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:04.118344 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-f7dbb897-a642-4477-bb0f-38cd0d6b3042 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '937aa5c23271467f83b05f570fde7468'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:04.125982 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-f7dbb897-a642-4477-bb0f-38cd0d6b3042 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '937aa5c23271467f83b05f570fde7468'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:04.131954 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1242/2460] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:36:04 2022] DELETE /identity/v3/users/937aa5c23271467f83b05f570fde7468 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:36:04.314315 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4dd12d-1499-48c1-84e6-8068abd85af9 service neutron] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:04.328395 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4dd12d-1499-48c1-84e6-8068abd85af9 service neutron] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:04.393472 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e198b-adde-40cc-acd7-d898e4f33444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:04.394108 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e198b-adde-40cc-acd7-d898e4f33444 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:04.394389 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e198b-adde-40cc-acd7-d898e4f33444 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:04.394661 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e198b-adde-40cc-acd7-d898e4f33444 admin admin] PATH_INFO: `/v3/projects/0b1d7ad43ff24c31af3b53349b2063cd` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:04.395836 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59e198b-adde-40cc-acd7-d898e4f33444 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b1d7ad43ff24c31af3b53349b2063cd)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:04.397941 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59e198b-adde-40cc-acd7-d898e4f33444 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:04.445096 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-d59e198b-adde-40cc-acd7-d898e4f33444 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b1d7ad43ff24c31af3b53349b2063cd', 'request_id': 'req-d59e198b-adde-40cc-acd7-d898e4f33444'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:04.452688 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-d59e198b-adde-40cc-acd7-d898e4f33444 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b1d7ad43ff24c31af3b53349b2063cd', 'request_id': 'req-d59e198b-adde-40cc-acd7-d898e4f33444'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:04.459038 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-d59e198b-adde-40cc-acd7-d898e4f33444 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b1d7ad43ff24c31af3b53349b2063cd', 'request_id': 'req-d59e198b-adde-40cc-acd7-d898e4f33444'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:04.469511 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-d59e198b-adde-40cc-acd7-d898e4f33444 admin admin] The token cache is being invalidate because project 0b1d7ad43ff24c31af3b53349b2063cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:36:04.469800 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-d59e198b-adde-40cc-acd7-d898e4f33444 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:04.470435 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-d59e198b-adde-40cc-acd7-d898e4f33444 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:04.471970 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1219/2461] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:36:04 2022] DELETE /identity/v3/projects/0b1d7ad43ff24c31af3b53349b2063cd => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:36:04.477601 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cbb404-ddf4-4bd2-b925-3bafa00ce640 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:04.478040 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cbb404-ddf4-4bd2-b925-3bafa00ce640 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:04.478426 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cbb404-ddf4-4bd2-b925-3bafa00ce640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:04.499165 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-35cbb404-ddf4-4bd2-b925-3bafa00ce640 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:36:04.500486 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-35cbb404-ddf4-4bd2-b925-3bafa00ce640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:36:04.559681 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1243/2462] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:36:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:36:04.567553 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb6128-e582-4ddb-abb9-e07163811fd7 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:04.567836 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb6128-e582-4ddb-abb9-e07163811fd7 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:04.568230 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb6128-e582-4ddb-abb9-e07163811fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:04.587867 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-7fbb6128-e582-4ddb-abb9-e07163811fd7 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:36:04.589089 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-7fbb6128-e582-4ddb-abb9-e07163811fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:36:04.597136 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1220/2463] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:36:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:36:04.601957 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cbb404-ddf4-4bd2-b925-3bafa00ce640 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:04.611565 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cbb404-ddf4-4bd2-b925-3bafa00ce640 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:04.617175 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f255e1-59f0-4ef8-b117-fc44445ff6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:04.617793 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f255e1-59f0-4ef8-b117-fc44445ff6b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:04.618071 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f255e1-59f0-4ef8-b117-fc44445ff6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:04.618337 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f255e1-59f0-4ef8-b117-fc44445ff6b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:04.619348 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f255e1-59f0-4ef8-b117-fc44445ff6b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:36:04.619655 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f255e1-59f0-4ef8-b117-fc44445ff6b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:04.621262 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f255e1-59f0-4ef8-b117-fc44445ff6b1 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:04.633919 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1244/2464] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 12:36:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:36:04.638249 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbb6128-e582-4ddb-abb9-e07163811fd7 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:04.647919 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbb6128-e582-4ddb-abb9-e07163811fd7 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:04.653495 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc885615-4baf-4f48-a3da-7e965e9218d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:04.654100 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc885615-4baf-4f48-a3da-7e965e9218d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:04.654393 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc885615-4baf-4f48-a3da-7e965e9218d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:04.654654 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc885615-4baf-4f48-a3da-7e965e9218d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:04.655327 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc885615-4baf-4f48-a3da-7e965e9218d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:04.657227 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc885615-4baf-4f48-a3da-7e965e9218d8 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:04.686303 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1221/2465] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:36:04 2022] POST /identity/v3/projects => generated 367 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:36:04.690453 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f255e1-59f0-4ef8-b117-fc44445ff6b1 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:04.700789 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f255e1-59f0-4ef8-b117-fc44445ff6b1 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:04.729954 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:36:04.759427 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3741369c-dee1-4232-81c8-841a32d31f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:04.760035 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3741369c-dee1-4232-81c8-841a32d31f27 admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:04.760315 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3741369c-dee1-4232-81c8-841a32d31f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:04.760581 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3741369c-dee1-4232-81c8-841a32d31f27 admin admin] PATH_INFO: `/v3/users` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:04.761204 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3741369c-dee1-4232-81c8-841a32d31f27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:04.763142 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3741369c-dee1-4232-81c8-841a32d31f27 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:04.785754 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1245/2466] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:36:04 2022] POST /identity/v3/users => generated 284 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:36:04.790147 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc885615-4baf-4f48-a3da-7e965e9218d8 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:04.801254 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc885615-4baf-4f48-a3da-7e965e9218d8 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:04.805885 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b242a393-bfe9-4761-830f-495c4a1986e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:04.806480 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242a393-bfe9-4761-830f-495c4a1986e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:04.806756 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242a393-bfe9-4761-830f-495c4a1986e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:04.807054 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242a393-bfe9-4761-830f-495c4a1986e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:04.807684 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b242a393-bfe9-4761-830f-495c4a1986e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:04.809265 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b242a393-bfe9-4761-830f-495c4a1986e6 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:04.820166 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1222/2467] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:36:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:36:04.824059 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3741369c-dee1-4232-81c8-841a32d31f27 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:04.835104 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3741369c-dee1-4232-81c8-841a32d31f27 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:04.839838 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771be61b-4926-4c80-a67f-e6e4c4bfb999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:04.840452 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771be61b-4926-4c80-a67f-e6e4c4bfb999 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:04.840739 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771be61b-4926-4c80-a67f-e6e4c4bfb999 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:04.841014 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771be61b-4926-4c80-a67f-e6e4c4bfb999 admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:04.841653 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771be61b-4926-4c80-a67f-e6e4c4bfb999 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:04.843308 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771be61b-4926-4c80-a67f-e6e4c4bfb999 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:04.855154 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1246/2468] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:36:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:36:04.859366 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b242a393-bfe9-4761-830f-495c4a1986e6 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:04.871927 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b242a393-bfe9-4761-830f-495c4a1986e6 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:04.877583 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb5162f-13b6-4f70-9b35-e2b0731b367f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:04.878259 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb5162f-13b6-4f70-9b35-e2b0731b367f admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:04.878539 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb5162f-13b6-4f70-9b35-e2b0731b367f admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:04.878814 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb5162f-13b6-4f70-9b35-e2b0731b367f admin admin] PATH_INFO: `/v3/projects/3b21fc03625743c39725ecbdd28cdbe0/users/8baa57e5fbf84dc8a3c770f8774503da/roles/b5cfd7a855a448359e9017f51d32b6fc` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:04.895821 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb5162f-13b6-4f70-9b35-e2b0731b367f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b21fc03625743c39725ecbdd28cdbe0, user_id=8baa57e5fbf84dc8a3c770f8774503da, role_id=b5cfd7a855a448359e9017f51d32b6fc)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:04.898601 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb5162f-13b6-4f70-9b35-e2b0731b367f admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:04.913316 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1223/2469] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:36:04 2022] PUT /identity/v3/projects/3b21fc03625743c39725ecbdd28cdbe0/users/8baa57e5fbf84dc8a3c770f8774503da/roles/b5cfd7a855a448359e9017f51d32b6fc => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:36:04.925360 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd9225-1cd1-473b-8139-3c080b7586ca None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:04.925646 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd9225-1cd1-473b-8139-3c080b7586ca None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:04.925917 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd9225-1cd1-473b-8139-3c080b7586ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:04.954487 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-53dd9225-1cd1-473b-8139-3c080b7586ca None None] MFA Rules not processed for user `8baa57e5fbf84dc8a3c770f8774503da`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:36:04.955728 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-53dd9225-1cd1-473b-8139-3c080b7586ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:36:05.019361 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1247/2470] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:36:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:36:05.030377 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb5162f-13b6-4f70-9b35-e2b0731b367f admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:05.032088 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-0bb5162f-13b6-4f70-9b35-e2b0731b367f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:36:05.042332 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:36:05.091672 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb5162f-13b6-4f70-9b35-e2b0731b367f admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:05.095235 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bb2fc4-ec45-4dd1-ac97-4d317b959877 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e79503178ac54e62ba385467d5617ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:05.095858 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bb2fc4-ec45-4dd1-ac97-4d317b959877 service cinder] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:05.096117 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bb2fc4-ec45-4dd1-ac97-4d317b959877 service cinder] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:05.096385 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bb2fc4-ec45-4dd1-ac97-4d317b959877 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:05.104710 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bb2fc4-ec45-4dd1-ac97-4d317b959877 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:05.106131 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bb2fc4-ec45-4dd1-ac97-4d317b959877 service cinder] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:05.115586 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1224/2471] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:36:05 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:36:13.570805 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dd9225-1cd1-473b-8139-3c080b7586ca None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:13.637547 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dd9225-1cd1-473b-8139-3c080b7586ca None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:13.642487 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968e737b-55e3-4d45-9bc7-227d10f1c64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:13.643159 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968e737b-55e3-4d45-9bc7-227d10f1c64b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:13.643613 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968e737b-55e3-4d45-9bc7-227d10f1c64b admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:13.643757 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968e737b-55e3-4d45-9bc7-227d10f1c64b admin admin] PATH_INFO: `/v3/users/8baa57e5fbf84dc8a3c770f8774503da` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:13.645566 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968e737b-55e3-4d45-9bc7-227d10f1c64b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8baa57e5fbf84dc8a3c770f8774503da)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:13.649406 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968e737b-55e3-4d45-9bc7-227d10f1c64b admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:13.706351 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:36:13.710971 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-968e737b-55e3-4d45-9bc7-227d10f1c64b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8baa57e5fbf84dc8a3c770f8774503da'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:13.724432 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-968e737b-55e3-4d45-9bc7-227d10f1c64b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8baa57e5fbf84dc8a3c770f8774503da'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:13.732732 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-968e737b-55e3-4d45-9bc7-227d10f1c64b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8baa57e5fbf84dc8a3c770f8774503da'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:13.733540 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-968e737b-55e3-4d45-9bc7-227d10f1c64b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8baa57e5fbf84dc8a3c770f8774503da'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:13.743137 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-968e737b-55e3-4d45-9bc7-227d10f1c64b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8baa57e5fbf84dc8a3c770f8774503da'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:13.749952 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1248/2472] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:36:13 2022] DELETE /identity/v3/users/8baa57e5fbf84dc8a3c770f8774503da => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:36:13.757077 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a6fe2a-2b2e-43b1-8b10-b278b69d0f03 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:13.757855 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a6fe2a-2b2e-43b1-8b10-b278b69d0f03 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:13.757855 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a6fe2a-2b2e-43b1-8b10-b278b69d0f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:13.780729 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-b8a6fe2a-2b2e-43b1-8b10-b278b69d0f03 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:36:13.782602 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-b8a6fe2a-2b2e-43b1-8b10-b278b69d0f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:36:13.852647 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1225/2473] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:36:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:36:13.864123 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968e737b-55e3-4d45-9bc7-227d10f1c64b admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:13.865658 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-968e737b-55e3-4d45-9bc7-227d10f1c64b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:36:13.935515 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968e737b-55e3-4d45-9bc7-227d10f1c64b admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:13.939411 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f1a64f-50fe-46af-95ad-c56480962371 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:13.940032 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f1a64f-50fe-46af-95ad-c56480962371 service neutron] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:13.940317 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f1a64f-50fe-46af-95ad-c56480962371 service neutron] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:13.940591 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f1a64f-50fe-46af-95ad-c56480962371 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:13.950630 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f1a64f-50fe-46af-95ad-c56480962371 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:13.952148 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f1a64f-50fe-46af-95ad-c56480962371 service neutron] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:13.963768 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1249/2474] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:36:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:36:14.379965 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a6fe2a-2b2e-43b1-8b10-b278b69d0f03 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:14.382019 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-b8a6fe2a-2b2e-43b1-8b10-b278b69d0f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:36:14.394826 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a6fe2a-2b2e-43b1-8b10-b278b69d0f03 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:14.401059 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee4bde4-ebf4-431e-8437-e53329fe1300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:14.401874 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4bde4-ebf4-431e-8437-e53329fe1300 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:14.402153 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4bde4-ebf4-431e-8437-e53329fe1300 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:14.402427 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4bde4-ebf4-431e-8437-e53329fe1300 admin admin] PATH_INFO: `/v3/projects/3b21fc03625743c39725ecbdd28cdbe0` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:14.403687 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee4bde4-ebf4-431e-8437-e53329fe1300 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b21fc03625743c39725ecbdd28cdbe0)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:14.405627 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee4bde4-ebf4-431e-8437-e53329fe1300 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:14.461966 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-7ee4bde4-ebf4-431e-8437-e53329fe1300 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b21fc03625743c39725ecbdd28cdbe0', 'request_id': 'req-7ee4bde4-ebf4-431e-8437-e53329fe1300'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:14.470098 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-7ee4bde4-ebf4-431e-8437-e53329fe1300 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b21fc03625743c39725ecbdd28cdbe0', 'request_id': 'req-7ee4bde4-ebf4-431e-8437-e53329fe1300'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:14.476976 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-7ee4bde4-ebf4-431e-8437-e53329fe1300 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b21fc03625743c39725ecbdd28cdbe0', 'request_id': 'req-7ee4bde4-ebf4-431e-8437-e53329fe1300'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:14.490354 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-7ee4bde4-ebf4-431e-8437-e53329fe1300 admin admin] The token cache is being invalidate because project 3b21fc03625743c39725ecbdd28cdbe0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:36:14.490735 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-7ee4bde4-ebf4-431e-8437-e53329fe1300 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:14.492191 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-7ee4bde4-ebf4-431e-8437-e53329fe1300 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:14.494008 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1226/2475] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:36:14 2022] DELETE /identity/v3/projects/3b21fc03625743c39725ecbdd28cdbe0 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:36:14.498659 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b61807-59c0-4a20-a10d-45985e28a8f9 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:14.498986 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b61807-59c0-4a20-a10d-45985e28a8f9 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:14.499267 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b61807-59c0-4a20-a10d-45985e28a8f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:14.528213 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-93b61807-59c0-4a20-a10d-45985e28a8f9 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:36:14.530351 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-93b61807-59c0-4a20-a10d-45985e28a8f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:36:14.621099 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1250/2476] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:36:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:36:14.632055 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c24e3b-194b-4007-ad9c-a780e9cb5d02 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:14.632953 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c24e3b-194b-4007-ad9c-a780e9cb5d02 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:14.633450 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c24e3b-194b-4007-ad9c-a780e9cb5d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:14.663319 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-68c24e3b-194b-4007-ad9c-a780e9cb5d02 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:36:14.663319 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-68c24e3b-194b-4007-ad9c-a780e9cb5d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:36:14.675407 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1227/2477] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:36:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:36:14.682020 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b61807-59c0-4a20-a10d-45985e28a8f9 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:14.692823 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b61807-59c0-4a20-a10d-45985e28a8f9 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:14.698785 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e9408a-95fb-4831-a46d-00197d6e3435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:14.699675 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e9408a-95fb-4831-a46d-00197d6e3435 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:14.699828 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e9408a-95fb-4831-a46d-00197d6e3435 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:14.699983 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e9408a-95fb-4831-a46d-00197d6e3435 admin admin] PATH_INFO: `/v3/domains` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:14.700886 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e9408a-95fb-4831-a46d-00197d6e3435 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:36:14.700981 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e9408a-95fb-4831-a46d-00197d6e3435 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:14.702551 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e9408a-95fb-4831-a46d-00197d6e3435 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:14.715586 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1251/2478] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 12:36:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:36:14.721449 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c24e3b-194b-4007-ad9c-a780e9cb5d02 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:14.730236 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c24e3b-194b-4007-ad9c-a780e9cb5d02 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:14.736572 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719d3714-415b-4bd5-8786-9af3d25a66b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:14.737191 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d3714-415b-4bd5-8786-9af3d25a66b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:14.737466 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d3714-415b-4bd5-8786-9af3d25a66b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:14.737733 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d3714-415b-4bd5-8786-9af3d25a66b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:14.738646 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719d3714-415b-4bd5-8786-9af3d25a66b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:14.741474 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719d3714-415b-4bd5-8786-9af3d25a66b3 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:14.774649 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1228/2479] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:36:14 2022] POST /identity/v3/projects => generated 365 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:36:14.775854 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e9408a-95fb-4831-a46d-00197d6e3435 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:14.786343 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e9408a-95fb-4831-a46d-00197d6e3435 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:14.839378 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:36:14.852192 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced43503-a79e-4eb9-89f5-379f4a36beba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:14.852815 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced43503-a79e-4eb9-89f5-379f4a36beba admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:14.853098 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced43503-a79e-4eb9-89f5-379f4a36beba admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:14.853374 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced43503-a79e-4eb9-89f5-379f4a36beba admin admin] PATH_INFO: `/v3/users` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:14.854053 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced43503-a79e-4eb9-89f5-379f4a36beba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:14.856020 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced43503-a79e-4eb9-89f5-379f4a36beba admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:14.883169 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1252/2480] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:36:14 2022] POST /identity/v3/users => generated 283 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:36:14.887395 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719d3714-415b-4bd5-8786-9af3d25a66b3 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:14.894639 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:36:14.899128 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719d3714-415b-4bd5-8786-9af3d25a66b3 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:14.905492 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f3bf57-78d4-4745-aa87-bfe7338485ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:14.906383 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f3bf57-78d4-4745-aa87-bfe7338485ff admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:14.907596 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f3bf57-78d4-4745-aa87-bfe7338485ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:14.907942 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f3bf57-78d4-4745-aa87-bfe7338485ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:14.908608 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f3bf57-78d4-4745-aa87-bfe7338485ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:14.910746 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f3bf57-78d4-4745-aa87-bfe7338485ff admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:14.922301 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1229/2481] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:36:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:36:14.926311 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced43503-a79e-4eb9-89f5-379f4a36beba admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:14.937986 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced43503-a79e-4eb9-89f5-379f4a36beba admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:14.942899 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524b64e9-151d-451c-8bfa-db8fa8477a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:14.943544 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b64e9-151d-451c-8bfa-db8fa8477a12 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:14.943856 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b64e9-151d-451c-8bfa-db8fa8477a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:14.945173 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b64e9-151d-451c-8bfa-db8fa8477a12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:14.945357 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524b64e9-151d-451c-8bfa-db8fa8477a12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:14.946991 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524b64e9-151d-451c-8bfa-db8fa8477a12 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:14.957797 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1253/2482] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:36:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:36:14.963182 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f3bf57-78d4-4745-aa87-bfe7338485ff admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:14.973550 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f3bf57-78d4-4745-aa87-bfe7338485ff admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:14.979720 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc16382-1818-49a2-aba0-71b9322f6cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:14.980502 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc16382-1818-49a2-aba0-71b9322f6cac admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:14.981019 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc16382-1818-49a2-aba0-71b9322f6cac admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:14.981141 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc16382-1818-49a2-aba0-71b9322f6cac admin admin] PATH_INFO: `/v3/projects/1c0b95e37c3a4005bbc21d9f256a3431/users/4a9f651a1de145438adc46afbdcd0817/roles/b5cfd7a855a448359e9017f51d32b6fc` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:15.003851 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc16382-1818-49a2-aba0-71b9322f6cac admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c0b95e37c3a4005bbc21d9f256a3431, user_id=4a9f651a1de145438adc46afbdcd0817, role_id=b5cfd7a855a448359e9017f51d32b6fc)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:15.007050 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc16382-1818-49a2-aba0-71b9322f6cac admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:15.018762 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5503118-05a2-4008-a124-8b9b2a594fb0 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:15.019152 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5503118-05a2-4008-a124-8b9b2a594fb0 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:15.019458 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5503118-05a2-4008-a124-8b9b2a594fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:15.022779 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1230/2483] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:36:14 2022] PUT /identity/v3/projects/1c0b95e37c3a4005bbc21d9f256a3431/users/4a9f651a1de145438adc46afbdcd0817/roles/b5cfd7a855a448359e9017f51d32b6fc => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:36:15.035177 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d385a0-ccc8-452a-9def-8d45acfa6166 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:15.036037 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d385a0-ccc8-452a-9def-8d45acfa6166 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:15.036329 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d385a0-ccc8-452a-9def-8d45acfa6166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:15.043202 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-d5503118-05a2-4008-a124-8b9b2a594fb0 None None] MFA Rules not processed for user `d277532df42244c693b5e51e9fd0c459`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:36:15.044475 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-d5503118-05a2-4008-a124-8b9b2a594fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:36:15.070275 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-36d385a0-ccc8-452a-9def-8d45acfa6166 None None] MFA Rules not processed for user `4a9f651a1de145438adc46afbdcd0817`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:36:15.071995 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-36d385a0-ccc8-452a-9def-8d45acfa6166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:36:15.102569 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1254/2484] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:36:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:36:15.142443 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1231/2485] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:36:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:36:15.147002 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5503118-05a2-4008-a124-8b9b2a594fb0 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:15.223519 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5503118-05a2-4008-a124-8b9b2a594fb0 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:15.229010 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6e4c3d-e5fc-49fe-b2de-24d95c570a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:15.229628 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e4c3d-e5fc-49fe-b2de-24d95c570a91 admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:15.229909 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e4c3d-e5fc-49fe-b2de-24d95c570a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:15.230181 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e4c3d-e5fc-49fe-b2de-24d95c570a91 admin admin] PATH_INFO: `/v3/projects` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:15.230814 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6e4c3d-e5fc-49fe-b2de-24d95c570a91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:15.232798 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6e4c3d-e5fc-49fe-b2de-24d95c570a91 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:15.262959 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1255/2486] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:36:15 2022] POST /identity/v3/projects => generated 363 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:36:15.267134 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d385a0-ccc8-452a-9def-8d45acfa6166 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:15.278520 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d385a0-ccc8-452a-9def-8d45acfa6166 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:15.341490 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8659770-abff-429f-8229-149dc339ea42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:15.342157 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8659770-abff-429f-8229-149dc339ea42 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:15.342442 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8659770-abff-429f-8229-149dc339ea42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:15.342714 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8659770-abff-429f-8229-149dc339ea42 admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:15.343453 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8659770-abff-429f-8229-149dc339ea42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:15.345457 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8659770-abff-429f-8229-149dc339ea42 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:15.370918 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1232/2487] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:36:15 2022] POST /identity/v3/users => generated 288 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:36:15.375126 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6e4c3d-e5fc-49fe-b2de-24d95c570a91 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:15.387464 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6e4c3d-e5fc-49fe-b2de-24d95c570a91 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:15.393011 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8e9329-7cdd-4471-ba76-709f2dea85a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:15.393648 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e9329-7cdd-4471-ba76-709f2dea85a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:15.393928 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e9329-7cdd-4471-ba76-709f2dea85a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:15.394198 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e9329-7cdd-4471-ba76-709f2dea85a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:15.394899 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8e9329-7cdd-4471-ba76-709f2dea85a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:15.396506 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8e9329-7cdd-4471-ba76-709f2dea85a8 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:15.409350 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1256/2488] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:36:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 12:36:15.414533 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8659770-abff-429f-8229-149dc339ea42 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:15.424996 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8659770-abff-429f-8229-149dc339ea42 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:15.429936 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346c991c-b79a-4df9-b6c1-2bb466ee6ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:15.430607 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346c991c-b79a-4df9-b6c1-2bb466ee6ea6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:15.430906 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346c991c-b79a-4df9-b6c1-2bb466ee6ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:15.431181 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346c991c-b79a-4df9-b6c1-2bb466ee6ea6 admin admin] PATH_INFO: `/v3/projects/616161119f54421d933be6cd4922d887/users/58cf387d006f4647bc2d9388f6f9400f/roles/a332ef951db949b0bad7019fbd28a1b9` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:15.451667 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346c991c-b79a-4df9-b6c1-2bb466ee6ea6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=616161119f54421d933be6cd4922d887, user_id=58cf387d006f4647bc2d9388f6f9400f, role_id=a332ef951db949b0bad7019fbd28a1b9)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:15.454424 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346c991c-b79a-4df9-b6c1-2bb466ee6ea6 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:15.471744 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1233/2489] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:36:15 2022] PUT /identity/v3/projects/616161119f54421d933be6cd4922d887/users/58cf387d006f4647bc2d9388f6f9400f/roles/a332ef951db949b0bad7019fbd28a1b9 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:36:15.477051 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8e9329-7cdd-4471-ba76-709f2dea85a8 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:15.487870 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8e9329-7cdd-4471-ba76-709f2dea85a8 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:15.540158 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:36:15.555731 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5033493a-8b86-4dc8-843b-b974f4aaf903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:15.556345 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5033493a-8b86-4dc8-843b-b974f4aaf903 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:15.556638 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5033493a-8b86-4dc8-843b-b974f4aaf903 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:15.556908 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5033493a-8b86-4dc8-843b-b974f4aaf903 admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:15.557547 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5033493a-8b86-4dc8-843b-b974f4aaf903 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:15.559254 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5033493a-8b86-4dc8-843b-b974f4aaf903 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:15.569466 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1257/2490] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:36:15 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:36:15.573752 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346c991c-b79a-4df9-b6c1-2bb466ee6ea6 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:15.584438 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346c991c-b79a-4df9-b6c1-2bb466ee6ea6 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:15.589955 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcd5956-8016-4949-a9ee-411998d31ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:15.590618 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd5956-8016-4949-a9ee-411998d31ae2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:15.590948 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd5956-8016-4949-a9ee-411998d31ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:15.591252 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd5956-8016-4949-a9ee-411998d31ae2 admin admin] PATH_INFO: `/v3/projects/616161119f54421d933be6cd4922d887/users/58cf387d006f4647bc2d9388f6f9400f/roles/a332ef951db949b0bad7019fbd28a1b9` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:15.593186 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcd5956-8016-4949-a9ee-411998d31ae2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=616161119f54421d933be6cd4922d887, user_id=58cf387d006f4647bc2d9388f6f9400f, role_id=a332ef951db949b0bad7019fbd28a1b9)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:15.595902 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcd5956-8016-4949-a9ee-411998d31ae2 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:15.607445 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1234/2491] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:36:15 2022] PUT /identity/v3/projects/616161119f54421d933be6cd4922d887/users/58cf387d006f4647bc2d9388f6f9400f/roles/a332ef951db949b0bad7019fbd28a1b9 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:36:15.619434 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0d978-ee4a-4853-83d7-df0dad9e61d3 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:15.619707 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0d978-ee4a-4853-83d7-df0dad9e61d3 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:15.619975 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0d978-ee4a-4853-83d7-df0dad9e61d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:15.649523 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-40c0d978-ee4a-4853-83d7-df0dad9e61d3 None None] MFA Rules not processed for user `58cf387d006f4647bc2d9388f6f9400f`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:36:15.650736 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-40c0d978-ee4a-4853-83d7-df0dad9e61d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:36:15.730436 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1258/2492] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:36:15 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:36:15.743601 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcd5956-8016-4949-a9ee-411998d31ae2 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:15.745999 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-9fcd5956-8016-4949-a9ee-411998d31ae2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:36:15.770096 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:36:15.845637 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcd5956-8016-4949-a9ee-411998d31ae2 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:15.854774 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9750e34f-a125-490f-b76a-e2e525e2f6d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e79503178ac54e62ba385467d5617ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:15.855456 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9750e34f-a125-490f-b76a-e2e525e2f6d8 service cinder] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:15.855762 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9750e34f-a125-490f-b76a-e2e525e2f6d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:15.856227 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9750e34f-a125-490f-b76a-e2e525e2f6d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:15.869308 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9750e34f-a125-490f-b76a-e2e525e2f6d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:15.870961 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9750e34f-a125-490f-b76a-e2e525e2f6d8 service cinder] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:15.883068 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1235/2493] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:36:15 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:36:15.971763 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c0d978-ee4a-4853-83d7-df0dad9e61d3 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:15.981945 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c0d978-ee4a-4853-83d7-df0dad9e61d3 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:15.985755 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d354ff-f18c-47e4-8441-9ecfe610dfa4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e79503178ac54e62ba385467d5617ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:15.986381 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d354ff-f18c-47e4-8441-9ecfe610dfa4 service cinder] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:15.986659 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d354ff-f18c-47e4-8441-9ecfe610dfa4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:15.986984 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d354ff-f18c-47e4-8441-9ecfe610dfa4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:16.059515 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d354ff-f18c-47e4-8441-9ecfe610dfa4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:16.061364 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d354ff-f18c-47e4-8441-9ecfe610dfa4 service cinder] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:16.074529 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1259/2494] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:36:15 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:36:25.490929 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9750e34f-a125-490f-b76a-e2e525e2f6d8 service cinder] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:25.552848 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9750e34f-a125-490f-b76a-e2e525e2f6d8 service cinder] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:25.558061 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd8a2dd-9206-41dd-9d0a-cbf866c78fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:25.558684 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8a2dd-9206-41dd-9d0a-cbf866c78fea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:25.558988 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8a2dd-9206-41dd-9d0a-cbf866c78fea admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:25.559259 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8a2dd-9206-41dd-9d0a-cbf866c78fea admin admin] PATH_INFO: `/v3/users/4a9f651a1de145438adc46afbdcd0817` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:25.560376 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd8a2dd-9206-41dd-9d0a-cbf866c78fea admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a9f651a1de145438adc46afbdcd0817)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:25.562284 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd8a2dd-9206-41dd-9d0a-cbf866c78fea admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:25.608091 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-abd8a2dd-9206-41dd-9d0a-cbf866c78fea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a9f651a1de145438adc46afbdcd0817'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:25.620680 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-abd8a2dd-9206-41dd-9d0a-cbf866c78fea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a9f651a1de145438adc46afbdcd0817'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:25.621356 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-abd8a2dd-9206-41dd-9d0a-cbf866c78fea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a9f651a1de145438adc46afbdcd0817'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:25.628097 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-abd8a2dd-9206-41dd-9d0a-cbf866c78fea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a9f651a1de145438adc46afbdcd0817'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:25.628719 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-abd8a2dd-9206-41dd-9d0a-cbf866c78fea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a9f651a1de145438adc46afbdcd0817'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:25.641289 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1236/2495] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:36:25 2022] DELETE /identity/v3/users/4a9f651a1de145438adc46afbdcd0817 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:36:25.645905 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf224da-15a4-4754-9a84-67f51062fc39 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:25.646456 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf224da-15a4-4754-9a84-67f51062fc39 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:25.646456 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf224da-15a4-4754-9a84-67f51062fc39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:25.666751 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-4cf224da-15a4-4754-9a84-67f51062fc39 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:36:25.668024 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-4cf224da-15a4-4754-9a84-67f51062fc39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:36:25.733325 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1260/2496] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:36:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:36:25.743452 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd8a2dd-9206-41dd-9d0a-cbf866c78fea admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:25.744971 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-abd8a2dd-9206-41dd-9d0a-cbf866c78fea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:36:25.782821 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:36:25.808695 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd8a2dd-9206-41dd-9d0a-cbf866c78fea admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:25.812613 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f131ff7-7354-4f4d-ba73-352824568142 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:25.813225 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f131ff7-7354-4f4d-ba73-352824568142 service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:25.813503 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f131ff7-7354-4f4d-ba73-352824568142 service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:25.813772 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f131ff7-7354-4f4d-ba73-352824568142 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:25.824192 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f131ff7-7354-4f4d-ba73-352824568142 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:25.825636 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f131ff7-7354-4f4d-ba73-352824568142 service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:25.837021 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1237/2497] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:36:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:36:26.109907 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf224da-15a4-4754-9a84-67f51062fc39 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:26.111508 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-4cf224da-15a4-4754-9a84-67f51062fc39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:36:26.125570 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf224da-15a4-4754-9a84-67f51062fc39 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:26.130256 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9afe78-c219-4e9a-9d21-690b901be61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:26.130930 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9afe78-c219-4e9a-9d21-690b901be61d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:26.131214 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9afe78-c219-4e9a-9d21-690b901be61d admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:26.131495 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9afe78-c219-4e9a-9d21-690b901be61d admin admin] PATH_INFO: `/v3/projects/1c0b95e37c3a4005bbc21d9f256a3431` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:26.132626 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9afe78-c219-4e9a-9d21-690b901be61d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c0b95e37c3a4005bbc21d9f256a3431)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:26.135668 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9afe78-c219-4e9a-9d21-690b901be61d admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:26.139264 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:36:26.192562 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-6a9afe78-c219-4e9a-9d21-690b901be61d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c0b95e37c3a4005bbc21d9f256a3431', 'request_id': 'req-6a9afe78-c219-4e9a-9d21-690b901be61d'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:26.201121 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-6a9afe78-c219-4e9a-9d21-690b901be61d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c0b95e37c3a4005bbc21d9f256a3431', 'request_id': 'req-6a9afe78-c219-4e9a-9d21-690b901be61d'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:26.207745 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-6a9afe78-c219-4e9a-9d21-690b901be61d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c0b95e37c3a4005bbc21d9f256a3431', 'request_id': 'req-6a9afe78-c219-4e9a-9d21-690b901be61d'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:26.220077 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-6a9afe78-c219-4e9a-9d21-690b901be61d admin admin] The token cache is being invalidate because project 1c0b95e37c3a4005bbc21d9f256a3431 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:36:26.220371 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-6a9afe78-c219-4e9a-9d21-690b901be61d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:26.221044 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-6a9afe78-c219-4e9a-9d21-690b901be61d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:26.222951 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1261/2498] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:36:26 2022] DELETE /identity/v3/projects/1c0b95e37c3a4005bbc21d9f256a3431 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:36:26.227846 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f131ff7-7354-4f4d-ba73-352824568142 service neutron] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:26.237460 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f131ff7-7354-4f4d-ba73-352824568142 service neutron] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:26.301366 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd1d0ca-2d57-42c2-9ee4-706c1c43a42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:26.302002 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd1d0ca-2d57-42c2-9ee4-706c1c43a42f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:26.302281 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd1d0ca-2d57-42c2-9ee4-706c1c43a42f admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:26.302552 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd1d0ca-2d57-42c2-9ee4-706c1c43a42f admin admin] PATH_INFO: `/v3/users/58cf387d006f4647bc2d9388f6f9400f` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:26.303921 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd1d0ca-2d57-42c2-9ee4-706c1c43a42f admin admin] RBAC: Authorizing `identity:delete_user(user_id=58cf387d006f4647bc2d9388f6f9400f)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:26.305866 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd1d0ca-2d57-42c2-9ee4-706c1c43a42f admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:26.353152 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-4dd1d0ca-2d57-42c2-9ee4-706c1c43a42f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58cf387d006f4647bc2d9388f6f9400f'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:26.365576 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-4dd1d0ca-2d57-42c2-9ee4-706c1c43a42f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58cf387d006f4647bc2d9388f6f9400f'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:26.366277 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-4dd1d0ca-2d57-42c2-9ee4-706c1c43a42f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58cf387d006f4647bc2d9388f6f9400f'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:26.373587 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-4dd1d0ca-2d57-42c2-9ee4-706c1c43a42f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58cf387d006f4647bc2d9388f6f9400f'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:26.374253 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-4dd1d0ca-2d57-42c2-9ee4-706c1c43a42f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58cf387d006f4647bc2d9388f6f9400f'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:26.389857 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1238/2499] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:36:26 2022] DELETE /identity/v3/users/58cf387d006f4647bc2d9388f6f9400f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:36:26.768283 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9afe78-c219-4e9a-9d21-690b901be61d admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:26.769798 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-6a9afe78-c219-4e9a-9d21-690b901be61d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:36:26.784113 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9afe78-c219-4e9a-9d21-690b901be61d admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:26.842392 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2950c00-be4b-4ea1-9fe1-0a3722d86b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:26.843056 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2950c00-be4b-4ea1-9fe1-0a3722d86b4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:26.843373 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2950c00-be4b-4ea1-9fe1-0a3722d86b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:26.843679 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2950c00-be4b-4ea1-9fe1-0a3722d86b4f admin admin] PATH_INFO: `/v3/projects/616161119f54421d933be6cd4922d887` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:26.844850 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2950c00-be4b-4ea1-9fe1-0a3722d86b4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=616161119f54421d933be6cd4922d887)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:26.846793 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2950c00-be4b-4ea1-9fe1-0a3722d86b4f admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:26.892937 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-b2950c00-be4b-4ea1-9fe1-0a3722d86b4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '616161119f54421d933be6cd4922d887', 'request_id': 'req-b2950c00-be4b-4ea1-9fe1-0a3722d86b4f'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:26.900903 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-b2950c00-be4b-4ea1-9fe1-0a3722d86b4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '616161119f54421d933be6cd4922d887', 'request_id': 'req-b2950c00-be4b-4ea1-9fe1-0a3722d86b4f'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:26.907578 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-b2950c00-be4b-4ea1-9fe1-0a3722d86b4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '616161119f54421d933be6cd4922d887', 'request_id': 'req-b2950c00-be4b-4ea1-9fe1-0a3722d86b4f'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:26.919418 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-b2950c00-be4b-4ea1-9fe1-0a3722d86b4f admin admin] The token cache is being invalidate because project 616161119f54421d933be6cd4922d887 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:36:26.919700 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-b2950c00-be4b-4ea1-9fe1-0a3722d86b4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:26.920345 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-b2950c00-be4b-4ea1-9fe1-0a3722d86b4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:26.921843 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1262/2500] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:36:26 2022] DELETE /identity/v3/projects/616161119f54421d933be6cd4922d887 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:36:26.926714 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3118572b-e89e-44af-b240-7a6d24cfebb9 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:26.927248 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3118572b-e89e-44af-b240-7a6d24cfebb9 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:26.927408 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3118572b-e89e-44af-b240-7a6d24cfebb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:26.947650 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-3118572b-e89e-44af-b240-7a6d24cfebb9 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:36:26.948878 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-3118572b-e89e-44af-b240-7a6d24cfebb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:36:26.997715 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:36:27.010575 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1239/2501] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:36:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:36:27.018350 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2265dd-9933-4afa-856c-6affcb6773c4 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:27.018664 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2265dd-9933-4afa-856c-6affcb6773c4 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:27.018970 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2265dd-9933-4afa-856c-6affcb6773c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:27.039918 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-4d2265dd-9933-4afa-856c-6affcb6773c4 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:36:27.041178 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-4d2265dd-9933-4afa-856c-6affcb6773c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:36:27.049259 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1263/2502] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:36:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:36:27.053571 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3118572b-e89e-44af-b240-7a6d24cfebb9 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:27.064008 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3118572b-e89e-44af-b240-7a6d24cfebb9 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:27.068590 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adb5e3d-8ef4-48c7-883d-3b993d5dfdd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:27.069207 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb5e3d-8ef4-48c7-883d-3b993d5dfdd9 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:27.069486 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb5e3d-8ef4-48c7-883d-3b993d5dfdd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:27.069760 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb5e3d-8ef4-48c7-883d-3b993d5dfdd9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:27.071456 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adb5e3d-8ef4-48c7-883d-3b993d5dfdd9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:36:27.071759 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adb5e3d-8ef4-48c7-883d-3b993d5dfdd9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:27.073356 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adb5e3d-8ef4-48c7-883d-3b993d5dfdd9 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:27.087883 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1240/2503] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 12:36:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:36:27.093530 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2265dd-9933-4afa-856c-6affcb6773c4 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:27.105258 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2265dd-9933-4afa-856c-6affcb6773c4 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:27.110214 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5485b0b2-67b1-4b52-936c-11c0d8f3b1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:27.110961 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5485b0b2-67b1-4b52-936c-11c0d8f3b1ca admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:27.111246 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5485b0b2-67b1-4b52-936c-11c0d8f3b1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:27.111519 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5485b0b2-67b1-4b52-936c-11c0d8f3b1ca admin admin] PATH_INFO: `/v3/projects` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:27.112163 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5485b0b2-67b1-4b52-936c-11c0d8f3b1ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:27.114357 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5485b0b2-67b1-4b52-936c-11c0d8f3b1ca admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:27.131320 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:36:27.146527 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1264/2504] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:36:27 2022] POST /identity/v3/projects => generated 365 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:36:27.151607 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adb5e3d-8ef4-48c7-883d-3b993d5dfdd9 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:27.162166 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adb5e3d-8ef4-48c7-883d-3b993d5dfdd9 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:27.220101 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4659463a-99bf-45e0-8915-aba0e15881ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:27.220963 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4659463a-99bf-45e0-8915-aba0e15881ec admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:27.220963 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4659463a-99bf-45e0-8915-aba0e15881ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:27.221236 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4659463a-99bf-45e0-8915-aba0e15881ec admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:27.221871 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4659463a-99bf-45e0-8915-aba0e15881ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:27.223841 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4659463a-99bf-45e0-8915-aba0e15881ec admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:27.246479 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1241/2505] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:36:27 2022] POST /identity/v3/users => generated 283 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:36:27.250651 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5485b0b2-67b1-4b52-936c-11c0d8f3b1ca admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:27.261876 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5485b0b2-67b1-4b52-936c-11c0d8f3b1ca admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:27.266634 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9760dbe1-ed87-4add-aa89-84351602d6d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:27.267280 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9760dbe1-ed87-4add-aa89-84351602d6d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:27.267575 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9760dbe1-ed87-4add-aa89-84351602d6d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:27.267828 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9760dbe1-ed87-4add-aa89-84351602d6d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:27.268464 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9760dbe1-ed87-4add-aa89-84351602d6d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:27.270060 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9760dbe1-ed87-4add-aa89-84351602d6d6 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:27.281113 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1265/2506] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:36:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:36:27.285667 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4659463a-99bf-45e0-8915-aba0e15881ec admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:27.296682 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4659463a-99bf-45e0-8915-aba0e15881ec admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:27.301584 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e24f56d-b1bd-4660-90b8-c7362a8a74f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:27.302192 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e24f56d-b1bd-4660-90b8-c7362a8a74f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:27.302467 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e24f56d-b1bd-4660-90b8-c7362a8a74f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:27.302734 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e24f56d-b1bd-4660-90b8-c7362a8a74f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:27.303411 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e24f56d-b1bd-4660-90b8-c7362a8a74f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:27.305524 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e24f56d-b1bd-4660-90b8-c7362a8a74f6 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:27.316655 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1242/2507] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:36:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:36:27.321849 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9760dbe1-ed87-4add-aa89-84351602d6d6 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:27.331884 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9760dbe1-ed87-4add-aa89-84351602d6d6 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:27.336793 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b177f22-b89d-4781-b646-a2b24174d1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:27.337453 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b177f22-b89d-4781-b646-a2b24174d1bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:27.337734 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b177f22-b89d-4781-b646-a2b24174d1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:27.338007 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b177f22-b89d-4781-b646-a2b24174d1bf admin admin] PATH_INFO: `/v3/projects/d453694dd9d04375bb7edcb9466fe7eb/users/ae2ab2b3bcb44f1890d188c94fb00e17/roles/b5cfd7a855a448359e9017f51d32b6fc` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:27.355387 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b177f22-b89d-4781-b646-a2b24174d1bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=d453694dd9d04375bb7edcb9466fe7eb, user_id=ae2ab2b3bcb44f1890d188c94fb00e17, role_id=b5cfd7a855a448359e9017f51d32b6fc)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:27.358085 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b177f22-b89d-4781-b646-a2b24174d1bf admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:27.372767 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1266/2508] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:36:27 2022] PUT /identity/v3/projects/d453694dd9d04375bb7edcb9466fe7eb/users/ae2ab2b3bcb44f1890d188c94fb00e17/roles/b5cfd7a855a448359e9017f51d32b6fc => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:36:27.384915 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe8f5e-8964-4276-adaf-9eccb8dc2dff None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:27.385194 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe8f5e-8964-4276-adaf-9eccb8dc2dff None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:27.385465 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe8f5e-8964-4276-adaf-9eccb8dc2dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:27.417015 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-fefe8f5e-8964-4276-adaf-9eccb8dc2dff None None] MFA Rules not processed for user `ae2ab2b3bcb44f1890d188c94fb00e17`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:36:27.418400 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-fefe8f5e-8964-4276-adaf-9eccb8dc2dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:36:27.499152 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1243/2509] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:36:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:36:27.503996 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b177f22-b89d-4781-b646-a2b24174d1bf admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:27.579536 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b177f22-b89d-4781-b646-a2b24174d1bf admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:27.585652 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635de864-ed7b-442b-8c37-7c4eddcd8c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:27.587573 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635de864-ed7b-442b-8c37-7c4eddcd8c75 admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:27.588036 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635de864-ed7b-442b-8c37-7c4eddcd8c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:27.588473 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635de864-ed7b-442b-8c37-7c4eddcd8c75 admin admin] PATH_INFO: `/v3/projects` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:27.589561 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635de864-ed7b-442b-8c37-7c4eddcd8c75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:27.593034 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635de864-ed7b-442b-8c37-7c4eddcd8c75 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:27.634828 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1267/2510] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:36:27 2022] POST /identity/v3/projects => generated 365 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:36:27.639066 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefe8f5e-8964-4276-adaf-9eccb8dc2dff None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:27.653237 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefe8f5e-8964-4276-adaf-9eccb8dc2dff None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:27.736571 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:36:27.755247 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab93206-d9e9-45bf-816c-cf841ea57d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:27.756469 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab93206-d9e9-45bf-816c-cf841ea57d8d admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:27.756469 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab93206-d9e9-45bf-816c-cf841ea57d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:27.756725 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab93206-d9e9-45bf-816c-cf841ea57d8d admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:27.757426 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab93206-d9e9-45bf-816c-cf841ea57d8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:27.760088 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab93206-d9e9-45bf-816c-cf841ea57d8d admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:27.803555 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1244/2511] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:36:27 2022] POST /identity/v3/users => generated 289 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:36:27.805254 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635de864-ed7b-442b-8c37-7c4eddcd8c75 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:27.819474 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635de864-ed7b-442b-8c37-7c4eddcd8c75 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:27.825724 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84df30f1-829d-4b34-9ac3-c99b4103b180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:27.826497 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84df30f1-829d-4b34-9ac3-c99b4103b180 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:27.826824 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84df30f1-829d-4b34-9ac3-c99b4103b180 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:27.827193 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84df30f1-829d-4b34-9ac3-c99b4103b180 admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:27.827840 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84df30f1-829d-4b34-9ac3-c99b4103b180 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:27.829588 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84df30f1-829d-4b34-9ac3-c99b4103b180 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:27.846927 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1268/2512] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:36:27 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:36:27.848240 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab93206-d9e9-45bf-816c-cf841ea57d8d admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:27.859540 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab93206-d9e9-45bf-816c-cf841ea57d8d admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:27.864742 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c894a14-4e27-4fb7-a1d5-e9d992be50a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:27.865731 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c894a14-4e27-4fb7-a1d5-e9d992be50a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:27.866012 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c894a14-4e27-4fb7-a1d5-e9d992be50a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:27.866284 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c894a14-4e27-4fb7-a1d5-e9d992be50a9 admin admin] PATH_INFO: `/v3/projects/03302fe8a2f84f2ebeb4c2e6b56a3908/users/b44b402531d44b2e897c1079a7d4ac83/roles/a332ef951db949b0bad7019fbd28a1b9` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:27.891463 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c894a14-4e27-4fb7-a1d5-e9d992be50a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03302fe8a2f84f2ebeb4c2e6b56a3908, user_id=b44b402531d44b2e897c1079a7d4ac83, role_id=a332ef951db949b0bad7019fbd28a1b9)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:27.894287 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c894a14-4e27-4fb7-a1d5-e9d992be50a9 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:27.911698 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1245/2513] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:36:27 2022] PUT /identity/v3/projects/03302fe8a2f84f2ebeb4c2e6b56a3908/users/b44b402531d44b2e897c1079a7d4ac83/roles/a332ef951db949b0bad7019fbd28a1b9 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:36:27.917342 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84df30f1-829d-4b34-9ac3-c99b4103b180 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:27.933416 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84df30f1-829d-4b34-9ac3-c99b4103b180 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:28.009355 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9869b986-6830-4b1d-9853-b33df519c844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:28.010067 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9869b986-6830-4b1d-9853-b33df519c844 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:28.010401 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9869b986-6830-4b1d-9853-b33df519c844 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:28.010687 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9869b986-6830-4b1d-9853-b33df519c844 admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:28.011461 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9869b986-6830-4b1d-9853-b33df519c844 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:28.013488 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9869b986-6830-4b1d-9853-b33df519c844 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:28.025048 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1269/2514] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:36:27 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:36:28.029521 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c894a14-4e27-4fb7-a1d5-e9d992be50a9 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:28.040107 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c894a14-4e27-4fb7-a1d5-e9d992be50a9 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:28.044915 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711b052-d125-49b0-bb70-be5c508f2bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:28.045592 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711b052-d125-49b0-bb70-be5c508f2bea admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:28.045874 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711b052-d125-49b0-bb70-be5c508f2bea admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:28.046203 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711b052-d125-49b0-bb70-be5c508f2bea admin admin] PATH_INFO: `/v3/projects/03302fe8a2f84f2ebeb4c2e6b56a3908/users/b44b402531d44b2e897c1079a7d4ac83/roles/a332ef951db949b0bad7019fbd28a1b9` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:28.048169 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e711b052-d125-49b0-bb70-be5c508f2bea admin admin] RBAC: Authorizing `identity:create_grant(project_id=03302fe8a2f84f2ebeb4c2e6b56a3908, user_id=b44b402531d44b2e897c1079a7d4ac83, role_id=a332ef951db949b0bad7019fbd28a1b9)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:28.050831 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e711b052-d125-49b0-bb70-be5c508f2bea admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:28.067118 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1246/2515] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:36:28 2022] PUT /identity/v3/projects/03302fe8a2f84f2ebeb4c2e6b56a3908/users/b44b402531d44b2e897c1079a7d4ac83/roles/a332ef951db949b0bad7019fbd28a1b9 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:36:28.078813 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f7807-8533-4c00-8834-4720d7e7353a None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:28.079142 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f7807-8533-4c00-8834-4720d7e7353a None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:28.079423 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f7807-8533-4c00-8834-4720d7e7353a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:28.111060 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-0f5f7807-8533-4c00-8834-4720d7e7353a None None] MFA Rules not processed for user `b44b402531d44b2e897c1079a7d4ac83`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:36:28.112372 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-0f5f7807-8533-4c00-8834-4720d7e7353a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:36:28.135065 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:36:28.193862 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1270/2516] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:36:28 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:36:28.206450 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711b052-d125-49b0-bb70-be5c508f2bea admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:28.208188 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-e711b052-d125-49b0-bb70-be5c508f2bea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:36:28.273621 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711b052-d125-49b0-bb70-be5c508f2bea admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:28.277270 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b01aea-4cdf-42ad-bea5-cd73b78855d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e79503178ac54e62ba385467d5617ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:28.277884 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b01aea-4cdf-42ad-bea5-cd73b78855d3 service cinder] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:28.278160 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b01aea-4cdf-42ad-bea5-cd73b78855d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:28.278432 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b01aea-4cdf-42ad-bea5-cd73b78855d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:28.287684 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b01aea-4cdf-42ad-bea5-cd73b78855d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:28.289154 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b01aea-4cdf-42ad-bea5-cd73b78855d3 service cinder] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:28.298687 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1247/2517] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:36:28 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:36:28.377200 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5f7807-8533-4c00-8834-4720d7e7353a None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:28.387499 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5f7807-8533-4c00-8834-4720d7e7353a None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:28.391028 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e8b1f2-e3d5-4496-81f2-5dddcb1e9a6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e79503178ac54e62ba385467d5617ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:28.391633 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e8b1f2-e3d5-4496-81f2-5dddcb1e9a6b service cinder] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:28.391908 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e8b1f2-e3d5-4496-81f2-5dddcb1e9a6b service cinder] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:28.392175 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e8b1f2-e3d5-4496-81f2-5dddcb1e9a6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:28.455396 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e8b1f2-e3d5-4496-81f2-5dddcb1e9a6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:28.456843 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e8b1f2-e3d5-4496-81f2-5dddcb1e9a6b service cinder] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:28.466481 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1271/2518] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:36:28 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:36:31.220456 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b01aea-4cdf-42ad-bea5-cd73b78855d3 service cinder] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:31.244517 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e8b1f2-e3d5-4496-81f2-5dddcb1e9a6b service cinder] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:31.246563 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-b0e8b1f2-e3d5-4496-81f2-5dddcb1e9a6b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:36:31.300018 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b01aea-4cdf-42ad-bea5-cd73b78855d3 service cinder] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:31.306168 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752f9e52-7a32-48e3-81dc-437f176e6564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:31.307537 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f9e52-7a32-48e3-81dc-437f176e6564 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:31.307804 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f9e52-7a32-48e3-81dc-437f176e6564 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:31.308085 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f9e52-7a32-48e3-81dc-437f176e6564 admin admin] PATH_INFO: `/v3/users/ae2ab2b3bcb44f1890d188c94fb00e17` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:31.309693 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752f9e52-7a32-48e3-81dc-437f176e6564 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae2ab2b3bcb44f1890d188c94fb00e17)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:31.311678 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752f9e52-7a32-48e3-81dc-437f176e6564 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:31.341465 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e8b1f2-e3d5-4496-81f2-5dddcb1e9a6b service cinder] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:31.347946 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa44411-66e8-4e15-b1a7-a4892bff896b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62401c8e1457450590f4147e0665265a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:31.348592 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa44411-66e8-4e15-b1a7-a4892bff896b service nova] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:31.349011 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa44411-66e8-4e15-b1a7-a4892bff896b service nova] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:31.349186 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa44411-66e8-4e15-b1a7-a4892bff896b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:31.352119 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-4aa44411-66e8-4e15-b1a7-a4892bff896b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:36:31.368703 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa44411-66e8-4e15-b1a7-a4892bff896b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:31.371318 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa44411-66e8-4e15-b1a7-a4892bff896b service nova] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:31.374915 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-752f9e52-7a32-48e3-81dc-437f176e6564 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae2ab2b3bcb44f1890d188c94fb00e17'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:31.376137 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:36:31.385504 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1272/2519] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:36:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:36:31.394971 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-752f9e52-7a32-48e3-81dc-437f176e6564 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae2ab2b3bcb44f1890d188c94fb00e17'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:31.396773 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-752f9e52-7a32-48e3-81dc-437f176e6564 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae2ab2b3bcb44f1890d188c94fb00e17'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:31.407836 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-752f9e52-7a32-48e3-81dc-437f176e6564 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae2ab2b3bcb44f1890d188c94fb00e17'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:31.409552 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-752f9e52-7a32-48e3-81dc-437f176e6564 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae2ab2b3bcb44f1890d188c94fb00e17'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:31.427146 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1248/2520] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:36:31 2022] DELETE /identity/v3/users/ae2ab2b3bcb44f1890d188c94fb00e17 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:36:31.432618 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455957b2-8174-4c3a-b487-e6093dd90776 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:31.432618 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455957b2-8174-4c3a-b487-e6093dd90776 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:31.432964 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455957b2-8174-4c3a-b487-e6093dd90776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:31.457787 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-455957b2-8174-4c3a-b487-e6093dd90776 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:36:31.459185 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-455957b2-8174-4c3a-b487-e6093dd90776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:36:31.497074 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:36:31.528191 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1273/2521] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:36:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:36:31.537559 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752f9e52-7a32-48e3-81dc-437f176e6564 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:31.539707 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-752f9e52-7a32-48e3-81dc-437f176e6564 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:36:31.614777 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752f9e52-7a32-48e3-81dc-437f176e6564 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:31.621451 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156cfb9c-5a41-4cbc-b890-b0afe9b4215c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:31.622258 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156cfb9c-5a41-4cbc-b890-b0afe9b4215c service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:31.622601 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156cfb9c-5a41-4cbc-b890-b0afe9b4215c service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:31.622966 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156cfb9c-5a41-4cbc-b890-b0afe9b4215c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:31.633834 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156cfb9c-5a41-4cbc-b890-b0afe9b4215c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:31.635476 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156cfb9c-5a41-4cbc-b890-b0afe9b4215c service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:31.647324 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1249/2522] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:36:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:36:32.135938 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455957b2-8174-4c3a-b487-e6093dd90776 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:32.137758 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-455957b2-8174-4c3a-b487-e6093dd90776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:36:32.161812 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455957b2-8174-4c3a-b487-e6093dd90776 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:32.169202 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bc2216-f34b-4d1a-ae5f-083bb557221e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:32.169858 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc2216-f34b-4d1a-ae5f-083bb557221e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:32.170136 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc2216-f34b-4d1a-ae5f-083bb557221e admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:32.170394 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc2216-f34b-4d1a-ae5f-083bb557221e admin admin] PATH_INFO: `/v3/projects/d453694dd9d04375bb7edcb9466fe7eb` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:32.171810 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bc2216-f34b-4d1a-ae5f-083bb557221e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d453694dd9d04375bb7edcb9466fe7eb)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:32.173741 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bc2216-f34b-4d1a-ae5f-083bb557221e admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:32.234985 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-45bc2216-f34b-4d1a-ae5f-083bb557221e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd453694dd9d04375bb7edcb9466fe7eb', 'request_id': 'req-45bc2216-f34b-4d1a-ae5f-083bb557221e'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:32.245735 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-45bc2216-f34b-4d1a-ae5f-083bb557221e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd453694dd9d04375bb7edcb9466fe7eb', 'request_id': 'req-45bc2216-f34b-4d1a-ae5f-083bb557221e'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:32.254153 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-45bc2216-f34b-4d1a-ae5f-083bb557221e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd453694dd9d04375bb7edcb9466fe7eb', 'request_id': 'req-45bc2216-f34b-4d1a-ae5f-083bb557221e'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:32.268263 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-45bc2216-f34b-4d1a-ae5f-083bb557221e admin admin] The token cache is being invalidate because project d453694dd9d04375bb7edcb9466fe7eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:36:32.268557 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-45bc2216-f34b-4d1a-ae5f-083bb557221e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:32.269207 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-45bc2216-f34b-4d1a-ae5f-083bb557221e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:32.270700 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1274/2523] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:36:32 2022] DELETE /identity/v3/projects/d453694dd9d04375bb7edcb9466fe7eb => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:36:32.276511 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156cfb9c-5a41-4cbc-b890-b0afe9b4215c service neutron] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:32.287051 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156cfb9c-5a41-4cbc-b890-b0afe9b4215c service neutron] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:32.364325 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a6f419-40cd-496f-9314-cafef13a792c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:32.364982 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a6f419-40cd-496f-9314-cafef13a792c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:32.365261 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a6f419-40cd-496f-9314-cafef13a792c admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:32.365535 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a6f419-40cd-496f-9314-cafef13a792c admin admin] PATH_INFO: `/v3/users/b44b402531d44b2e897c1079a7d4ac83` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:32.366749 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a6f419-40cd-496f-9314-cafef13a792c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b44b402531d44b2e897c1079a7d4ac83)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:32.368950 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a6f419-40cd-496f-9314-cafef13a792c admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:32.425200 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-48a6f419-40cd-496f-9314-cafef13a792c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b44b402531d44b2e897c1079a7d4ac83'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:32.449500 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-48a6f419-40cd-496f-9314-cafef13a792c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b44b402531d44b2e897c1079a7d4ac83'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:32.450378 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-48a6f419-40cd-496f-9314-cafef13a792c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b44b402531d44b2e897c1079a7d4ac83'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:32.456204 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:36:32.460417 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-48a6f419-40cd-496f-9314-cafef13a792c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b44b402531d44b2e897c1079a7d4ac83'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:32.462309 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-48a6f419-40cd-496f-9314-cafef13a792c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b44b402531d44b2e897c1079a7d4ac83'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:32.479712 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1250/2524] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:36:32 2022] DELETE /identity/v3/users/b44b402531d44b2e897c1079a7d4ac83 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:36:33.032297 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bc2216-f34b-4d1a-ae5f-083bb557221e admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:33.033811 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-45bc2216-f34b-4d1a-ae5f-083bb557221e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:36:33.047890 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bc2216-f34b-4d1a-ae5f-083bb557221e admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:33.107757 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c76767-2fb4-4ca7-a99f-eb9b74377a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:33.108394 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c76767-2fb4-4ca7-a99f-eb9b74377a0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:33.108668 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c76767-2fb4-4ca7-a99f-eb9b74377a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:33.108938 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c76767-2fb4-4ca7-a99f-eb9b74377a0f admin admin] PATH_INFO: `/v3/projects/03302fe8a2f84f2ebeb4c2e6b56a3908` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:33.110051 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c76767-2fb4-4ca7-a99f-eb9b74377a0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=03302fe8a2f84f2ebeb4c2e6b56a3908)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:33.112009 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c76767-2fb4-4ca7-a99f-eb9b74377a0f admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:33.163026 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-51c76767-2fb4-4ca7-a99f-eb9b74377a0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03302fe8a2f84f2ebeb4c2e6b56a3908', 'request_id': 'req-51c76767-2fb4-4ca7-a99f-eb9b74377a0f'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:33.171251 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-51c76767-2fb4-4ca7-a99f-eb9b74377a0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03302fe8a2f84f2ebeb4c2e6b56a3908', 'request_id': 'req-51c76767-2fb4-4ca7-a99f-eb9b74377a0f'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:33.177859 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-51c76767-2fb4-4ca7-a99f-eb9b74377a0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03302fe8a2f84f2ebeb4c2e6b56a3908', 'request_id': 'req-51c76767-2fb4-4ca7-a99f-eb9b74377a0f'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:33.180015 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:36:33.191050 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-51c76767-2fb4-4ca7-a99f-eb9b74377a0f admin admin] The token cache is being invalidate because project 03302fe8a2f84f2ebeb4c2e6b56a3908 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:36:33.191342 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-51c76767-2fb4-4ca7-a99f-eb9b74377a0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:33.192001 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-51c76767-2fb4-4ca7-a99f-eb9b74377a0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:33.193518 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1275/2525] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:36:33 2022] DELETE /identity/v3/projects/03302fe8a2f84f2ebeb4c2e6b56a3908 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:36:33.199209 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b68d6-bc30-4cbe-88a8-2ee63d8414e1 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:33.199492 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b68d6-bc30-4cbe-88a8-2ee63d8414e1 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:33.199768 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b68d6-bc30-4cbe-88a8-2ee63d8414e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:33.220553 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-943b68d6-bc30-4cbe-88a8-2ee63d8414e1 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:36:33.221756 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-943b68d6-bc30-4cbe-88a8-2ee63d8414e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:36:33.282032 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1251/2526] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:36:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:36:33.289778 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3cdbd-6dd8-47d9-91e8-711c35e00699 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:33.290237 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3cdbd-6dd8-47d9-91e8-711c35e00699 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:33.290335 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3cdbd-6dd8-47d9-91e8-711c35e00699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:33.311012 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-bba3cdbd-6dd8-47d9-91e8-711c35e00699 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:36:33.312220 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-bba3cdbd-6dd8-47d9-91e8-711c35e00699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:36:33.320206 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1276/2527] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:36:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:36:33.325331 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943b68d6-bc30-4cbe-88a8-2ee63d8414e1 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:33.335271 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943b68d6-bc30-4cbe-88a8-2ee63d8414e1 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:33.340262 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc2f325-60d7-422f-bf37-adf8dbde2820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:33.340875 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc2f325-60d7-422f-bf37-adf8dbde2820 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:33.341157 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc2f325-60d7-422f-bf37-adf8dbde2820 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:33.341432 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc2f325-60d7-422f-bf37-adf8dbde2820 admin admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:33.342079 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc2f325-60d7-422f-bf37-adf8dbde2820 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:36:33.342384 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc2f325-60d7-422f-bf37-adf8dbde2820 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:33.344048 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc2f325-60d7-422f-bf37-adf8dbde2820 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:33.358757 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1252/2528] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 12:36:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:36:33.360282 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba3cdbd-6dd8-47d9-91e8-711c35e00699 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:33.370419 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba3cdbd-6dd8-47d9-91e8-711c35e00699 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:33.375161 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0296f5fb-ac0d-4689-a40b-aa2074a584e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:33.375755 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296f5fb-ac0d-4689-a40b-aa2074a584e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:33.376030 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296f5fb-ac0d-4689-a40b-aa2074a584e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:33.376295 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296f5fb-ac0d-4689-a40b-aa2074a584e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:33.376926 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0296f5fb-ac0d-4689-a40b-aa2074a584e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:33.378797 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0296f5fb-ac0d-4689-a40b-aa2074a584e2 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:33.405825 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1277/2529] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:36:33 2022] POST /identity/v3/projects => generated 387 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:36:33.410137 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc2f325-60d7-422f-bf37-adf8dbde2820 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:33.420920 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc2f325-60d7-422f-bf37-adf8dbde2820 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:33.480494 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e54973-1bc4-4b91-af27-ce5581850ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:33.481101 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e54973-1bc4-4b91-af27-ce5581850ecf admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:33.481375 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e54973-1bc4-4b91-af27-ce5581850ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:33.481644 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e54973-1bc4-4b91-af27-ce5581850ecf admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:33.482273 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e54973-1bc4-4b91-af27-ce5581850ecf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:33.484194 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e54973-1bc4-4b91-af27-ce5581850ecf admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:33.505920 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1253/2530] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:36:33 2022] POST /identity/v3/users => generated 294 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:36:33.510414 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0296f5fb-ac0d-4689-a40b-aa2074a584e2 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:33.520697 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0296f5fb-ac0d-4689-a40b-aa2074a584e2 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:33.525853 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1b5fdd-69a8-4522-98fe-1ed3badffc16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:33.526484 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b5fdd-69a8-4522-98fe-1ed3badffc16 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:33.526756 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b5fdd-69a8-4522-98fe-1ed3badffc16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:33.527512 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b5fdd-69a8-4522-98fe-1ed3badffc16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:33.528160 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1b5fdd-69a8-4522-98fe-1ed3badffc16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:33.529772 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1b5fdd-69a8-4522-98fe-1ed3badffc16 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:33.540674 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1278/2531] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:36:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:36:33.544664 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e54973-1bc4-4b91-af27-ce5581850ecf admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:33.554658 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e54973-1bc4-4b91-af27-ce5581850ecf admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:33.559523 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3f962d-3b42-441e-89f5-20b546ae8b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:33.560164 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f962d-3b42-441e-89f5-20b546ae8b25 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:33.560445 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f962d-3b42-441e-89f5-20b546ae8b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:33.560717 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f962d-3b42-441e-89f5-20b546ae8b25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:33.561364 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3f962d-3b42-441e-89f5-20b546ae8b25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:33.563009 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3f962d-3b42-441e-89f5-20b546ae8b25 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:33.575936 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1254/2532] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:36:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:36:33.580436 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1b5fdd-69a8-4522-98fe-1ed3badffc16 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:33.597547 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1b5fdd-69a8-4522-98fe-1ed3badffc16 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:33.604308 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa007a9-be77-48b0-a0f7-0afc791813cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:33.604989 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa007a9-be77-48b0-a0f7-0afc791813cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:33.605272 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa007a9-be77-48b0-a0f7-0afc791813cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:33.605546 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa007a9-be77-48b0-a0f7-0afc791813cb admin admin] PATH_INFO: `/v3/projects/4c04cd02fd59403e831830ed32de1677/users/4104ad931d9245c9b05c524ab627f997/roles/b5cfd7a855a448359e9017f51d32b6fc` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:33.622206 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa007a9-be77-48b0-a0f7-0afc791813cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c04cd02fd59403e831830ed32de1677, user_id=4104ad931d9245c9b05c524ab627f997, role_id=b5cfd7a855a448359e9017f51d32b6fc)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:33.624909 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa007a9-be77-48b0-a0f7-0afc791813cb admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:33.639728 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1279/2533] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:36:33 2022] PUT /identity/v3/projects/4c04cd02fd59403e831830ed32de1677/users/4104ad931d9245c9b05c524ab627f997/roles/b5cfd7a855a448359e9017f51d32b6fc => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:36:33.651973 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7519e21d-7d0c-4167-a0f0-bd13774600ad None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:33.652249 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7519e21d-7d0c-4167-a0f0-bd13774600ad None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:33.652519 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7519e21d-7d0c-4167-a0f0-bd13774600ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:33.682709 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-7519e21d-7d0c-4167-a0f0-bd13774600ad None None] MFA Rules not processed for user `4104ad931d9245c9b05c524ab627f997`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:36:33.684139 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-7519e21d-7d0c-4167-a0f0-bd13774600ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:36:33.731609 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:36:33.760865 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1255/2534] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:36:33 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:36:33.768222 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa007a9-be77-48b0-a0f7-0afc791813cb admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:33.830891 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa007a9-be77-48b0-a0f7-0afc791813cb admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:33.836801 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0abf02-ff4d-4f50-82a4-5e942c888a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:33.837441 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0abf02-ff4d-4f50-82a4-5e942c888a2a admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:33.837724 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0abf02-ff4d-4f50-82a4-5e942c888a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:33.838001 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0abf02-ff4d-4f50-82a4-5e942c888a2a admin admin] PATH_INFO: `/v3/projects` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:33.838770 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0abf02-ff4d-4f50-82a4-5e942c888a2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:33.840848 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0abf02-ff4d-4f50-82a4-5e942c888a2a admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:33.868661 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1280/2535] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:36:33 2022] POST /identity/v3/projects => generated 385 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:36:33.872944 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7519e21d-7d0c-4167-a0f0-bd13774600ad None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:33.884915 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7519e21d-7d0c-4167-a0f0-bd13774600ad None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:33.943427 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70d05ca-d8d2-4ac8-8f2e-fe2c041ee35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:33.944037 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70d05ca-d8d2-4ac8-8f2e-fe2c041ee35e admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:33.944313 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70d05ca-d8d2-4ac8-8f2e-fe2c041ee35e admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:33.944580 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70d05ca-d8d2-4ac8-8f2e-fe2c041ee35e admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:33.945750 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70d05ca-d8d2-4ac8-8f2e-fe2c041ee35e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:33.947730 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70d05ca-d8d2-4ac8-8f2e-fe2c041ee35e admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:33.970025 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1256/2536] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:36:33 2022] POST /identity/v3/users => generated 299 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:36:33.974028 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0abf02-ff4d-4f50-82a4-5e942c888a2a admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:33.984594 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0abf02-ff4d-4f50-82a4-5e942c888a2a admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:33.989493 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe89f4e-748c-4797-85ec-be7bb0f6c5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:33.990098 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe89f4e-748c-4797-85ec-be7bb0f6c5c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:33.990377 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe89f4e-748c-4797-85ec-be7bb0f6c5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:33.990644 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe89f4e-748c-4797-85ec-be7bb0f6c5c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:33.991313 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe89f4e-748c-4797-85ec-be7bb0f6c5c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:33.993101 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe89f4e-748c-4797-85ec-be7bb0f6c5c3 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:34.004281 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1281/2537] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:36:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:36:34.009369 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70d05ca-d8d2-4ac8-8f2e-fe2c041ee35e admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:34.019723 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70d05ca-d8d2-4ac8-8f2e-fe2c041ee35e admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:34.025639 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc9ae79-2be8-49c8-b555-0be53baf8f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:34.026311 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9ae79-2be8-49c8-b555-0be53baf8f86 admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:34.026595 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9ae79-2be8-49c8-b555-0be53baf8f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:34.026891 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9ae79-2be8-49c8-b555-0be53baf8f86 admin admin] PATH_INFO: `/v3/projects/200ba10e31d94e42958d53ba5544fbd5/users/3f80610ad54b4759a4d60d9bb3f7ad8d/roles/a332ef951db949b0bad7019fbd28a1b9` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:34.042845 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc9ae79-2be8-49c8-b555-0be53baf8f86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=200ba10e31d94e42958d53ba5544fbd5, user_id=3f80610ad54b4759a4d60d9bb3f7ad8d, role_id=a332ef951db949b0bad7019fbd28a1b9)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:34.045564 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc9ae79-2be8-49c8-b555-0be53baf8f86 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:34.060321 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1257/2538] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:36:34 2022] PUT /identity/v3/projects/200ba10e31d94e42958d53ba5544fbd5/users/3f80610ad54b4759a4d60d9bb3f7ad8d/roles/a332ef951db949b0bad7019fbd28a1b9 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:36:34.064506 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe89f4e-748c-4797-85ec-be7bb0f6c5c3 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:34.076299 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe89f4e-748c-4797-85ec-be7bb0f6c5c3 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:34.148347 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ffb7ca-2646-4c9c-89ca-c71efe0ffd15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:34.148907 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ffb7ca-2646-4c9c-89ca-c71efe0ffd15 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:34.149185 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ffb7ca-2646-4c9c-89ca-c71efe0ffd15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:34.149527 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ffb7ca-2646-4c9c-89ca-c71efe0ffd15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:34.150172 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ffb7ca-2646-4c9c-89ca-c71efe0ffd15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:34.151796 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ffb7ca-2646-4c9c-89ca-c71efe0ffd15 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:34.154058 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:36:34.164449 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1282/2539] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:36:34 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:36:34.168974 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc9ae79-2be8-49c8-b555-0be53baf8f86 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:34.179252 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc9ae79-2be8-49c8-b555-0be53baf8f86 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:34.184436 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee09513-5634-42ec-a53b-05f08ba6fb36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:34.185092 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee09513-5634-42ec-a53b-05f08ba6fb36 admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:34.185369 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee09513-5634-42ec-a53b-05f08ba6fb36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:34.185638 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee09513-5634-42ec-a53b-05f08ba6fb36 admin admin] PATH_INFO: `/v3/projects/200ba10e31d94e42958d53ba5544fbd5/users/3f80610ad54b4759a4d60d9bb3f7ad8d/roles/a332ef951db949b0bad7019fbd28a1b9` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:34.187543 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee09513-5634-42ec-a53b-05f08ba6fb36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=200ba10e31d94e42958d53ba5544fbd5, user_id=3f80610ad54b4759a4d60d9bb3f7ad8d, role_id=a332ef951db949b0bad7019fbd28a1b9)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:34.190146 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee09513-5634-42ec-a53b-05f08ba6fb36 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:34.202599 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1258/2540] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:36:34 2022] PUT /identity/v3/projects/200ba10e31d94e42958d53ba5544fbd5/users/3f80610ad54b4759a4d60d9bb3f7ad8d/roles/a332ef951db949b0bad7019fbd28a1b9 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:36:34.214425 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c4b250-87b7-4afd-a7a7-e59e1dfecad2 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:34.214712 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c4b250-87b7-4afd-a7a7-e59e1dfecad2 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:34.215043 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c4b250-87b7-4afd-a7a7-e59e1dfecad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:34.245177 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-48c4b250-87b7-4afd-a7a7-e59e1dfecad2 None None] MFA Rules not processed for user `3f80610ad54b4759a4d60d9bb3f7ad8d`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:36:34.246401 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-48c4b250-87b7-4afd-a7a7-e59e1dfecad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:36:34.318023 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1283/2541] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:36:34 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:36:34.330072 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee09513-5634-42ec-a53b-05f08ba6fb36 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:34.331868 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-0ee09513-5634-42ec-a53b-05f08ba6fb36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:36:34.391751 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee09513-5634-42ec-a53b-05f08ba6fb36 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:34.395402 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2753e0e2-318c-4f50-8e04-39c1fff36838 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e79503178ac54e62ba385467d5617ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:34.396015 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2753e0e2-318c-4f50-8e04-39c1fff36838 service cinder] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:34.396295 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2753e0e2-318c-4f50-8e04-39c1fff36838 service cinder] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:34.396560 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2753e0e2-318c-4f50-8e04-39c1fff36838 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:34.406777 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2753e0e2-318c-4f50-8e04-39c1fff36838 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:34.408168 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2753e0e2-318c-4f50-8e04-39c1fff36838 service cinder] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:34.418300 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1259/2542] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:36:34 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:36:35.018359 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c4b250-87b7-4afd-a7a7-e59e1dfecad2 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:35.081879 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c4b250-87b7-4afd-a7a7-e59e1dfecad2 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:35.086832 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad851320-cac8-4b91-a45b-f7de7896a774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:35.087855 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad851320-cac8-4b91-a45b-f7de7896a774 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:35.088266 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad851320-cac8-4b91-a45b-f7de7896a774 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:35.088542 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad851320-cac8-4b91-a45b-f7de7896a774 admin admin] PATH_INFO: `/v3/users/4104ad931d9245c9b05c524ab627f997` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:35.089745 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad851320-cac8-4b91-a45b-f7de7896a774 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4104ad931d9245c9b05c524ab627f997)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:35.091738 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad851320-cac8-4b91-a45b-f7de7896a774 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:35.141291 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-ad851320-cac8-4b91-a45b-f7de7896a774 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4104ad931d9245c9b05c524ab627f997'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:35.154395 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-ad851320-cac8-4b91-a45b-f7de7896a774 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4104ad931d9245c9b05c524ab627f997'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:35.167488 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-ad851320-cac8-4b91-a45b-f7de7896a774 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4104ad931d9245c9b05c524ab627f997'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:35.168623 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-ad851320-cac8-4b91-a45b-f7de7896a774 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4104ad931d9245c9b05c524ab627f997'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:35.179404 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-ad851320-cac8-4b91-a45b-f7de7896a774 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4104ad931d9245c9b05c524ab627f997'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:35.190316 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1284/2543] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:36:35 2022] DELETE /identity/v3/users/4104ad931d9245c9b05c524ab627f997 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:36:35.196551 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af7efb7-9b5e-4df7-b76e-42f568d50c03 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:35.196865 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af7efb7-9b5e-4df7-b76e-42f568d50c03 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:35.197141 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af7efb7-9b5e-4df7-b76e-42f568d50c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:35.217444 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-5af7efb7-9b5e-4df7-b76e-42f568d50c03 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:36:35.218684 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-5af7efb7-9b5e-4df7-b76e-42f568d50c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:36:35.260644 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:36:35.290129 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1260/2544] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:36:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:36:35.300202 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad851320-cac8-4b91-a45b-f7de7896a774 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:35.301683 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-ad851320-cac8-4b91-a45b-f7de7896a774 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:36:35.307276 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:36:35.371117 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad851320-cac8-4b91-a45b-f7de7896a774 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:35.374933 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb28f02-6dc1-4c0d-ae50-b49d7d7d1103 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:35.375564 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb28f02-6dc1-4c0d-ae50-b49d7d7d1103 service neutron] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:35.375859 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb28f02-6dc1-4c0d-ae50-b49d7d7d1103 service neutron] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:35.376800 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb28f02-6dc1-4c0d-ae50-b49d7d7d1103 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:35.386838 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb28f02-6dc1-4c0d-ae50-b49d7d7d1103 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:35.388623 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb28f02-6dc1-4c0d-ae50-b49d7d7d1103 service neutron] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:35.399664 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1285/2545] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:36:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:36:35.689993 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af7efb7-9b5e-4df7-b76e-42f568d50c03 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:35.692422 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-5af7efb7-9b5e-4df7-b76e-42f568d50c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:36:35.719390 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af7efb7-9b5e-4df7-b76e-42f568d50c03 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:35.727034 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadb4d43-3f0d-48f3-9c64-97a9fd5ff64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:35.728232 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb4d43-3f0d-48f3-9c64-97a9fd5ff64b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:35.728592 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb4d43-3f0d-48f3-9c64-97a9fd5ff64b admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:35.728859 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb4d43-3f0d-48f3-9c64-97a9fd5ff64b admin admin] PATH_INFO: `/v3/projects/4c04cd02fd59403e831830ed32de1677` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:35.730082 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadb4d43-3f0d-48f3-9c64-97a9fd5ff64b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c04cd02fd59403e831830ed32de1677)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:35.732060 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadb4d43-3f0d-48f3-9c64-97a9fd5ff64b admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:35.803467 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-aadb4d43-3f0d-48f3-9c64-97a9fd5ff64b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c04cd02fd59403e831830ed32de1677', 'request_id': 'req-aadb4d43-3f0d-48f3-9c64-97a9fd5ff64b'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:35.815273 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-aadb4d43-3f0d-48f3-9c64-97a9fd5ff64b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c04cd02fd59403e831830ed32de1677', 'request_id': 'req-aadb4d43-3f0d-48f3-9c64-97a9fd5ff64b'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:35.822478 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-aadb4d43-3f0d-48f3-9c64-97a9fd5ff64b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c04cd02fd59403e831830ed32de1677', 'request_id': 'req-aadb4d43-3f0d-48f3-9c64-97a9fd5ff64b'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:35.833824 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-aadb4d43-3f0d-48f3-9c64-97a9fd5ff64b admin admin] The token cache is being invalidate because project 4c04cd02fd59403e831830ed32de1677 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:36:35.836484 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-aadb4d43-3f0d-48f3-9c64-97a9fd5ff64b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:35.836484 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-aadb4d43-3f0d-48f3-9c64-97a9fd5ff64b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:35.837438 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1261/2546] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:36:35 2022] DELETE /identity/v3/projects/4c04cd02fd59403e831830ed32de1677 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:36:35.842399 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb28f02-6dc1-4c0d-ae50-b49d7d7d1103 service neutron] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:35.853067 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb28f02-6dc1-4c0d-ae50-b49d7d7d1103 service neutron] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:35.912364 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0e2290-ff65-47bb-8a56-23e28185e51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:35.913006 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e2290-ff65-47bb-8a56-23e28185e51e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:35.913286 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e2290-ff65-47bb-8a56-23e28185e51e admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:35.913559 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e2290-ff65-47bb-8a56-23e28185e51e admin admin] PATH_INFO: `/v3/users/3f80610ad54b4759a4d60d9bb3f7ad8d` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:35.915392 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0e2290-ff65-47bb-8a56-23e28185e51e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f80610ad54b4759a4d60d9bb3f7ad8d)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:35.917315 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0e2290-ff65-47bb-8a56-23e28185e51e admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:35.970409 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-bb0e2290-ff65-47bb-8a56-23e28185e51e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f80610ad54b4759a4d60d9bb3f7ad8d'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:35.984509 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-bb0e2290-ff65-47bb-8a56-23e28185e51e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f80610ad54b4759a4d60d9bb3f7ad8d'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:35.993522 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-bb0e2290-ff65-47bb-8a56-23e28185e51e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f80610ad54b4759a4d60d9bb3f7ad8d'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:35.995447 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-bb0e2290-ff65-47bb-8a56-23e28185e51e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f80610ad54b4759a4d60d9bb3f7ad8d'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:36.006079 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-bb0e2290-ff65-47bb-8a56-23e28185e51e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f80610ad54b4759a4d60d9bb3f7ad8d'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:36.013748 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1286/2547] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:36:35 2022] DELETE /identity/v3/users/3f80610ad54b4759a4d60d9bb3f7ad8d => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:36:36.406282 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadb4d43-3f0d-48f3-9c64-97a9fd5ff64b admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:36.407871 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-aadb4d43-3f0d-48f3-9c64-97a9fd5ff64b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:36:36.421725 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadb4d43-3f0d-48f3-9c64-97a9fd5ff64b admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:36.513087 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620d2026-2d9d-443a-812e-01db479cfeb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:36.513903 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620d2026-2d9d-443a-812e-01db479cfeb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:36.514212 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620d2026-2d9d-443a-812e-01db479cfeb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:36.514663 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620d2026-2d9d-443a-812e-01db479cfeb6 admin admin] PATH_INFO: `/v3/projects/200ba10e31d94e42958d53ba5544fbd5` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:36.515952 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620d2026-2d9d-443a-812e-01db479cfeb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=200ba10e31d94e42958d53ba5544fbd5)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:36.517948 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620d2026-2d9d-443a-812e-01db479cfeb6 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:36.572843 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-620d2026-2d9d-443a-812e-01db479cfeb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '200ba10e31d94e42958d53ba5544fbd5', 'request_id': 'req-620d2026-2d9d-443a-812e-01db479cfeb6'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:36.582584 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-620d2026-2d9d-443a-812e-01db479cfeb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '200ba10e31d94e42958d53ba5544fbd5', 'request_id': 'req-620d2026-2d9d-443a-812e-01db479cfeb6'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:36.591231 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-620d2026-2d9d-443a-812e-01db479cfeb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '200ba10e31d94e42958d53ba5544fbd5', 'request_id': 'req-620d2026-2d9d-443a-812e-01db479cfeb6'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:36.593861 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:36:36.608813 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-620d2026-2d9d-443a-812e-01db479cfeb6 admin admin] The token cache is being invalidate because project 200ba10e31d94e42958d53ba5544fbd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:36:36.609087 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-620d2026-2d9d-443a-812e-01db479cfeb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:36.609772 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-620d2026-2d9d-443a-812e-01db479cfeb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:36.611453 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1262/2548] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:36:36 2022] DELETE /identity/v3/projects/200ba10e31d94e42958d53ba5544fbd5 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:36:36.616840 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e662389-42c1-4109-a6aa-3956cb77ccbf None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:36.618483 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e662389-42c1-4109-a6aa-3956cb77ccbf None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:36.618483 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e662389-42c1-4109-a6aa-3956cb77ccbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:36.639461 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-9e662389-42c1-4109-a6aa-3956cb77ccbf None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:36:36.640701 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-9e662389-42c1-4109-a6aa-3956cb77ccbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:36:36.661660 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:36:36.713201 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1287/2549] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:36:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:36:36.721272 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d89ac36-dca0-4ddf-9136-adec6ba6402f None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:36.722028 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d89ac36-dca0-4ddf-9136-adec6ba6402f None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:36.722028 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d89ac36-dca0-4ddf-9136-adec6ba6402f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:36.746744 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-1d89ac36-dca0-4ddf-9136-adec6ba6402f None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:36:36.748074 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-1d89ac36-dca0-4ddf-9136-adec6ba6402f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:36:36.756692 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1263/2550] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:36:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:36:36.764162 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e662389-42c1-4109-a6aa-3956cb77ccbf None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:36.781658 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e662389-42c1-4109-a6aa-3956cb77ccbf None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:36.790582 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ea201e-9402-4886-85ad-3c50d18e7907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:36.791676 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea201e-9402-4886-85ad-3c50d18e7907 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:36.792173 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea201e-9402-4886-85ad-3c50d18e7907 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:36.792657 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea201e-9402-4886-85ad-3c50d18e7907 admin admin] PATH_INFO: `/v3/domains` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:36.793854 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ea201e-9402-4886-85ad-3c50d18e7907 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:36:36.794390 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ea201e-9402-4886-85ad-3c50d18e7907 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:36.797566 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ea201e-9402-4886-85ad-3c50d18e7907 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:36.814472 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1288/2551] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 12:36:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:36:36.821071 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d89ac36-dca0-4ddf-9136-adec6ba6402f None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:36.831301 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d89ac36-dca0-4ddf-9136-adec6ba6402f None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:36.836982 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfa5d28-2a8d-4899-bc7c-0c4c667cd633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:36.837798 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa5d28-2a8d-4899-bc7c-0c4c667cd633 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:36.838043 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa5d28-2a8d-4899-bc7c-0c4c667cd633 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:36.838268 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa5d28-2a8d-4899-bc7c-0c4c667cd633 admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:36.838974 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfa5d28-2a8d-4899-bc7c-0c4c667cd633 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:36.840937 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfa5d28-2a8d-4899-bc7c-0c4c667cd633 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:36.874379 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1264/2552] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:36:36 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:36:36.878939 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ea201e-9402-4886-85ad-3c50d18e7907 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:36.890226 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ea201e-9402-4886-85ad-3c50d18e7907 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:36.954551 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b54d05-45d9-4509-b9fa-2cc5e43c7537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:36.955206 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b54d05-45d9-4509-b9fa-2cc5e43c7537 admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:36.955482 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b54d05-45d9-4509-b9fa-2cc5e43c7537 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:36.955753 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b54d05-45d9-4509-b9fa-2cc5e43c7537 admin admin] PATH_INFO: `/v3/users` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:36.956394 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b54d05-45d9-4509-b9fa-2cc5e43c7537 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:36.958315 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b54d05-45d9-4509-b9fa-2cc5e43c7537 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:36.981900 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1289/2553] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:36:36 2022] POST /identity/v3/users => generated 288 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:36:36.985983 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfa5d28-2a8d-4899-bc7c-0c4c667cd633 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:36.997660 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfa5d28-2a8d-4899-bc7c-0c4c667cd633 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:37.002428 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0048a8e0-8d64-41ef-b4e8-3ef12f99ccd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:37.003087 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0048a8e0-8d64-41ef-b4e8-3ef12f99ccd1 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:37.003369 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0048a8e0-8d64-41ef-b4e8-3ef12f99ccd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:37.006203 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0048a8e0-8d64-41ef-b4e8-3ef12f99ccd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:37.006203 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0048a8e0-8d64-41ef-b4e8-3ef12f99ccd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:37.006203 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0048a8e0-8d64-41ef-b4e8-3ef12f99ccd1 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:37.016930 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1265/2554] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:36:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:36:37.021392 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b54d05-45d9-4509-b9fa-2cc5e43c7537 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:37.033751 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b54d05-45d9-4509-b9fa-2cc5e43c7537 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:37.038495 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd798f39-e327-4098-864e-a72cae33d4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:37.041707 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd798f39-e327-4098-864e-a72cae33d4c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:37.044207 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd798f39-e327-4098-864e-a72cae33d4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:37.044478 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd798f39-e327-4098-864e-a72cae33d4c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:37.047798 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd798f39-e327-4098-864e-a72cae33d4c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:37.049427 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd798f39-e327-4098-864e-a72cae33d4c1 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:37.061223 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1290/2555] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:36:37 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 12:36:37.065697 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0048a8e0-8d64-41ef-b4e8-3ef12f99ccd1 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:37.077765 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0048a8e0-8d64-41ef-b4e8-3ef12f99ccd1 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:37.082555 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08957be-9e19-4e91-abd0-39a6f6f49e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:37.083279 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08957be-9e19-4e91-abd0-39a6f6f49e90 admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:37.083563 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08957be-9e19-4e91-abd0-39a6f6f49e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:37.083821 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08957be-9e19-4e91-abd0-39a6f6f49e90 admin admin] PATH_INFO: `/v3/projects/1f06a9cb22ba4e708d3e56c4d1f9f98e/users/0b653370d507453ebb158eb40d2b1253/roles/b5cfd7a855a448359e9017f51d32b6fc` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:37.100731 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08957be-9e19-4e91-abd0-39a6f6f49e90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f06a9cb22ba4e708d3e56c4d1f9f98e, user_id=0b653370d507453ebb158eb40d2b1253, role_id=b5cfd7a855a448359e9017f51d32b6fc)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:37.104037 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08957be-9e19-4e91-abd0-39a6f6f49e90 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:37.120160 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1266/2556] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:36:37 2022] PUT /identity/v3/projects/1f06a9cb22ba4e708d3e56c4d1f9f98e/users/0b653370d507453ebb158eb40d2b1253/roles/b5cfd7a855a448359e9017f51d32b6fc => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:36:37.130895 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41bc49b-d574-4893-bdc0-875184a1208e None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:37.131277 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41bc49b-d574-4893-bdc0-875184a1208e None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:37.131556 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41bc49b-d574-4893-bdc0-875184a1208e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:37.163263 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-a41bc49b-d574-4893-bdc0-875184a1208e None None] MFA Rules not processed for user `0b653370d507453ebb158eb40d2b1253`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:36:37.165796 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-a41bc49b-d574-4893-bdc0-875184a1208e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:36:37.239980 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1291/2557] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:36:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:36:37.252206 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08957be-9e19-4e91-abd0-39a6f6f49e90 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:37.253914 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-f08957be-9e19-4e91-abd0-39a6f6f49e90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:36:37.315452 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08957be-9e19-4e91-abd0-39a6f6f49e90 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:37.319611 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99df8b6-4690-4f12-ac52-28733f9c1d0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e79503178ac54e62ba385467d5617ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:37.320347 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99df8b6-4690-4f12-ac52-28733f9c1d0c service cinder] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:37.320625 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99df8b6-4690-4f12-ac52-28733f9c1d0c service cinder] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:37.320896 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99df8b6-4690-4f12-ac52-28733f9c1d0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:37.333493 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99df8b6-4690-4f12-ac52-28733f9c1d0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:37.335282 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99df8b6-4690-4f12-ac52-28733f9c1d0c service cinder] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:37.346774 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1267/2558] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:36:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:36:46.250827 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41bc49b-d574-4893-bdc0-875184a1208e None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:46.252286 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-a41bc49b-d574-4893-bdc0-875184a1208e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:36:46.276463 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:36:46.319702 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41bc49b-d574-4893-bdc0-875184a1208e None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:46.325720 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ccd68-a256-4dd9-bc15-a5353d3162ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:46.326465 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ccd68-a256-4dd9-bc15-a5353d3162ae service neutron] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:46.326748 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ccd68-a256-4dd9-bc15-a5353d3162ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:46.327049 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ccd68-a256-4dd9-bc15-a5353d3162ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:46.329210 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-564ccd68-a256-4dd9-bc15-a5353d3162ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:36:46.397728 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564ccd68-a256-4dd9-bc15-a5353d3162ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:46.399180 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564ccd68-a256-4dd9-bc15-a5353d3162ae service neutron] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:46.410501 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1292/2559] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:36:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:36:47.341858 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=56,keystone:DELETE=1,keystone:INSERT=2 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:36:50.009336 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bb0715-5bdc-4fd2-83bf-7d40b246ed4e None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:50.010052 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bb0715-5bdc-4fd2-83bf-7d40b246ed4e None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:50.010341 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bb0715-5bdc-4fd2-83bf-7d40b246ed4e None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:50.014783 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1268/2560] 10.222.0.79 () {54 vars in 961 bytes} [Wed Aug 31 12:36:50 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:36:50.021863 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e31e5ce-b6f1-4fde-bd74-0c4eabfb95ab None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:50.022432 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e31e5ce-b6f1-4fde-bd74-0c4eabfb95ab None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:50.022919 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e31e5ce-b6f1-4fde-bd74-0c4eabfb95ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:50.054041 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-5e31e5ce-b6f1-4fde-bd74-0c4eabfb95ab None None] MFA Rules not processed for user `b6deab40ae6244d4b9affa47b274aea3`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:36:50.055628 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-5e31e5ce-b6f1-4fde-bd74-0c4eabfb95ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:36:50.081169 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bb0715-5bdc-4fd2-83bf-7d40b246ed4e None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:50.083034 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-d3bb0715-5bdc-4fd2-83bf-7d40b246ed4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:36:50.102338 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bb0715-5bdc-4fd2-83bf-7d40b246ed4e None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:50.107870 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b86d9a-08c0-4049-9aec-976a5263739c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:50.108750 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b86d9a-08c0-4049-9aec-976a5263739c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:50.109025 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b86d9a-08c0-4049-9aec-976a5263739c admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:50.109468 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b86d9a-08c0-4049-9aec-976a5263739c admin admin] PATH_INFO: `/v3/users/ee19faf2a2c54b19a9dc01d28f045b3a` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:50.110868 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b86d9a-08c0-4049-9aec-976a5263739c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee19faf2a2c54b19a9dc01d28f045b3a)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:50.112942 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b86d9a-08c0-4049-9aec-976a5263739c admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:50.160847 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1293/2561] 10.222.0.79 () {58 vars in 1058 bytes} [Wed Aug 31 12:36:50 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:36:50.170087 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e31e5ce-b6f1-4fde-bd74-0c4eabfb95ab None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:50.178496 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-23b86d9a-08c0-4049-9aec-976a5263739c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee19faf2a2c54b19a9dc01d28f045b3a'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:50.182589 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e31e5ce-b6f1-4fde-bd74-0c4eabfb95ab None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:50.189703 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325fa0dd-edda-4ef8-9b6c-77584dde5d75 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6deab40ae6244d4b9affa47b274aea3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:50.190619 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325fa0dd-edda-4ef8-9b6c-77584dde5d75 service placement] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:50.191063 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325fa0dd-edda-4ef8-9b6c-77584dde5d75 service placement] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:50.191443 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325fa0dd-edda-4ef8-9b6c-77584dde5d75 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:50.194292 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-325fa0dd-edda-4ef8-9b6c-77584dde5d75 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:36:50.202662 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-23b86d9a-08c0-4049-9aec-976a5263739c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee19faf2a2c54b19a9dc01d28f045b3a'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:50.203907 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-23b86d9a-08c0-4049-9aec-976a5263739c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee19faf2a2c54b19a9dc01d28f045b3a'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:50.211916 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325fa0dd-edda-4ef8-9b6c-77584dde5d75 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:50.213560 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325fa0dd-edda-4ef8-9b6c-77584dde5d75 service placement] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:50.217016 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-23b86d9a-08c0-4049-9aec-976a5263739c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee19faf2a2c54b19a9dc01d28f045b3a'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:50.221885 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-23b86d9a-08c0-4049-9aec-976a5263739c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee19faf2a2c54b19a9dc01d28f045b3a'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:50.224794 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1294/2562] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:36:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:36:50.238605 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1269/2563] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:36:50 2022] DELETE /identity/v3/users/ee19faf2a2c54b19a9dc01d28f045b3a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:36:50.462837 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325fa0dd-edda-4ef8-9b6c-77584dde5d75 service placement] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:50.479364 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325fa0dd-edda-4ef8-9b6c-77584dde5d75 service placement] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:50.535103 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:36:50.546463 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2cefb2-c405-49d8-a425-d6d6c7778b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:50.547190 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2cefb2-c405-49d8-a425-d6d6c7778b3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:50.547539 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2cefb2-c405-49d8-a425-d6d6c7778b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:50.547737 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2cefb2-c405-49d8-a425-d6d6c7778b3e admin admin] PATH_INFO: `/v3/projects/93d78bffa2c740b1aa7e09882a90eb9a` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:50.549035 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2cefb2-c405-49d8-a425-d6d6c7778b3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=93d78bffa2c740b1aa7e09882a90eb9a)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:50.551007 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2cefb2-c405-49d8-a425-d6d6c7778b3e admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:50.619300 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-1f2cefb2-c405-49d8-a425-d6d6c7778b3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93d78bffa2c740b1aa7e09882a90eb9a', 'request_id': 'req-1f2cefb2-c405-49d8-a425-d6d6c7778b3e'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:50.627982 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-1f2cefb2-c405-49d8-a425-d6d6c7778b3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93d78bffa2c740b1aa7e09882a90eb9a', 'request_id': 'req-1f2cefb2-c405-49d8-a425-d6d6c7778b3e'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:50.634766 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-1f2cefb2-c405-49d8-a425-d6d6c7778b3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93d78bffa2c740b1aa7e09882a90eb9a', 'request_id': 'req-1f2cefb2-c405-49d8-a425-d6d6c7778b3e'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:50.649509 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-1f2cefb2-c405-49d8-a425-d6d6c7778b3e admin admin] The token cache is being invalidate because project 93d78bffa2c740b1aa7e09882a90eb9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:36:50.649858 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-1f2cefb2-c405-49d8-a425-d6d6c7778b3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:50.650444 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-1f2cefb2-c405-49d8-a425-d6d6c7778b3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:50.652014 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1295/2564] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:36:50 2022] DELETE /identity/v3/projects/93d78bffa2c740b1aa7e09882a90eb9a => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:36:50.657057 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce201e1-28ad-400a-93ae-3ad1de05d1e3 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:50.657341 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce201e1-28ad-400a-93ae-3ad1de05d1e3 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:50.657616 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce201e1-28ad-400a-93ae-3ad1de05d1e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:50.679486 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-bce201e1-28ad-400a-93ae-3ad1de05d1e3 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:36:50.681266 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-bce201e1-28ad-400a-93ae-3ad1de05d1e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:36:50.744724 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1270/2565] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:36:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:36:50.753625 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23866170-4579-4870-bfbc-8ef763ca0940 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:50.753912 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23866170-4579-4870-bfbc-8ef763ca0940 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:50.754187 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23866170-4579-4870-bfbc-8ef763ca0940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:50.775111 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-23866170-4579-4870-bfbc-8ef763ca0940 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:36:50.776339 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-23866170-4579-4870-bfbc-8ef763ca0940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:36:50.785134 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1296/2566] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:36:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:36:50.789607 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce201e1-28ad-400a-93ae-3ad1de05d1e3 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:50.799444 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce201e1-28ad-400a-93ae-3ad1de05d1e3 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:50.804112 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fffc05c-236e-4fd1-8426-1dff57ad4998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:50.805280 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fffc05c-236e-4fd1-8426-1dff57ad4998 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:50.805557 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fffc05c-236e-4fd1-8426-1dff57ad4998 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:50.805826 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fffc05c-236e-4fd1-8426-1dff57ad4998 admin admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:50.806470 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fffc05c-236e-4fd1-8426-1dff57ad4998 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:36:50.806769 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fffc05c-236e-4fd1-8426-1dff57ad4998 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:50.808403 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fffc05c-236e-4fd1-8426-1dff57ad4998 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:50.821258 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1271/2567] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 12:36:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:36:50.825488 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23866170-4579-4870-bfbc-8ef763ca0940 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:50.835143 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23866170-4579-4870-bfbc-8ef763ca0940 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:50.840887 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce28956-89a8-41ae-9364-0e72f0f95969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:50.841580 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce28956-89a8-41ae-9364-0e72f0f95969 admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:50.841893 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce28956-89a8-41ae-9364-0e72f0f95969 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:50.842182 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce28956-89a8-41ae-9364-0e72f0f95969 admin admin] PATH_INFO: `/v3/projects` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:50.842830 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce28956-89a8-41ae-9364-0e72f0f95969 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:50.844793 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce28956-89a8-41ae-9364-0e72f0f95969 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:50.874328 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1297/2568] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:36:50 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:36:50.878872 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fffc05c-236e-4fd1-8426-1dff57ad4998 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:50.890011 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fffc05c-236e-4fd1-8426-1dff57ad4998 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:50.954590 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de96d82-652f-479f-8147-e19636443f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:50.955371 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de96d82-652f-479f-8147-e19636443f4f admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:50.955652 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de96d82-652f-479f-8147-e19636443f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:50.955926 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de96d82-652f-479f-8147-e19636443f4f admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:50.956623 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de96d82-652f-479f-8147-e19636443f4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:50.958704 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de96d82-652f-479f-8147-e19636443f4f admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:50.967455 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:36:50.984232 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1272/2569] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:36:50 2022] POST /identity/v3/users => generated 288 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:36:50.989459 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce28956-89a8-41ae-9364-0e72f0f95969 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:51.001010 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce28956-89a8-41ae-9364-0e72f0f95969 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:51.005849 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86fa03c-ce0b-4093-bb4a-57333c0c09a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:51.006510 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86fa03c-ce0b-4093-bb4a-57333c0c09a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:51.006897 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86fa03c-ce0b-4093-bb4a-57333c0c09a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:51.007162 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86fa03c-ce0b-4093-bb4a-57333c0c09a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:51.007862 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86fa03c-ce0b-4093-bb4a-57333c0c09a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:51.009642 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86fa03c-ce0b-4093-bb4a-57333c0c09a1 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:51.020426 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1298/2570] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:36:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:36:51.025204 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de96d82-652f-479f-8147-e19636443f4f admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:51.036215 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de96d82-652f-479f-8147-e19636443f4f admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:51.042049 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b82d89-88e0-411d-b6f5-97904d3688ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:51.042684 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b82d89-88e0-411d-b6f5-97904d3688ca admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:51.043000 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b82d89-88e0-411d-b6f5-97904d3688ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:51.043278 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b82d89-88e0-411d-b6f5-97904d3688ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:51.043938 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b82d89-88e0-411d-b6f5-97904d3688ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:51.045581 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b82d89-88e0-411d-b6f5-97904d3688ca admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:51.058025 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1273/2571] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:36:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:36:51.062374 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86fa03c-ce0b-4093-bb4a-57333c0c09a1 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:51.073611 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86fa03c-ce0b-4093-bb4a-57333c0c09a1 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:51.078349 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9edddf1-d880-408a-a489-42554e1a73af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:51.079069 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9edddf1-d880-408a-a489-42554e1a73af admin admin] REQUEST_METHOD: `PUT` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:51.079351 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9edddf1-d880-408a-a489-42554e1a73af admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:51.079623 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9edddf1-d880-408a-a489-42554e1a73af admin admin] PATH_INFO: `/v3/projects/4ab8eb57013043c9860183b66e999c5b/users/37e7f9e3297545338ab9bfe2de330788/roles/b5cfd7a855a448359e9017f51d32b6fc` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:51.096300 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9edddf1-d880-408a-a489-42554e1a73af admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ab8eb57013043c9860183b66e999c5b, user_id=37e7f9e3297545338ab9bfe2de330788, role_id=b5cfd7a855a448359e9017f51d32b6fc)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:51.098995 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9edddf1-d880-408a-a489-42554e1a73af admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:51.113649 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1299/2572] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:36:51 2022] PUT /identity/v3/projects/4ab8eb57013043c9860183b66e999c5b/users/37e7f9e3297545338ab9bfe2de330788/roles/b5cfd7a855a448359e9017f51d32b6fc => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:36:51.124869 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb5a15-c1b5-45fd-bcbb-8ef557678679 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:51.125151 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb5a15-c1b5-45fd-bcbb-8ef557678679 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:51.125421 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb5a15-c1b5-45fd-bcbb-8ef557678679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:51.152942 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-fafb5a15-c1b5-45fd-bcbb-8ef557678679 None None] MFA Rules not processed for user `37e7f9e3297545338ab9bfe2de330788`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:36:51.154141 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-fafb5a15-c1b5-45fd-bcbb-8ef557678679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:36:51.223666 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1274/2573] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:36:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:36:51.229017 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9edddf1-d880-408a-a489-42554e1a73af admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:51.291080 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9edddf1-d880-408a-a489-42554e1a73af admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:51.295935 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c68d65-d553-4613-b994-e20bcf87b261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:51.296547 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c68d65-d553-4613-b994-e20bcf87b261 admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:51.296825 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c68d65-d553-4613-b994-e20bcf87b261 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:51.297099 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c68d65-d553-4613-b994-e20bcf87b261 admin admin] PATH_INFO: `/v3/projects` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:51.297734 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c68d65-d553-4613-b994-e20bcf87b261 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:51.299672 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c68d65-d553-4613-b994-e20bcf87b261 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:51.326327 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1300/2574] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:36:51 2022] POST /identity/v3/projects => generated 375 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:36:51.330417 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafb5a15-c1b5-45fd-bcbb-8ef557678679 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:51.343414 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafb5a15-c1b5-45fd-bcbb-8ef557678679 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:51.404768 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840b3878-3969-476f-b15e-42e5d049e1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:51.405396 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b3878-3969-476f-b15e-42e5d049e1e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:51.405681 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b3878-3969-476f-b15e-42e5d049e1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:51.405951 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b3878-3969-476f-b15e-42e5d049e1e5 admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:51.406625 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840b3878-3969-476f-b15e-42e5d049e1e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:51.408626 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840b3878-3969-476f-b15e-42e5d049e1e5 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:51.432647 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1275/2575] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:36:51 2022] POST /identity/v3/users => generated 294 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:36:51.437186 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c68d65-d553-4613-b994-e20bcf87b261 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:51.445641 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:36:51.450458 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c68d65-d553-4613-b994-e20bcf87b261 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:51.457207 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8258582-d202-4795-ab34-935e72724b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:51.458091 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8258582-d202-4795-ab34-935e72724b28 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:51.458415 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8258582-d202-4795-ab34-935e72724b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:51.458745 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8258582-d202-4795-ab34-935e72724b28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:51.459562 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8258582-d202-4795-ab34-935e72724b28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:51.461684 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8258582-d202-4795-ab34-935e72724b28 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:51.472547 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1301/2576] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:36:51 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:36:51.477488 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840b3878-3969-476f-b15e-42e5d049e1e5 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:51.487523 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840b3878-3969-476f-b15e-42e5d049e1e5 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:51.492464 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3241f4db-6624-43d0-a104-acffb8aa7188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:51.493120 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3241f4db-6624-43d0-a104-acffb8aa7188 admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:51.493401 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3241f4db-6624-43d0-a104-acffb8aa7188 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:51.493677 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3241f4db-6624-43d0-a104-acffb8aa7188 admin admin] PATH_INFO: `/v3/projects/94b7407ec6ef40daaff3088603fce7de/users/12af04d153f24064931e15554230ed6b/roles/a332ef951db949b0bad7019fbd28a1b9` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:51.508461 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3241f4db-6624-43d0-a104-acffb8aa7188 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94b7407ec6ef40daaff3088603fce7de, user_id=12af04d153f24064931e15554230ed6b, role_id=a332ef951db949b0bad7019fbd28a1b9)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:51.511081 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3241f4db-6624-43d0-a104-acffb8aa7188 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:51.525332 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1276/2577] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:36:51 2022] PUT /identity/v3/projects/94b7407ec6ef40daaff3088603fce7de/users/12af04d153f24064931e15554230ed6b/roles/a332ef951db949b0bad7019fbd28a1b9 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:36:51.529264 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8258582-d202-4795-ab34-935e72724b28 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:51.540369 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8258582-d202-4795-ab34-935e72724b28 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:51.602407 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a5b767-7698-478f-8f0e-120ba53b1eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:51.603134 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a5b767-7698-478f-8f0e-120ba53b1eeb admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:51.603419 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a5b767-7698-478f-8f0e-120ba53b1eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:51.603688 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a5b767-7698-478f-8f0e-120ba53b1eeb admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:51.604335 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a5b767-7698-478f-8f0e-120ba53b1eeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:51.605933 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a5b767-7698-478f-8f0e-120ba53b1eeb admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:51.618390 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1302/2578] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:36:51 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:36:51.622723 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3241f4db-6624-43d0-a104-acffb8aa7188 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:51.633741 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3241f4db-6624-43d0-a104-acffb8aa7188 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:51.638750 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f67cfbf-b658-4289-aae8-86096dccb106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:51.639636 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67cfbf-b658-4289-aae8-86096dccb106 admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:51.639928 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67cfbf-b658-4289-aae8-86096dccb106 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:51.640200 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67cfbf-b658-4289-aae8-86096dccb106 admin admin] PATH_INFO: `/v3/projects/94b7407ec6ef40daaff3088603fce7de/users/12af04d153f24064931e15554230ed6b/roles/a332ef951db949b0bad7019fbd28a1b9` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:51.642290 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f67cfbf-b658-4289-aae8-86096dccb106 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94b7407ec6ef40daaff3088603fce7de, user_id=12af04d153f24064931e15554230ed6b, role_id=a332ef951db949b0bad7019fbd28a1b9)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:51.645260 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f67cfbf-b658-4289-aae8-86096dccb106 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:51.661282 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1277/2579] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:36:51 2022] PUT /identity/v3/projects/94b7407ec6ef40daaff3088603fce7de/users/12af04d153f24064931e15554230ed6b/roles/a332ef951db949b0bad7019fbd28a1b9 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:36:51.673726 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a54ddf3-8055-4eec-a7bd-67a71ccd4fa1 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:51.674222 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a54ddf3-8055-4eec-a7bd-67a71ccd4fa1 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:51.674386 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a54ddf3-8055-4eec-a7bd-67a71ccd4fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:51.704980 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-7a54ddf3-8055-4eec-a7bd-67a71ccd4fa1 None None] MFA Rules not processed for user `12af04d153f24064931e15554230ed6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:36:51.706196 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-7a54ddf3-8055-4eec-a7bd-67a71ccd4fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:36:51.785514 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1303/2580] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:36:51 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:36:51.798369 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f67cfbf-b658-4289-aae8-86096dccb106 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:51.800162 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-0f67cfbf-b658-4289-aae8-86096dccb106 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:36:51.823247 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:36:51.860478 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f67cfbf-b658-4289-aae8-86096dccb106 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:51.864455 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee76e311-d0b5-471e-a58c-ffa58e797ca6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e79503178ac54e62ba385467d5617ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:51.865062 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee76e311-d0b5-471e-a58c-ffa58e797ca6 service cinder] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:51.865336 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee76e311-d0b5-471e-a58c-ffa58e797ca6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:51.865625 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee76e311-d0b5-471e-a58c-ffa58e797ca6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:51.924195 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee76e311-d0b5-471e-a58c-ffa58e797ca6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:51.925645 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee76e311-d0b5-471e-a58c-ffa58e797ca6 service cinder] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:51.935504 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1278/2581] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:36:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:36:57.603638 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a54ddf3-8055-4eec-a7bd-67a71ccd4fa1 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:57.604467 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-7a54ddf3-8055-4eec-a7bd-67a71ccd4fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:36:57.618559 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a54ddf3-8055-4eec-a7bd-67a71ccd4fa1 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:57.622690 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33638f37-db9d-4fed-871b-c641c189ae5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e79503178ac54e62ba385467d5617ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:57.623345 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33638f37-db9d-4fed-871b-c641c189ae5a service cinder] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:57.623628 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33638f37-db9d-4fed-871b-c641c189ae5a service cinder] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:57.623890 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33638f37-db9d-4fed-871b-c641c189ae5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:57.634506 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33638f37-db9d-4fed-871b-c641c189ae5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:57.636251 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33638f37-db9d-4fed-871b-c641c189ae5a service cinder] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:57.650530 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1304/2582] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:36:57 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:36:58.596821 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee76e311-d0b5-471e-a58c-ffa58e797ca6 service cinder] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:58.598304 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-ee76e311-d0b5-471e-a58c-ffa58e797ca6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:36:58.669550 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee76e311-d0b5-471e-a58c-ffa58e797ca6 service cinder] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:58.674147 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221e7ff4-a840-4211-bec8-d51ab2438f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:58.674789 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e7ff4-a840-4211-bec8-d51ab2438f28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:58.675101 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e7ff4-a840-4211-bec8-d51ab2438f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:58.675375 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e7ff4-a840-4211-bec8-d51ab2438f28 admin admin] PATH_INFO: `/v3/users/0b653370d507453ebb158eb40d2b1253` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:58.676533 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221e7ff4-a840-4211-bec8-d51ab2438f28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b653370d507453ebb158eb40d2b1253)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:58.678475 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221e7ff4-a840-4211-bec8-d51ab2438f28 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:58.726164 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-221e7ff4-a840-4211-bec8-d51ab2438f28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b653370d507453ebb158eb40d2b1253'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:58.738681 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-221e7ff4-a840-4211-bec8-d51ab2438f28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b653370d507453ebb158eb40d2b1253'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:58.739821 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-221e7ff4-a840-4211-bec8-d51ab2438f28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b653370d507453ebb158eb40d2b1253'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:58.746702 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-221e7ff4-a840-4211-bec8-d51ab2438f28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b653370d507453ebb158eb40d2b1253'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:58.747454 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-221e7ff4-a840-4211-bec8-d51ab2438f28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b653370d507453ebb158eb40d2b1253'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:58.750433 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:36:58.763155 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1279/2583] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:36:58 2022] DELETE /identity/v3/users/0b653370d507453ebb158eb40d2b1253 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:36:58.768023 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb14fc-73fb-4cda-bba6-6a69e40ac185 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:58.768518 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb14fc-73fb-4cda-bba6-6a69e40ac185 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:58.768637 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb14fc-73fb-4cda-bba6-6a69e40ac185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:58.788561 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-76bb14fc-73fb-4cda-bba6-6a69e40ac185 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:36:58.790314 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-76bb14fc-73fb-4cda-bba6-6a69e40ac185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:36:58.856365 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1305/2584] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:36:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:36:58.866600 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221e7ff4-a840-4211-bec8-d51ab2438f28 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:58.868940 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-221e7ff4-a840-4211-bec8-d51ab2438f28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:36:58.932646 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221e7ff4-a840-4211-bec8-d51ab2438f28 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:58.936310 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b280aed-117f-42ba-8710-11f2bcd011f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:58.936913 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b280aed-117f-42ba-8710-11f2bcd011f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:58.937189 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b280aed-117f-42ba-8710-11f2bcd011f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:58.937516 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b280aed-117f-42ba-8710-11f2bcd011f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:58.948746 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b280aed-117f-42ba-8710-11f2bcd011f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:58.950378 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b280aed-117f-42ba-8710-11f2bcd011f0 service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:58.961700 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1280/2585] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:36:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:36:59.263836 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb14fc-73fb-4cda-bba6-6a69e40ac185 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:59.266370 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-76bb14fc-73fb-4cda-bba6-6a69e40ac185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:36:59.278457 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:36:59.285165 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb14fc-73fb-4cda-bba6-6a69e40ac185 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:59.293010 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11696e91-1826-40fb-b192-e6c8119d5d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:59.293010 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11696e91-1826-40fb-b192-e6c8119d5d1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:59.293010 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11696e91-1826-40fb-b192-e6c8119d5d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:59.293010 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11696e91-1826-40fb-b192-e6c8119d5d1c admin admin] PATH_INFO: `/v3/projects/1f06a9cb22ba4e708d3e56c4d1f9f98e` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:59.296216 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11696e91-1826-40fb-b192-e6c8119d5d1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f06a9cb22ba4e708d3e56c4d1f9f98e)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:59.298512 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11696e91-1826-40fb-b192-e6c8119d5d1c admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:59.350284 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-11696e91-1826-40fb-b192-e6c8119d5d1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f06a9cb22ba4e708d3e56c4d1f9f98e', 'request_id': 'req-11696e91-1826-40fb-b192-e6c8119d5d1c'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:59.358623 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-11696e91-1826-40fb-b192-e6c8119d5d1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f06a9cb22ba4e708d3e56c4d1f9f98e', 'request_id': 'req-11696e91-1826-40fb-b192-e6c8119d5d1c'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:59.365842 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-11696e91-1826-40fb-b192-e6c8119d5d1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f06a9cb22ba4e708d3e56c4d1f9f98e', 'request_id': 'req-11696e91-1826-40fb-b192-e6c8119d5d1c'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:59.377811 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-11696e91-1826-40fb-b192-e6c8119d5d1c admin admin] The token cache is being invalidate because project 1f06a9cb22ba4e708d3e56c4d1f9f98e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:36:59.378198 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-11696e91-1826-40fb-b192-e6c8119d5d1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:59.378976 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-11696e91-1826-40fb-b192-e6c8119d5d1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:36:59.380612 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1306/2586] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:36:59 2022] DELETE /identity/v3/projects/1f06a9cb22ba4e708d3e56c4d1f9f98e => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:36:59.386278 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100286a6-9e1d-4b47-bfcd-8fd9b79be9ce None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:59.386670 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100286a6-9e1d-4b47-bfcd-8fd9b79be9ce None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:59.387024 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100286a6-9e1d-4b47-bfcd-8fd9b79be9ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:59.407310 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-100286a6-9e1d-4b47-bfcd-8fd9b79be9ce None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:36:59.408537 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-100286a6-9e1d-4b47-bfcd-8fd9b79be9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:36:59.470484 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1281/2587] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:36:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:36:59.479535 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0a124-cfe5-4717-90d3-ea2ff948714b None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:59.479535 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0a124-cfe5-4717-90d3-ea2ff948714b None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:59.479535 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0a124-cfe5-4717-90d3-ea2ff948714b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:59.505249 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-74b0a124-cfe5-4717-90d3-ea2ff948714b None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:36:59.506462 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-74b0a124-cfe5-4717-90d3-ea2ff948714b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:36:59.515258 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1307/2588] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:36:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:36:59.519767 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100286a6-9e1d-4b47-bfcd-8fd9b79be9ce None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:59.529853 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100286a6-9e1d-4b47-bfcd-8fd9b79be9ce None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:59.534500 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bd0bb7-9e55-47ab-a12b-07990532fd51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:59.535138 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd0bb7-9e55-47ab-a12b-07990532fd51 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:59.535419 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd0bb7-9e55-47ab-a12b-07990532fd51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:59.535687 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd0bb7-9e55-47ab-a12b-07990532fd51 admin admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:59.536331 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bd0bb7-9e55-47ab-a12b-07990532fd51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:36:59.536632 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bd0bb7-9e55-47ab-a12b-07990532fd51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:59.538227 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bd0bb7-9e55-47ab-a12b-07990532fd51 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:59.551281 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1282/2589] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 12:36:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:36:59.556475 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b0a124-cfe5-4717-90d3-ea2ff948714b None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:59.566165 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b0a124-cfe5-4717-90d3-ea2ff948714b None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:59.572091 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7033db2-d8df-4681-b11c-3f8d19623b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:59.572710 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7033db2-d8df-4681-b11c-3f8d19623b9b admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:59.572989 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7033db2-d8df-4681-b11c-3f8d19623b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:59.573260 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7033db2-d8df-4681-b11c-3f8d19623b9b admin admin] PATH_INFO: `/v3/projects` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:59.573901 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7033db2-d8df-4681-b11c-3f8d19623b9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:59.575849 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7033db2-d8df-4681-b11c-3f8d19623b9b admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:59.605562 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1308/2590] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:36:59 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:36:59.609852 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bd0bb7-9e55-47ab-a12b-07990532fd51 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:59.620909 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bd0bb7-9e55-47ab-a12b-07990532fd51 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:59.683354 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5e6686-b48f-4ad8-8057-712a9ada2bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:59.683996 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e6686-b48f-4ad8-8057-712a9ada2bb3 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:59.684270 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e6686-b48f-4ad8-8057-712a9ada2bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:59.684537 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e6686-b48f-4ad8-8057-712a9ada2bb3 admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:59.685247 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5e6686-b48f-4ad8-8057-712a9ada2bb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:59.687326 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5e6686-b48f-4ad8-8057-712a9ada2bb3 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:59.711527 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1283/2591] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:36:59 2022] POST /identity/v3/users => generated 288 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:36:59.715313 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7033db2-d8df-4681-b11c-3f8d19623b9b admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:59.725591 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7033db2-d8df-4681-b11c-3f8d19623b9b admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:59.731610 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b2df93-4bce-4355-9de8-156ca62fac4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:59.732283 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b2df93-4bce-4355-9de8-156ca62fac4c admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:59.732544 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b2df93-4bce-4355-9de8-156ca62fac4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:59.732826 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b2df93-4bce-4355-9de8-156ca62fac4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:59.733486 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b2df93-4bce-4355-9de8-156ca62fac4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:59.735248 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b2df93-4bce-4355-9de8-156ca62fac4c admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:59.747557 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1309/2592] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:36:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:36:59.751670 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5e6686-b48f-4ad8-8057-712a9ada2bb3 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:59.763064 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5e6686-b48f-4ad8-8057-712a9ada2bb3 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:59.767936 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1a73bf-c446-4829-b9a7-7aa1f609daf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:59.768552 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a73bf-c446-4829-b9a7-7aa1f609daf5 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:59.768834 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a73bf-c446-4829-b9a7-7aa1f609daf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:59.769107 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a73bf-c446-4829-b9a7-7aa1f609daf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:59.769753 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1a73bf-c446-4829-b9a7-7aa1f609daf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:59.771422 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1a73bf-c446-4829-b9a7-7aa1f609daf5 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:59.784622 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1284/2593] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:36:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:36:59.789915 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b2df93-4bce-4355-9de8-156ca62fac4c admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:36:59.802939 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b2df93-4bce-4355-9de8-156ca62fac4c admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:36:59.809755 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f188ee3f-f11b-4ce8-8d28-06c10b55da74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:36:59.810437 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f188ee3f-f11b-4ce8-8d28-06c10b55da74 admin admin] REQUEST_METHOD: `PUT` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:59.810736 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f188ee3f-f11b-4ce8-8d28-06c10b55da74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:59.811038 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f188ee3f-f11b-4ce8-8d28-06c10b55da74 admin admin] PATH_INFO: `/v3/projects/af57502132204bf788983b348d67e8b5/users/0a50ec34bf9b496ba1ad326647da8b2e/roles/b5cfd7a855a448359e9017f51d32b6fc` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:59.827950 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f188ee3f-f11b-4ce8-8d28-06c10b55da74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af57502132204bf788983b348d67e8b5, user_id=0a50ec34bf9b496ba1ad326647da8b2e, role_id=b5cfd7a855a448359e9017f51d32b6fc)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:36:59.830663 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f188ee3f-f11b-4ce8-8d28-06c10b55da74 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:36:59.847914 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1310/2594] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:36:59 2022] PUT /identity/v3/projects/af57502132204bf788983b348d67e8b5/users/0a50ec34bf9b496ba1ad326647da8b2e/roles/b5cfd7a855a448359e9017f51d32b6fc => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:36:59.861617 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a2e11-e410-4bbb-a6ae-2dfa4d59a3b0 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:36:59.861834 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a2e11-e410-4bbb-a6ae-2dfa4d59a3b0 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:36:59.862085 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a2e11-e410-4bbb-a6ae-2dfa4d59a3b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:36:59.871903 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:37:00.020371 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-bb1a2e11-e410-4bbb-a6ae-2dfa4d59a3b0 None None] MFA Rules not processed for user `0a50ec34bf9b496ba1ad326647da8b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:37:00.021630 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-bb1a2e11-e410-4bbb-a6ae-2dfa4d59a3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:37:00.095672 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1285/2595] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:36:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:37:00.110989 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f188ee3f-f11b-4ce8-8d28-06c10b55da74 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:37:00.113423 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-f188ee3f-f11b-4ce8-8d28-06c10b55da74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:37:00.179757 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f188ee3f-f11b-4ce8-8d28-06c10b55da74 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:37:00.183789 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eff4b75-d0ae-45fb-b7e7-af6bc97cad65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e79503178ac54e62ba385467d5617ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:37:00.184417 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff4b75-d0ae-45fb-b7e7-af6bc97cad65 service cinder] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:37:00.184716 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff4b75-d0ae-45fb-b7e7-af6bc97cad65 service cinder] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:37:00.184988 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff4b75-d0ae-45fb-b7e7-af6bc97cad65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:37:00.194387 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eff4b75-d0ae-45fb-b7e7-af6bc97cad65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:37:00.196373 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eff4b75-d0ae-45fb-b7e7-af6bc97cad65 service cinder] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:37:00.206617 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1311/2596] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:37:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:37:03.396414 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1a2e11-e410-4bbb-a6ae-2dfa4d59a3b0 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:37:03.498018 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1a2e11-e410-4bbb-a6ae-2dfa4d59a3b0 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:37:03.503466 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395b5727-17ab-4dba-9f53-66fcfc103d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:37:03.504290 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b5727-17ab-4dba-9f53-66fcfc103d25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:37:03.504634 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b5727-17ab-4dba-9f53-66fcfc103d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:37:03.504820 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b5727-17ab-4dba-9f53-66fcfc103d25 admin admin] PATH_INFO: `/v3/users/0a50ec34bf9b496ba1ad326647da8b2e` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:37:03.505937 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395b5727-17ab-4dba-9f53-66fcfc103d25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a50ec34bf9b496ba1ad326647da8b2e)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:37:03.511773 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395b5727-17ab-4dba-9f53-66fcfc103d25 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:37:03.585829 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-395b5727-17ab-4dba-9f53-66fcfc103d25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a50ec34bf9b496ba1ad326647da8b2e'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:37:03.606602 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-395b5727-17ab-4dba-9f53-66fcfc103d25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a50ec34bf9b496ba1ad326647da8b2e'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:37:03.607413 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-395b5727-17ab-4dba-9f53-66fcfc103d25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a50ec34bf9b496ba1ad326647da8b2e'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:37:03.615519 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-395b5727-17ab-4dba-9f53-66fcfc103d25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a50ec34bf9b496ba1ad326647da8b2e'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:37:03.616343 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-395b5727-17ab-4dba-9f53-66fcfc103d25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a50ec34bf9b496ba1ad326647da8b2e'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:37:03.637085 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1286/2597] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:37:03 2022] DELETE /identity/v3/users/0a50ec34bf9b496ba1ad326647da8b2e => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:37:03.641932 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea02fa-4ca6-497f-8a93-4966550aba77 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:37:03.642609 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea02fa-4ca6-497f-8a93-4966550aba77 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:37:03.642609 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea02fa-4ca6-497f-8a93-4966550aba77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:37:03.667777 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-f9ea02fa-4ca6-497f-8a93-4966550aba77 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:37:03.669956 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-f9ea02fa-4ca6-497f-8a93-4966550aba77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:37:03.697127 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:37:03.759061 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1312/2598] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:37:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:37:03.770276 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395b5727-17ab-4dba-9f53-66fcfc103d25 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:37:03.771984 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-395b5727-17ab-4dba-9f53-66fcfc103d25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:37:03.786404 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:37:03.844941 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395b5727-17ab-4dba-9f53-66fcfc103d25 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:37:03.850814 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c93706-8770-4182-89e4-86a11bae7ff9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:37:03.851947 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c93706-8770-4182-89e4-86a11bae7ff9 service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:37:03.852503 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c93706-8770-4182-89e4-86a11bae7ff9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:37:03.853040 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c93706-8770-4182-89e4-86a11bae7ff9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:37:03.870091 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c93706-8770-4182-89e4-86a11bae7ff9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:37:03.871656 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c93706-8770-4182-89e4-86a11bae7ff9 service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:37:03.882737 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1287/2599] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:37:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:37:04.189662 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ea02fa-4ca6-497f-8a93-4966550aba77 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:37:04.191317 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-f9ea02fa-4ca6-497f-8a93-4966550aba77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:37:04.205338 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ea02fa-4ca6-497f-8a93-4966550aba77 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:37:04.210155 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a593187-5afe-4c69-babd-a2cea8de902c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:37:04.210837 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a593187-5afe-4c69-babd-a2cea8de902c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:37:04.211148 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a593187-5afe-4c69-babd-a2cea8de902c admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:37:04.211465 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a593187-5afe-4c69-babd-a2cea8de902c admin admin] PATH_INFO: `/v3/projects/af57502132204bf788983b348d67e8b5` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:37:04.213277 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a593187-5afe-4c69-babd-a2cea8de902c admin admin] RBAC: Authorizing `identity:delete_project(project_id=af57502132204bf788983b348d67e8b5)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:37:04.215289 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a593187-5afe-4c69-babd-a2cea8de902c admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:37:04.275295 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-3a593187-5afe-4c69-babd-a2cea8de902c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af57502132204bf788983b348d67e8b5', 'request_id': 'req-3a593187-5afe-4c69-babd-a2cea8de902c'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:37:04.284451 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-3a593187-5afe-4c69-babd-a2cea8de902c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af57502132204bf788983b348d67e8b5', 'request_id': 'req-3a593187-5afe-4c69-babd-a2cea8de902c'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:37:04.292164 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-3a593187-5afe-4c69-babd-a2cea8de902c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af57502132204bf788983b348d67e8b5', 'request_id': 'req-3a593187-5afe-4c69-babd-a2cea8de902c'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:37:04.304225 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-3a593187-5afe-4c69-babd-a2cea8de902c admin admin] The token cache is being invalidate because project af57502132204bf788983b348d67e8b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:37:04.304515 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-3a593187-5afe-4c69-babd-a2cea8de902c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:37:04.305307 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-3a593187-5afe-4c69-babd-a2cea8de902c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:37:04.308111 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1313/2600] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:37:04 2022] DELETE /identity/v3/projects/af57502132204bf788983b348d67e8b5 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:37:04.313491 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc63c5c-77a1-405d-8d90-b1db9de1143e None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:37:04.313775 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc63c5c-77a1-405d-8d90-b1db9de1143e None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:37:04.314047 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc63c5c-77a1-405d-8d90-b1db9de1143e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:37:04.335444 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-1bc63c5c-77a1-405d-8d90-b1db9de1143e None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:37:04.337512 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-1bc63c5c-77a1-405d-8d90-b1db9de1143e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:37:04.406000 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1288/2601] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:37:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:37:04.416082 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e3ddf-9708-4516-a419-fa05bc2080fa None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:37:04.416478 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e3ddf-9708-4516-a419-fa05bc2080fa None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:37:04.416769 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e3ddf-9708-4516-a419-fa05bc2080fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:37:04.438637 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-137e3ddf-9708-4516-a419-fa05bc2080fa None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:37:04.439839 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-137e3ddf-9708-4516-a419-fa05bc2080fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:37:04.448455 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1314/2602] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:37:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:37:04.453011 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc63c5c-77a1-405d-8d90-b1db9de1143e None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:37:04.467092 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc63c5c-77a1-405d-8d90-b1db9de1143e None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:37:04.473289 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161097ac-b1bf-4866-bba1-b735c8b106ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:37:04.473289 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161097ac-b1bf-4866-bba1-b735c8b106ee admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:37:04.473708 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161097ac-b1bf-4866-bba1-b735c8b106ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:37:04.473708 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161097ac-b1bf-4866-bba1-b735c8b106ee admin admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:37:04.474287 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161097ac-b1bf-4866-bba1-b735c8b106ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:37:04.474592 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161097ac-b1bf-4866-bba1-b735c8b106ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:37:04.476260 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161097ac-b1bf-4866-bba1-b735c8b106ee admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:37:04.490402 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1289/2603] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 12:37:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:37:04.496038 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137e3ddf-9708-4516-a419-fa05bc2080fa None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:37:04.505917 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137e3ddf-9708-4516-a419-fa05bc2080fa None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:37:04.511782 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcafc024-4c2b-467a-81e6-c379ccced04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:37:04.512413 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcafc024-4c2b-467a-81e6-c379ccced04e admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:37:04.512704 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcafc024-4c2b-467a-81e6-c379ccced04e admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:37:04.512970 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcafc024-4c2b-467a-81e6-c379ccced04e admin admin] PATH_INFO: `/v3/projects` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:37:04.513617 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcafc024-4c2b-467a-81e6-c379ccced04e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:37:04.515604 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcafc024-4c2b-467a-81e6-c379ccced04e admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:37:04.545850 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1315/2604] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:37:04 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:37:04.550592 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161097ac-b1bf-4866-bba1-b735c8b106ee admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:37:04.562692 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161097ac-b1bf-4866-bba1-b735c8b106ee admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:37:04.635625 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f898fa2-e1cf-4024-8d08-5daf4d20b986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:37:04.636248 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f898fa2-e1cf-4024-8d08-5daf4d20b986 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:37:04.636528 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f898fa2-e1cf-4024-8d08-5daf4d20b986 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:37:04.636802 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f898fa2-e1cf-4024-8d08-5daf4d20b986 admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:37:04.637672 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f898fa2-e1cf-4024-8d08-5daf4d20b986 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:37:04.639811 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f898fa2-e1cf-4024-8d08-5daf4d20b986 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:37:04.663562 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1290/2605] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:37:04 2022] POST /identity/v3/users => generated 292 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:37:04.668556 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcafc024-4c2b-467a-81e6-c379ccced04e admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:37:04.679411 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcafc024-4c2b-467a-81e6-c379ccced04e admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:37:04.685045 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ffb2b3-3ee6-4228-9412-158fe2d80d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:37:04.685715 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ffb2b3-3ee6-4228-9412-158fe2d80d52 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:37:04.685993 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ffb2b3-3ee6-4228-9412-158fe2d80d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:37:04.686268 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ffb2b3-3ee6-4228-9412-158fe2d80d52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:37:04.686957 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ffb2b3-3ee6-4228-9412-158fe2d80d52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:37:04.688591 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ffb2b3-3ee6-4228-9412-158fe2d80d52 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:37:04.700988 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1316/2606] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:37:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 12:37:04.705276 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f898fa2-e1cf-4024-8d08-5daf4d20b986 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:37:04.716031 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f898fa2-e1cf-4024-8d08-5daf4d20b986 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:37:04.721076 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5f8f0a-f6be-44bf-be6b-3d69fb2cb2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:37:04.721739 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f8f0a-f6be-44bf-be6b-3d69fb2cb2c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:37:04.722023 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f8f0a-f6be-44bf-be6b-3d69fb2cb2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:37:04.722299 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f8f0a-f6be-44bf-be6b-3d69fb2cb2c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:37:04.723004 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5f8f0a-f6be-44bf-be6b-3d69fb2cb2c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:37:04.724643 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5f8f0a-f6be-44bf-be6b-3d69fb2cb2c4 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:37:04.736458 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1291/2607] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:37:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:37:04.741831 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ffb2b3-3ee6-4228-9412-158fe2d80d52 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:37:04.753887 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ffb2b3-3ee6-4228-9412-158fe2d80d52 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:37:04.759536 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fefd71a-278c-49cf-951e-91e7a94ba38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:37:04.760341 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fefd71a-278c-49cf-951e-91e7a94ba38a admin admin] REQUEST_METHOD: `PUT` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:37:04.760505 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fefd71a-278c-49cf-951e-91e7a94ba38a admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:37:04.760775 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fefd71a-278c-49cf-951e-91e7a94ba38a admin admin] PATH_INFO: `/v3/projects/812b75d0fa3241d38b2727efe253ca20/users/c4fb81a9221d435a8d9e38ab138cad4a/roles/b5cfd7a855a448359e9017f51d32b6fc` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:37:04.788007 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fefd71a-278c-49cf-951e-91e7a94ba38a admin admin] RBAC: Authorizing `identity:create_grant(project_id=812b75d0fa3241d38b2727efe253ca20, user_id=c4fb81a9221d435a8d9e38ab138cad4a, role_id=b5cfd7a855a448359e9017f51d32b6fc)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:37:04.791241 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fefd71a-278c-49cf-951e-91e7a94ba38a admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:37:04.811626 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1317/2608] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:37:04 2022] PUT /identity/v3/projects/812b75d0fa3241d38b2727efe253ca20/users/c4fb81a9221d435a8d9e38ab138cad4a/roles/b5cfd7a855a448359e9017f51d32b6fc => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:37:04.816729 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a26727-3c12-4872-8654-cd6d1769e5d4 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:37:04.817020 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a26727-3c12-4872-8654-cd6d1769e5d4 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:37:04.817297 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a26727-3c12-4872-8654-cd6d1769e5d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:37:04.837923 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-c3a26727-3c12-4872-8654-cd6d1769e5d4 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:37:04.839178 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-c3a26727-3c12-4872-8654-cd6d1769e5d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:37:04.852795 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:37:04.906263 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1292/2609] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:37:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:37:04.919487 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fefd71a-278c-49cf-951e-91e7a94ba38a admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:37:04.921475 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-9fefd71a-278c-49cf-951e-91e7a94ba38a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:37:04.973305 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:37:04.987359 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fefd71a-278c-49cf-951e-91e7a94ba38a admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:37:04.991952 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60ac65f-110d-4b47-bc56-448b602ff9bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:37:04.992582 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ac65f-110d-4b47-bc56-448b602ff9bc service neutron] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:37:04.993506 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ac65f-110d-4b47-bc56-448b602ff9bc service neutron] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:37:04.993777 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ac65f-110d-4b47-bc56-448b602ff9bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:37:05.003917 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60ac65f-110d-4b47-bc56-448b602ff9bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:37:05.005511 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60ac65f-110d-4b47-bc56-448b602ff9bc service neutron] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:37:05.015920 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1318/2610] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:37:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:37:05.713649 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52658ae8-b50a-4626-aa91-866959b409c5 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:37:05.714235 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52658ae8-b50a-4626-aa91-866959b409c5 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:37:05.714235 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52658ae8-b50a-4626-aa91-866959b409c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:37:05.747716 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-52658ae8-b50a-4626-aa91-866959b409c5 None None] MFA Rules not processed for user `c4fb81a9221d435a8d9e38ab138cad4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:37:05.749489 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-52658ae8-b50a-4626-aa91-866959b409c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:37:05.842960 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1293/2611] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:37:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:37:05.854567 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60ac65f-110d-4b47-bc56-448b602ff9bc service neutron] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:37:05.856072 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-d60ac65f-110d-4b47-bc56-448b602ff9bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:37:05.922181 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60ac65f-110d-4b47-bc56-448b602ff9bc service neutron] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:37:05.926527 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abea2ea2-d451-4061-b185-c1ece018ae85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e79503178ac54e62ba385467d5617ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:37:05.927186 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea2ea2-d451-4061-b185-c1ece018ae85 service cinder] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:37:05.927474 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea2ea2-d451-4061-b185-c1ece018ae85 service cinder] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:37:05.927745 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea2ea2-d451-4061-b185-c1ece018ae85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:37:05.938058 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abea2ea2-d451-4061-b185-c1ece018ae85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:37:05.939577 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abea2ea2-d451-4061-b185-c1ece018ae85 service cinder] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:37:05.950955 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1319/2612] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:37:05 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:37:07.415734 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4548240-31a5-4dfa-bec2-1396a0438e50 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:37:07.416418 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4548240-31a5-4dfa-bec2-1396a0438e50 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:37:07.416418 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4548240-31a5-4dfa-bec2-1396a0438e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:37:07.435022 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-b4548240-31a5-4dfa-bec2-1396a0438e50 None None] MFA Rules not processed for user `c4fb81a9221d435a8d9e38ab138cad4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:37:07.436243 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-b4548240-31a5-4dfa-bec2-1396a0438e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:37:07.443108 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1294/2613] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:37:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:37:07.696953 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abea2ea2-d451-4061-b185-c1ece018ae85 service cinder] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:37:07.707022 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abea2ea2-d451-4061-b185-c1ece018ae85 service cinder] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:37:07.710484 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be96c43-f7c8-44a3-b7ed-50dee7b10a18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:37:07.711118 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be96c43-f7c8-44a3-b7ed-50dee7b10a18 service neutron] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:37:07.711394 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be96c43-f7c8-44a3-b7ed-50dee7b10a18 service neutron] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:37:07.711679 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be96c43-f7c8-44a3-b7ed-50dee7b10a18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:37:07.713429 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-8be96c43-f7c8-44a3-b7ed-50dee7b10a18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:37:07.724638 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be96c43-f7c8-44a3-b7ed-50dee7b10a18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:37:07.726060 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be96c43-f7c8-44a3-b7ed-50dee7b10a18 service neutron] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:37:07.734204 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1320/2614] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:37:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:37:17.429904 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=53 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:37:17.730701 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=38 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:37:22.988447 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4548240-31a5-4dfa-bec2-1396a0438e50 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:37:22.990276 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-b4548240-31a5-4dfa-bec2-1396a0438e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:37:23.005480 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4548240-31a5-4dfa-bec2-1396a0438e50 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:37:23.010003 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff192ae0-7142-4185-9fb4-903a1edb2ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:37:23.010631 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff192ae0-7142-4185-9fb4-903a1edb2ba3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:37:23.010935 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff192ae0-7142-4185-9fb4-903a1edb2ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:37:23.011209 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff192ae0-7142-4185-9fb4-903a1edb2ba3 admin admin] PATH_INFO: `/v3/users/37e7f9e3297545338ab9bfe2de330788` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:37:23.012326 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff192ae0-7142-4185-9fb4-903a1edb2ba3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37e7f9e3297545338ab9bfe2de330788)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:37:23.014237 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff192ae0-7142-4185-9fb4-903a1edb2ba3 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:37:23.072549 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-ff192ae0-7142-4185-9fb4-903a1edb2ba3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37e7f9e3297545338ab9bfe2de330788'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:37:23.085725 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-ff192ae0-7142-4185-9fb4-903a1edb2ba3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37e7f9e3297545338ab9bfe2de330788'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:37:23.086468 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-ff192ae0-7142-4185-9fb4-903a1edb2ba3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37e7f9e3297545338ab9bfe2de330788'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:37:23.093708 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-ff192ae0-7142-4185-9fb4-903a1edb2ba3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37e7f9e3297545338ab9bfe2de330788'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:37:23.094359 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-ff192ae0-7142-4185-9fb4-903a1edb2ba3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37e7f9e3297545338ab9bfe2de330788'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:37:23.108185 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1295/2615] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:37:22 2022] DELETE /identity/v3/users/37e7f9e3297545338ab9bfe2de330788 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:37:23.113056 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d1bc6-07d6-43ac-9146-fab9942eb1b3 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:37:23.113646 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d1bc6-07d6-43ac-9146-fab9942eb1b3 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:37:23.113646 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d1bc6-07d6-43ac-9146-fab9942eb1b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:37:23.133587 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-219d1bc6-07d6-43ac-9146-fab9942eb1b3 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:37:23.135544 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-219d1bc6-07d6-43ac-9146-fab9942eb1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:37:23.198379 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1321/2616] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:37:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:37:23.208541 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff192ae0-7142-4185-9fb4-903a1edb2ba3 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:37:23.210064 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-ff192ae0-7142-4185-9fb4-903a1edb2ba3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:37:23.274609 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff192ae0-7142-4185-9fb4-903a1edb2ba3 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:37:23.280794 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbd428f-daf0-4c8e-ae1d-d8e6460bc38d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:37:23.281427 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd428f-daf0-4c8e-ae1d-d8e6460bc38d service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:37:23.281704 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd428f-daf0-4c8e-ae1d-d8e6460bc38d service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:37:23.282235 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd428f-daf0-4c8e-ae1d-d8e6460bc38d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:37:23.293138 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbd428f-daf0-4c8e-ae1d-d8e6460bc38d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:37:23.294608 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbd428f-daf0-4c8e-ae1d-d8e6460bc38d service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:37:23.305481 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1296/2617] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:37:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:37:23.627073 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219d1bc6-07d6-43ac-9146-fab9942eb1b3 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:37:23.628594 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-219d1bc6-07d6-43ac-9146-fab9942eb1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:37:23.643342 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219d1bc6-07d6-43ac-9146-fab9942eb1b3 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:37:23.648030 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16dffb9-7dde-474f-95e6-e23364180d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:37:23.648771 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16dffb9-7dde-474f-95e6-e23364180d38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:37:23.649145 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16dffb9-7dde-474f-95e6-e23364180d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:37:23.649484 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16dffb9-7dde-474f-95e6-e23364180d38 admin admin] PATH_INFO: `/v3/projects/4ab8eb57013043c9860183b66e999c5b` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:37:23.651687 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16dffb9-7dde-474f-95e6-e23364180d38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ab8eb57013043c9860183b66e999c5b)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:37:23.653748 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16dffb9-7dde-474f-95e6-e23364180d38 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:37:23.705853 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-e16dffb9-7dde-474f-95e6-e23364180d38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ab8eb57013043c9860183b66e999c5b', 'request_id': 'req-e16dffb9-7dde-474f-95e6-e23364180d38'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:37:23.715165 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-e16dffb9-7dde-474f-95e6-e23364180d38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ab8eb57013043c9860183b66e999c5b', 'request_id': 'req-e16dffb9-7dde-474f-95e6-e23364180d38'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:37:23.723138 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-e16dffb9-7dde-474f-95e6-e23364180d38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ab8eb57013043c9860183b66e999c5b', 'request_id': 'req-e16dffb9-7dde-474f-95e6-e23364180d38'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:37:23.733916 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-e16dffb9-7dde-474f-95e6-e23364180d38 admin admin] The token cache is being invalidate because project 4ab8eb57013043c9860183b66e999c5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:37:23.734205 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-e16dffb9-7dde-474f-95e6-e23364180d38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:37:23.734897 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-e16dffb9-7dde-474f-95e6-e23364180d38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:37:23.736420 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1322/2618] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:37:23 2022] DELETE /identity/v3/projects/4ab8eb57013043c9860183b66e999c5b => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:37:23.740979 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbd428f-daf0-4c8e-ae1d-d8e6460bc38d service neutron] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:37:23.752103 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbd428f-daf0-4c8e-ae1d-d8e6460bc38d service neutron] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:37:23.823420 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7053c3c-700a-4cf9-b278-2e5106dc1e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:37:23.823995 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7053c3c-700a-4cf9-b278-2e5106dc1e6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:37:23.824274 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7053c3c-700a-4cf9-b278-2e5106dc1e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:37:23.824548 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7053c3c-700a-4cf9-b278-2e5106dc1e6a admin admin] PATH_INFO: `/v3/users/12af04d153f24064931e15554230ed6b` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:37:23.825678 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7053c3c-700a-4cf9-b278-2e5106dc1e6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=12af04d153f24064931e15554230ed6b)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:37:23.827629 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7053c3c-700a-4cf9-b278-2e5106dc1e6a admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:37:23.846336 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:37:23.883085 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-b7053c3c-700a-4cf9-b278-2e5106dc1e6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12af04d153f24064931e15554230ed6b'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:37:23.898531 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-b7053c3c-700a-4cf9-b278-2e5106dc1e6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12af04d153f24064931e15554230ed6b'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:37:23.899296 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-b7053c3c-700a-4cf9-b278-2e5106dc1e6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12af04d153f24064931e15554230ed6b'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:37:23.906175 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-b7053c3c-700a-4cf9-b278-2e5106dc1e6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12af04d153f24064931e15554230ed6b'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:37:23.906791 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-b7053c3c-700a-4cf9-b278-2e5106dc1e6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12af04d153f24064931e15554230ed6b'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:37:23.920542 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1297/2619] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:37:23 2022] DELETE /identity/v3/users/12af04d153f24064931e15554230ed6b => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:37:24.211082 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16dffb9-7dde-474f-95e6-e23364180d38 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:37:24.212621 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-e16dffb9-7dde-474f-95e6-e23364180d38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:37:24.227336 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16dffb9-7dde-474f-95e6-e23364180d38 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:37:24.291690 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276fb0b2-3543-4b9c-a5cb-71a0b7b8e1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:37:24.292331 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276fb0b2-3543-4b9c-a5cb-71a0b7b8e1ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:37:24.292700 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276fb0b2-3543-4b9c-a5cb-71a0b7b8e1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:37:24.292882 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276fb0b2-3543-4b9c-a5cb-71a0b7b8e1ed admin admin] PATH_INFO: `/v3/projects/94b7407ec6ef40daaff3088603fce7de` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:37:24.293990 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276fb0b2-3543-4b9c-a5cb-71a0b7b8e1ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=94b7407ec6ef40daaff3088603fce7de)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:37:24.296292 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276fb0b2-3543-4b9c-a5cb-71a0b7b8e1ed admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:37:24.328535 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:37:24.348427 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-276fb0b2-3543-4b9c-a5cb-71a0b7b8e1ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94b7407ec6ef40daaff3088603fce7de', 'request_id': 'req-276fb0b2-3543-4b9c-a5cb-71a0b7b8e1ed'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:37:24.360327 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-276fb0b2-3543-4b9c-a5cb-71a0b7b8e1ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94b7407ec6ef40daaff3088603fce7de', 'request_id': 'req-276fb0b2-3543-4b9c-a5cb-71a0b7b8e1ed'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:37:24.367246 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-276fb0b2-3543-4b9c-a5cb-71a0b7b8e1ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94b7407ec6ef40daaff3088603fce7de', 'request_id': 'req-276fb0b2-3543-4b9c-a5cb-71a0b7b8e1ed'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:37:24.377797 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-276fb0b2-3543-4b9c-a5cb-71a0b7b8e1ed admin admin] The token cache is being invalidate because project 94b7407ec6ef40daaff3088603fce7de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:37:24.378151 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-276fb0b2-3543-4b9c-a5cb-71a0b7b8e1ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:37:24.378892 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-276fb0b2-3543-4b9c-a5cb-71a0b7b8e1ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:37:24.380819 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1323/2620] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:37:24 2022] DELETE /identity/v3/projects/94b7407ec6ef40daaff3088603fce7de => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:37:24.386586 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c13a7-ccbe-491f-9d58-4c02dd5c9247 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:37:24.387167 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c13a7-ccbe-491f-9d58-4c02dd5c9247 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:37:24.387167 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c13a7-ccbe-491f-9d58-4c02dd5c9247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:37:24.407791 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-1b5c13a7-ccbe-491f-9d58-4c02dd5c9247 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:37:24.409411 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-1b5c13a7-ccbe-491f-9d58-4c02dd5c9247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:37:24.474100 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1298/2621] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:37:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:37:24.482028 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de92d68a-880a-4cec-8eb4-b4d093558980 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:37:24.482318 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de92d68a-880a-4cec-8eb4-b4d093558980 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:37:24.482600 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de92d68a-880a-4cec-8eb4-b4d093558980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:37:24.504139 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-de92d68a-880a-4cec-8eb4-b4d093558980 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:37:24.505376 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-de92d68a-880a-4cec-8eb4-b4d093558980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:37:24.514084 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1324/2622] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:37:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:37:24.518565 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5c13a7-ccbe-491f-9d58-4c02dd5c9247 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:37:24.529209 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5c13a7-ccbe-491f-9d58-4c02dd5c9247 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:37:24.533850 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a382f40-1a4a-4d43-aa11-4b1a1d6b16c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:37:24.534455 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a382f40-1a4a-4d43-aa11-4b1a1d6b16c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:37:24.534761 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a382f40-1a4a-4d43-aa11-4b1a1d6b16c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:37:24.535064 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a382f40-1a4a-4d43-aa11-4b1a1d6b16c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:37:24.535722 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a382f40-1a4a-4d43-aa11-4b1a1d6b16c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:37:24.536054 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a382f40-1a4a-4d43-aa11-4b1a1d6b16c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:37:24.537667 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a382f40-1a4a-4d43-aa11-4b1a1d6b16c9 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:37:24.551082 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1299/2623] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 12:37:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:37:24.555559 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de92d68a-880a-4cec-8eb4-b4d093558980 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:37:24.566519 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de92d68a-880a-4cec-8eb4-b4d093558980 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:37:24.571425 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183a9f82-bed5-4995-8086-da09d19c3625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:37:24.572049 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a9f82-bed5-4995-8086-da09d19c3625 admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:37:24.572449 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a9f82-bed5-4995-8086-da09d19c3625 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:37:24.572727 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a9f82-bed5-4995-8086-da09d19c3625 admin admin] PATH_INFO: `/v3/projects` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:37:24.573383 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183a9f82-bed5-4995-8086-da09d19c3625 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:37:24.575459 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183a9f82-bed5-4995-8086-da09d19c3625 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:37:24.604881 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1325/2624] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:37:24 2022] POST /identity/v3/projects => generated 369 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:37:24.609055 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a382f40-1a4a-4d43-aa11-4b1a1d6b16c9 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:37:24.620284 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a382f40-1a4a-4d43-aa11-4b1a1d6b16c9 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:37:24.689651 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3742e70-0307-4b2a-91eb-feb148f64740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:37:24.690310 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3742e70-0307-4b2a-91eb-feb148f64740 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:37:24.690591 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3742e70-0307-4b2a-91eb-feb148f64740 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:37:24.690886 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3742e70-0307-4b2a-91eb-feb148f64740 admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:37:24.691548 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3742e70-0307-4b2a-91eb-feb148f64740 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:37:24.693489 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3742e70-0307-4b2a-91eb-feb148f64740 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:37:24.717538 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1300/2625] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:37:24 2022] POST /identity/v3/users => generated 285 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:37:24.722508 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183a9f82-bed5-4995-8086-da09d19c3625 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:37:24.741817 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183a9f82-bed5-4995-8086-da09d19c3625 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:37:24.750968 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ed916b-9893-4659-ac19-134b2c84e491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:37:24.752035 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed916b-9893-4659-ac19-134b2c84e491 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:37:24.752537 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed916b-9893-4659-ac19-134b2c84e491 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:37:24.753067 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed916b-9893-4659-ac19-134b2c84e491 admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:37:24.754268 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ed916b-9893-4659-ac19-134b2c84e491 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:37:24.757369 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ed916b-9893-4659-ac19-134b2c84e491 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:37:24.770406 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1326/2626] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:37:24 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:37:24.776503 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3742e70-0307-4b2a-91eb-feb148f64740 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:37:24.787334 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3742e70-0307-4b2a-91eb-feb148f64740 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:37:24.793316 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d728bca7-ed0c-4d9d-aca6-c86933759365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:37:24.793964 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d728bca7-ed0c-4d9d-aca6-c86933759365 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:37:24.794243 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d728bca7-ed0c-4d9d-aca6-c86933759365 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:37:24.794519 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d728bca7-ed0c-4d9d-aca6-c86933759365 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:37:24.795228 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d728bca7-ed0c-4d9d-aca6-c86933759365 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:37:24.796873 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d728bca7-ed0c-4d9d-aca6-c86933759365 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:37:24.803143 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:37:24.810762 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1301/2627] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:37:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:37:24.814648 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ed916b-9893-4659-ac19-134b2c84e491 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:37:24.827838 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ed916b-9893-4659-ac19-134b2c84e491 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:37:24.833040 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c7c25-f783-4465-8c6e-d8dda1d40a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:37:24.833703 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c7c25-f783-4465-8c6e-d8dda1d40a99 admin admin] REQUEST_METHOD: `PUT` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:37:24.833983 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c7c25-f783-4465-8c6e-d8dda1d40a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:37:24.834256 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c7c25-f783-4465-8c6e-d8dda1d40a99 admin admin] PATH_INFO: `/v3/projects/8b1cb0d4aebe48d585707f32c857e404/users/c70f2d59df0c488bac06c996dd121911/roles/b5cfd7a855a448359e9017f51d32b6fc` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:37:24.854879 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79c7c25-f783-4465-8c6e-d8dda1d40a99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b1cb0d4aebe48d585707f32c857e404, user_id=c70f2d59df0c488bac06c996dd121911, role_id=b5cfd7a855a448359e9017f51d32b6fc)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:37:24.857815 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79c7c25-f783-4465-8c6e-d8dda1d40a99 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:37:24.875487 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1327/2628] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:37:24 2022] PUT /identity/v3/projects/8b1cb0d4aebe48d585707f32c857e404/users/c70f2d59df0c488bac06c996dd121911/roles/b5cfd7a855a448359e9017f51d32b6fc => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:37:24.887734 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b6f7f8-2fea-421e-ac93-c61fd214ee3f None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:37:24.888039 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b6f7f8-2fea-421e-ac93-c61fd214ee3f None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:37:24.888315 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b6f7f8-2fea-421e-ac93-c61fd214ee3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:37:24.918239 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-82b6f7f8-2fea-421e-ac93-c61fd214ee3f None None] MFA Rules not processed for user `c70f2d59df0c488bac06c996dd121911`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:37:24.919508 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-82b6f7f8-2fea-421e-ac93-c61fd214ee3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:37:24.998822 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1302/2629] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:37:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:37:25.003523 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c7c25-f783-4465-8c6e-d8dda1d40a99 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:37:25.074917 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c7c25-f783-4465-8c6e-d8dda1d40a99 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:37:25.079960 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea78ed6b-4a1b-4965-96c2-0927f0cc51ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:37:25.080608 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea78ed6b-4a1b-4965-96c2-0927f0cc51ee admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:37:25.080895 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea78ed6b-4a1b-4965-96c2-0927f0cc51ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:37:25.081172 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea78ed6b-4a1b-4965-96c2-0927f0cc51ee admin admin] PATH_INFO: `/v3/projects` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:37:25.081828 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea78ed6b-4a1b-4965-96c2-0927f0cc51ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:37:25.083798 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea78ed6b-4a1b-4965-96c2-0927f0cc51ee admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:37:25.113106 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1328/2630] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:37:25 2022] POST /identity/v3/projects => generated 367 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:37:25.119133 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b6f7f8-2fea-421e-ac93-c61fd214ee3f None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:37:25.131215 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b6f7f8-2fea-421e-ac93-c61fd214ee3f None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:37:25.192393 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789842e8-59e3-4326-b64b-18eadd3e334a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:37:25.193010 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789842e8-59e3-4326-b64b-18eadd3e334a admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:37:25.193400 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789842e8-59e3-4326-b64b-18eadd3e334a admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:37:25.193709 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789842e8-59e3-4326-b64b-18eadd3e334a admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:37:25.194504 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789842e8-59e3-4326-b64b-18eadd3e334a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:37:25.196762 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789842e8-59e3-4326-b64b-18eadd3e334a admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:37:25.218716 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1303/2631] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:37:25 2022] POST /identity/v3/users => generated 290 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:37:25.222978 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea78ed6b-4a1b-4965-96c2-0927f0cc51ee admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:37:25.235376 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea78ed6b-4a1b-4965-96c2-0927f0cc51ee admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:37:25.240331 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71eac2a-a01a-488a-8b0c-9d284e4195f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:37:25.240945 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71eac2a-a01a-488a-8b0c-9d284e4195f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:37:25.241277 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71eac2a-a01a-488a-8b0c-9d284e4195f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:37:25.241477 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71eac2a-a01a-488a-8b0c-9d284e4195f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:37:25.242117 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71eac2a-a01a-488a-8b0c-9d284e4195f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:37:25.243751 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71eac2a-a01a-488a-8b0c-9d284e4195f4 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:37:25.256900 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1329/2632] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:37:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:37:25.261755 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789842e8-59e3-4326-b64b-18eadd3e334a admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:37:25.271839 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789842e8-59e3-4326-b64b-18eadd3e334a admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:37:25.277186 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52386a75-e3bd-4a1d-84f7-3aaa6ec8314b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:37:25.277841 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52386a75-e3bd-4a1d-84f7-3aaa6ec8314b admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:37:25.278118 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52386a75-e3bd-4a1d-84f7-3aaa6ec8314b admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:37:25.278387 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52386a75-e3bd-4a1d-84f7-3aaa6ec8314b admin admin] PATH_INFO: `/v3/projects/b90ef95652ac4711b1c5d7a38b02900a/users/87c942a5f3b942e792354486152d3ab1/roles/a332ef951db949b0bad7019fbd28a1b9` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:37:25.296881 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52386a75-e3bd-4a1d-84f7-3aaa6ec8314b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b90ef95652ac4711b1c5d7a38b02900a, user_id=87c942a5f3b942e792354486152d3ab1, role_id=a332ef951db949b0bad7019fbd28a1b9)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:37:25.299777 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52386a75-e3bd-4a1d-84f7-3aaa6ec8314b admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:37:25.313829 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1304/2633] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:37:25 2022] PUT /identity/v3/projects/b90ef95652ac4711b1c5d7a38b02900a/users/87c942a5f3b942e792354486152d3ab1/roles/a332ef951db949b0bad7019fbd28a1b9 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:37:25.317787 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71eac2a-a01a-488a-8b0c-9d284e4195f4 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:37:25.328424 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71eac2a-a01a-488a-8b0c-9d284e4195f4 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:37:25.349505 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:37:25.396600 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de2bb5e-64da-4f9f-a018-c0ec20ab035c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:37:25.397149 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de2bb5e-64da-4f9f-a018-c0ec20ab035c admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:37:25.397426 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de2bb5e-64da-4f9f-a018-c0ec20ab035c admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:37:25.397694 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de2bb5e-64da-4f9f-a018-c0ec20ab035c admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:37:25.398336 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de2bb5e-64da-4f9f-a018-c0ec20ab035c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:37:25.400011 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de2bb5e-64da-4f9f-a018-c0ec20ab035c admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:37:25.411497 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1330/2634] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:37:25 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:37:25.417217 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52386a75-e3bd-4a1d-84f7-3aaa6ec8314b admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:37:25.428487 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52386a75-e3bd-4a1d-84f7-3aaa6ec8314b admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:37:25.433257 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b87ffe2-7d79-4cc4-a1d5-196e0c6a51c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:37:25.433914 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b87ffe2-7d79-4cc4-a1d5-196e0c6a51c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:37:25.434189 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b87ffe2-7d79-4cc4-a1d5-196e0c6a51c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:37:25.434458 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b87ffe2-7d79-4cc4-a1d5-196e0c6a51c6 admin admin] PATH_INFO: `/v3/projects/b90ef95652ac4711b1c5d7a38b02900a/users/87c942a5f3b942e792354486152d3ab1/roles/a332ef951db949b0bad7019fbd28a1b9` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:37:25.436390 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b87ffe2-7d79-4cc4-a1d5-196e0c6a51c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b90ef95652ac4711b1c5d7a38b02900a, user_id=87c942a5f3b942e792354486152d3ab1, role_id=a332ef951db949b0bad7019fbd28a1b9)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:37:25.439020 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b87ffe2-7d79-4cc4-a1d5-196e0c6a51c6 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:37:25.451190 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1305/2635] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:37:25 2022] PUT /identity/v3/projects/b90ef95652ac4711b1c5d7a38b02900a/users/87c942a5f3b942e792354486152d3ab1/roles/a332ef951db949b0bad7019fbd28a1b9 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:37:25.461913 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf9e297-fd72-472f-a802-742ce3edf4af None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:37:25.462241 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf9e297-fd72-472f-a802-742ce3edf4af None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:37:25.462666 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf9e297-fd72-472f-a802-742ce3edf4af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:37:25.493128 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-9bf9e297-fd72-472f-a802-742ce3edf4af None None] MFA Rules not processed for user `87c942a5f3b942e792354486152d3ab1`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:37:25.494479 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-9bf9e297-fd72-472f-a802-742ce3edf4af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:37:25.567126 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1331/2636] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:37:25 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:37:25.578213 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b87ffe2-7d79-4cc4-a1d5-196e0c6a51c6 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:37:25.579990 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-3b87ffe2-7d79-4cc4-a1d5-196e0c6a51c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:37:25.629315 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:37:25.642394 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b87ffe2-7d79-4cc4-a1d5-196e0c6a51c6 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:37:25.646008 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae42175-02cf-4d54-afdd-4dd49a0118e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e79503178ac54e62ba385467d5617ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:37:25.646773 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae42175-02cf-4d54-afdd-4dd49a0118e3 service cinder] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:37:25.647085 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae42175-02cf-4d54-afdd-4dd49a0118e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:37:25.647357 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae42175-02cf-4d54-afdd-4dd49a0118e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:37:25.658335 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae42175-02cf-4d54-afdd-4dd49a0118e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:37:25.659812 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae42175-02cf-4d54-afdd-4dd49a0118e3 service cinder] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:37:25.670587 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1306/2637] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:37:25 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:37:25.718380 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf9e297-fd72-472f-a802-742ce3edf4af None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:37:25.719839 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-9bf9e297-fd72-472f-a802-742ce3edf4af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:37:25.733545 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf9e297-fd72-472f-a802-742ce3edf4af None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:37:25.738135 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9889c0-dd79-4d48-8792-aca547fa1313 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e79503178ac54e62ba385467d5617ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:37:25.738761 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9889c0-dd79-4d48-8792-aca547fa1313 service cinder] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:37:25.739137 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9889c0-dd79-4d48-8792-aca547fa1313 service cinder] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:37:25.739447 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9889c0-dd79-4d48-8792-aca547fa1313 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:37:25.798925 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9889c0-dd79-4d48-8792-aca547fa1313 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:37:25.800559 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9889c0-dd79-4d48-8792-aca547fa1313 service cinder] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:37:25.810380 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1332/2638] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:37:25 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:37:29.297532 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae42175-02cf-4d54-afdd-4dd49a0118e3 service cinder] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:37:29.408106 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae42175-02cf-4d54-afdd-4dd49a0118e3 service cinder] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:37:29.413195 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f38063d-c066-4773-9f8e-12cecd978998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:37:29.413997 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f38063d-c066-4773-9f8e-12cecd978998 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:37:29.414388 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f38063d-c066-4773-9f8e-12cecd978998 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:37:29.414769 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f38063d-c066-4773-9f8e-12cecd978998 admin admin] PATH_INFO: `/v3/users/c70f2d59df0c488bac06c996dd121911` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:37:29.416862 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f38063d-c066-4773-9f8e-12cecd978998 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c70f2d59df0c488bac06c996dd121911)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:37:29.419110 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f38063d-c066-4773-9f8e-12cecd978998 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:37:29.492022 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-3f38063d-c066-4773-9f8e-12cecd978998 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c70f2d59df0c488bac06c996dd121911'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:37:29.513955 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-3f38063d-c066-4773-9f8e-12cecd978998 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c70f2d59df0c488bac06c996dd121911'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:37:29.515112 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-3f38063d-c066-4773-9f8e-12cecd978998 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c70f2d59df0c488bac06c996dd121911'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:37:29.526253 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-3f38063d-c066-4773-9f8e-12cecd978998 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c70f2d59df0c488bac06c996dd121911'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:37:29.527446 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-3f38063d-c066-4773-9f8e-12cecd978998 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c70f2d59df0c488bac06c996dd121911'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:37:29.551047 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1307/2639] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:37:29 2022] DELETE /identity/v3/users/c70f2d59df0c488bac06c996dd121911 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:37:29.554685 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2bc5e0-3574-4d2d-a363-3c310ac27a36 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:37:29.555476 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2bc5e0-3574-4d2d-a363-3c310ac27a36 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:37:29.555476 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2bc5e0-3574-4d2d-a363-3c310ac27a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:37:29.580891 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-8f2bc5e0-3574-4d2d-a363-3c310ac27a36 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:37:29.582502 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-8f2bc5e0-3574-4d2d-a363-3c310ac27a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:37:29.644776 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:37:29.672668 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1333/2640] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:37:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:37:29.683973 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f38063d-c066-4773-9f8e-12cecd978998 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:37:29.685717 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-3f38063d-c066-4773-9f8e-12cecd978998 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:37:29.762096 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f38063d-c066-4773-9f8e-12cecd978998 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:37:29.765946 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb45636-e19d-4f6d-82de-9b8d6dbbfb81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:37:29.766599 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb45636-e19d-4f6d-82de-9b8d6dbbfb81 service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:37:29.767048 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb45636-e19d-4f6d-82de-9b8d6dbbfb81 service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:37:29.767318 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb45636-e19d-4f6d-82de-9b8d6dbbfb81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:37:29.778480 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb45636-e19d-4f6d-82de-9b8d6dbbfb81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:37:29.779988 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb45636-e19d-4f6d-82de-9b8d6dbbfb81 service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:37:29.790155 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1308/2641] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:37:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:37:30.146795 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2bc5e0-3574-4d2d-a363-3c310ac27a36 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:37:30.149096 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-8f2bc5e0-3574-4d2d-a363-3c310ac27a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:37:30.172896 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2bc5e0-3574-4d2d-a363-3c310ac27a36 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:37:30.188356 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7132fee4-210a-45b1-8224-43349a1a56a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:37:30.189049 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7132fee4-210a-45b1-8224-43349a1a56a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:37:30.189337 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7132fee4-210a-45b1-8224-43349a1a56a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:37:30.189609 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7132fee4-210a-45b1-8224-43349a1a56a9 admin admin] PATH_INFO: `/v3/projects/8b1cb0d4aebe48d585707f32c857e404` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:37:30.190911 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7132fee4-210a-45b1-8224-43349a1a56a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b1cb0d4aebe48d585707f32c857e404)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:37:30.192920 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7132fee4-210a-45b1-8224-43349a1a56a9 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:37:30.248393 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-7132fee4-210a-45b1-8224-43349a1a56a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b1cb0d4aebe48d585707f32c857e404', 'request_id': 'req-7132fee4-210a-45b1-8224-43349a1a56a9'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:37:30.256359 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-7132fee4-210a-45b1-8224-43349a1a56a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b1cb0d4aebe48d585707f32c857e404', 'request_id': 'req-7132fee4-210a-45b1-8224-43349a1a56a9'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:37:30.263702 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-7132fee4-210a-45b1-8224-43349a1a56a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b1cb0d4aebe48d585707f32c857e404', 'request_id': 'req-7132fee4-210a-45b1-8224-43349a1a56a9'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:37:30.277935 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-7132fee4-210a-45b1-8224-43349a1a56a9 admin admin] The token cache is being invalidate because project 8b1cb0d4aebe48d585707f32c857e404 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:37:30.278496 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-7132fee4-210a-45b1-8224-43349a1a56a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:37:30.279224 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-7132fee4-210a-45b1-8224-43349a1a56a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:37:30.280730 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1334/2642] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:37:30 2022] DELETE /identity/v3/projects/8b1cb0d4aebe48d585707f32c857e404 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:37:30.284918 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb45636-e19d-4f6d-82de-9b8d6dbbfb81 service neutron] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:37:30.297093 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb45636-e19d-4f6d-82de-9b8d6dbbfb81 service neutron] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:37:30.303351 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:37:30.372202 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf0000-df99-4e19-86ac-d53ffea3c41e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:37:30.372938 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf0000-df99-4e19-86ac-d53ffea3c41e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:37:30.373380 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf0000-df99-4e19-86ac-d53ffea3c41e admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:37:30.373749 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf0000-df99-4e19-86ac-d53ffea3c41e admin admin] PATH_INFO: `/v3/users/87c942a5f3b942e792354486152d3ab1` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:37:30.375063 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cf0000-df99-4e19-86ac-d53ffea3c41e admin admin] RBAC: Authorizing `identity:delete_user(user_id=87c942a5f3b942e792354486152d3ab1)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:37:30.377226 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cf0000-df99-4e19-86ac-d53ffea3c41e admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:37:30.467876 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-50cf0000-df99-4e19-86ac-d53ffea3c41e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87c942a5f3b942e792354486152d3ab1'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:37:30.485255 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-50cf0000-df99-4e19-86ac-d53ffea3c41e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87c942a5f3b942e792354486152d3ab1'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:37:30.486199 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-50cf0000-df99-4e19-86ac-d53ffea3c41e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87c942a5f3b942e792354486152d3ab1'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:37:30.499686 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-50cf0000-df99-4e19-86ac-d53ffea3c41e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87c942a5f3b942e792354486152d3ab1'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:37:30.500565 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-50cf0000-df99-4e19-86ac-d53ffea3c41e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87c942a5f3b942e792354486152d3ab1'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:37:30.525350 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1309/2643] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:37:30 2022] DELETE /identity/v3/users/87c942a5f3b942e792354486152d3ab1 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:37:30.872755 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7132fee4-210a-45b1-8224-43349a1a56a9 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:37:30.875696 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-7132fee4-210a-45b1-8224-43349a1a56a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:37:30.996472 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7132fee4-210a-45b1-8224-43349a1a56a9 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:37:31.070399 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d444fec2-3aa6-4be0-9a5f-aaf10c3acf66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:37:31.071199 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d444fec2-3aa6-4be0-9a5f-aaf10c3acf66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:37:31.071572 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d444fec2-3aa6-4be0-9a5f-aaf10c3acf66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:37:31.072619 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d444fec2-3aa6-4be0-9a5f-aaf10c3acf66 admin admin] PATH_INFO: `/v3/projects/b90ef95652ac4711b1c5d7a38b02900a` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:37:31.074267 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d444fec2-3aa6-4be0-9a5f-aaf10c3acf66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b90ef95652ac4711b1c5d7a38b02900a)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:37:31.077275 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d444fec2-3aa6-4be0-9a5f-aaf10c3acf66 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:37:31.086176 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:37:31.144707 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-d444fec2-3aa6-4be0-9a5f-aaf10c3acf66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b90ef95652ac4711b1c5d7a38b02900a', 'request_id': 'req-d444fec2-3aa6-4be0-9a5f-aaf10c3acf66'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:37:31.155395 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-d444fec2-3aa6-4be0-9a5f-aaf10c3acf66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b90ef95652ac4711b1c5d7a38b02900a', 'request_id': 'req-d444fec2-3aa6-4be0-9a5f-aaf10c3acf66'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:37:31.164256 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-d444fec2-3aa6-4be0-9a5f-aaf10c3acf66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b90ef95652ac4711b1c5d7a38b02900a', 'request_id': 'req-d444fec2-3aa6-4be0-9a5f-aaf10c3acf66'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:37:31.180148 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-d444fec2-3aa6-4be0-9a5f-aaf10c3acf66 admin admin] The token cache is being invalidate because project b90ef95652ac4711b1c5d7a38b02900a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:37:31.180522 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-d444fec2-3aa6-4be0-9a5f-aaf10c3acf66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:37:31.181257 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-d444fec2-3aa6-4be0-9a5f-aaf10c3acf66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:37:31.184647 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1335/2644] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:37:30 2022] DELETE /identity/v3/projects/b90ef95652ac4711b1c5d7a38b02900a => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:37:31.193186 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf30b22-608b-4676-9cca-3fc1d0735ffe None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:37:31.193512 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf30b22-608b-4676-9cca-3fc1d0735ffe None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:37:31.194023 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf30b22-608b-4676-9cca-3fc1d0735ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:37:31.274717 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-baf30b22-608b-4676-9cca-3fc1d0735ffe None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:37:31.276993 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-baf30b22-608b-4676-9cca-3fc1d0735ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:37:31.344459 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:37:31.361577 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1310/2645] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:37:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:37:31.370766 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17334503-4f70-41af-a0b9-5d868bdbbbe6 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:37:31.371093 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17334503-4f70-41af-a0b9-5d868bdbbbe6 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:37:31.371260 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17334503-4f70-41af-a0b9-5d868bdbbbe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:37:31.399816 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-17334503-4f70-41af-a0b9-5d868bdbbbe6 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:37:31.401665 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-17334503-4f70-41af-a0b9-5d868bdbbbe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:37:31.417708 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1336/2646] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:37:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:37:31.425572 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf30b22-608b-4676-9cca-3fc1d0735ffe None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:37:31.453938 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf30b22-608b-4676-9cca-3fc1d0735ffe None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:37:31.461261 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9167411-04d9-4e71-b077-ef8776f87c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:37:31.462087 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9167411-04d9-4e71-b077-ef8776f87c2a admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:37:31.462478 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9167411-04d9-4e71-b077-ef8776f87c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:37:31.462722 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9167411-04d9-4e71-b077-ef8776f87c2a admin admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:37:31.463714 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9167411-04d9-4e71-b077-ef8776f87c2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:37:31.464017 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9167411-04d9-4e71-b077-ef8776f87c2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:37:31.465707 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9167411-04d9-4e71-b077-ef8776f87c2a admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:37:31.486069 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1311/2647] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 12:37:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:37:31.486958 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17334503-4f70-41af-a0b9-5d868bdbbbe6 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:37:31.498555 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17334503-4f70-41af-a0b9-5d868bdbbbe6 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:37:31.504052 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b338c85-c903-4113-a2ec-adf94c8fe19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:37:31.504659 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b338c85-c903-4113-a2ec-adf94c8fe19e admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:37:31.504942 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b338c85-c903-4113-a2ec-adf94c8fe19e admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:37:31.505210 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b338c85-c903-4113-a2ec-adf94c8fe19e admin admin] PATH_INFO: `/v3/projects` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:37:31.505856 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b338c85-c903-4113-a2ec-adf94c8fe19e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:37:31.508028 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b338c85-c903-4113-a2ec-adf94c8fe19e admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:37:31.541065 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1337/2648] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:37:31 2022] POST /identity/v3/projects => generated 365 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:37:31.545792 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9167411-04d9-4e71-b077-ef8776f87c2a admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:37:31.557006 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9167411-04d9-4e71-b077-ef8776f87c2a admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:37:31.619981 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd54bb08-02aa-48c3-8424-d849e4e13fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:37:31.620596 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd54bb08-02aa-48c3-8424-d849e4e13fb3 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:37:31.620927 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd54bb08-02aa-48c3-8424-d849e4e13fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:37:31.621143 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd54bb08-02aa-48c3-8424-d849e4e13fb3 admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:37:31.621787 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd54bb08-02aa-48c3-8424-d849e4e13fb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:37:31.623740 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd54bb08-02aa-48c3-8424-d849e4e13fb3 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:37:31.646015 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1312/2649] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:37:31 2022] POST /identity/v3/users => generated 283 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:37:31.650133 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b338c85-c903-4113-a2ec-adf94c8fe19e admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:37:31.660872 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b338c85-c903-4113-a2ec-adf94c8fe19e admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:37:31.665744 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3834895f-3fad-46c3-ba75-2379f3d79f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:37:31.666375 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3834895f-3fad-46c3-ba75-2379f3d79f72 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:37:31.666648 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3834895f-3fad-46c3-ba75-2379f3d79f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:37:31.666952 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3834895f-3fad-46c3-ba75-2379f3d79f72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:37:31.667619 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3834895f-3fad-46c3-ba75-2379f3d79f72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:37:31.669224 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3834895f-3fad-46c3-ba75-2379f3d79f72 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:37:31.680305 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1338/2650] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:37:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:37:31.685839 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd54bb08-02aa-48c3-8424-d849e4e13fb3 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:37:31.696837 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd54bb08-02aa-48c3-8424-d849e4e13fb3 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:37:31.702307 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4585e93b-a872-41ba-a936-3bb2912ea3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:37:31.702973 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4585e93b-a872-41ba-a936-3bb2912ea3aa admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:37:31.703232 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4585e93b-a872-41ba-a936-3bb2912ea3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:37:31.703503 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4585e93b-a872-41ba-a936-3bb2912ea3aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:37:31.704150 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4585e93b-a872-41ba-a936-3bb2912ea3aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:37:31.705754 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4585e93b-a872-41ba-a936-3bb2912ea3aa admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:37:31.717023 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1313/2651] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:37:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:37:31.721280 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3834895f-3fad-46c3-ba75-2379f3d79f72 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:37:31.732402 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3834895f-3fad-46c3-ba75-2379f3d79f72 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:37:31.737153 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56c7144-3eaa-4eba-acb3-cdc812c6b1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:37:31.737914 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56c7144-3eaa-4eba-acb3-cdc812c6b1a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:37:31.738099 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56c7144-3eaa-4eba-acb3-cdc812c6b1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:37:31.738366 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56c7144-3eaa-4eba-acb3-cdc812c6b1a9 admin admin] PATH_INFO: `/v3/projects/c001c34c9b604640ab7880171faa8c3a/users/b03c062926ab4b108608486c8961c328/roles/b5cfd7a855a448359e9017f51d32b6fc` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:37:31.886701 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56c7144-3eaa-4eba-acb3-cdc812c6b1a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c001c34c9b604640ab7880171faa8c3a, user_id=b03c062926ab4b108608486c8961c328, role_id=b5cfd7a855a448359e9017f51d32b6fc)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:37:31.889836 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56c7144-3eaa-4eba-acb3-cdc812c6b1a9 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:37:31.907362 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1339/2652] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:37:31 2022] PUT /identity/v3/projects/c001c34c9b604640ab7880171faa8c3a/users/b03c062926ab4b108608486c8961c328/roles/b5cfd7a855a448359e9017f51d32b6fc => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:37:31.923537 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa164ce-7007-4c09-97db-d0c9fabd8bbd None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:37:31.924009 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa164ce-7007-4c09-97db-d0c9fabd8bbd None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:37:31.924495 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa164ce-7007-4c09-97db-d0c9fabd8bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:37:31.974506 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-3fa164ce-7007-4c09-97db-d0c9fabd8bbd None None] MFA Rules not processed for user `b03c062926ab4b108608486c8961c328`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:37:31.976581 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-3fa164ce-7007-4c09-97db-d0c9fabd8bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:37:32.054595 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1314/2653] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:37:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:37:32.059924 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56c7144-3eaa-4eba-acb3-cdc812c6b1a9 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:37:32.127016 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56c7144-3eaa-4eba-acb3-cdc812c6b1a9 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:37:32.131882 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e98a98-dc17-432f-82d4-80dfb00229ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:37:32.132544 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e98a98-dc17-432f-82d4-80dfb00229ed admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:37:32.132878 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e98a98-dc17-432f-82d4-80dfb00229ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:37:32.133166 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e98a98-dc17-432f-82d4-80dfb00229ed admin admin] PATH_INFO: `/v3/projects` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:37:32.133822 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e98a98-dc17-432f-82d4-80dfb00229ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:37:32.136041 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e98a98-dc17-432f-82d4-80dfb00229ed admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:37:32.164546 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1340/2654] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:37:32 2022] POST /identity/v3/projects => generated 367 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:37:32.169056 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa164ce-7007-4c09-97db-d0c9fabd8bbd None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:37:32.180310 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa164ce-7007-4c09-97db-d0c9fabd8bbd None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:37:32.234945 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:37:32.252872 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c18adaa-cf47-4909-ab1e-b711453a6e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:37:32.253636 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c18adaa-cf47-4909-ab1e-b711453a6e72 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:37:32.253983 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c18adaa-cf47-4909-ab1e-b711453a6e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:37:32.254257 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c18adaa-cf47-4909-ab1e-b711453a6e72 admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:37:32.255149 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c18adaa-cf47-4909-ab1e-b711453a6e72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:37:32.256886 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c18adaa-cf47-4909-ab1e-b711453a6e72 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:37:32.282621 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1315/2655] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:37:32 2022] POST /identity/v3/users => generated 290 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:37:32.287450 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e98a98-dc17-432f-82d4-80dfb00229ed admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:37:32.302505 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e98a98-dc17-432f-82d4-80dfb00229ed admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:37:32.308900 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16952c87-63b3-42cc-a0c1-5310c87afc76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:37:32.309530 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16952c87-63b3-42cc-a0c1-5310c87afc76 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:37:32.309813 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16952c87-63b3-42cc-a0c1-5310c87afc76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:37:32.310086 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16952c87-63b3-42cc-a0c1-5310c87afc76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:37:32.310809 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16952c87-63b3-42cc-a0c1-5310c87afc76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:37:32.312601 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16952c87-63b3-42cc-a0c1-5310c87afc76 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:37:32.324819 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1341/2656] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:37:32 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:37:32.334369 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c18adaa-cf47-4909-ab1e-b711453a6e72 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:37:32.345442 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c18adaa-cf47-4909-ab1e-b711453a6e72 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:37:32.350186 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13181e2-e95d-45d2-a6d0-14ba55a6ba29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:37:32.350885 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13181e2-e95d-45d2-a6d0-14ba55a6ba29 admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:37:32.351156 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13181e2-e95d-45d2-a6d0-14ba55a6ba29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:37:32.351427 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13181e2-e95d-45d2-a6d0-14ba55a6ba29 admin admin] PATH_INFO: `/v3/projects/a6195ca39252498887f1456a16dd398d/users/5968ca8bc49a4f11b810e679baf03649/roles/a332ef951db949b0bad7019fbd28a1b9` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:37:32.368218 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13181e2-e95d-45d2-a6d0-14ba55a6ba29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6195ca39252498887f1456a16dd398d, user_id=5968ca8bc49a4f11b810e679baf03649, role_id=a332ef951db949b0bad7019fbd28a1b9)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:37:32.371563 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13181e2-e95d-45d2-a6d0-14ba55a6ba29 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:37:32.387108 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1316/2657] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:37:32 2022] PUT /identity/v3/projects/a6195ca39252498887f1456a16dd398d/users/5968ca8bc49a4f11b810e679baf03649/roles/a332ef951db949b0bad7019fbd28a1b9 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:37:32.391416 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16952c87-63b3-42cc-a0c1-5310c87afc76 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:37:32.407207 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16952c87-63b3-42cc-a0c1-5310c87afc76 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:37:32.411186 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:37:32.469415 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460f68a6-5f48-4492-b6e3-0111e1f0b20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:37:32.470034 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f68a6-5f48-4492-b6e3-0111e1f0b20f admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:37:32.470310 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f68a6-5f48-4492-b6e3-0111e1f0b20f admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:37:32.470582 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f68a6-5f48-4492-b6e3-0111e1f0b20f admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:37:32.471326 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460f68a6-5f48-4492-b6e3-0111e1f0b20f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:37:32.472956 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460f68a6-5f48-4492-b6e3-0111e1f0b20f admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:37:32.484798 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1342/2658] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:37:32 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:37:32.490419 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13181e2-e95d-45d2-a6d0-14ba55a6ba29 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:37:32.505644 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13181e2-e95d-45d2-a6d0-14ba55a6ba29 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:37:32.511597 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d348ac9f-6e39-405c-810b-28658665639b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:37:32.512264 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d348ac9f-6e39-405c-810b-28658665639b admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:37:32.512549 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d348ac9f-6e39-405c-810b-28658665639b admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:37:32.512819 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d348ac9f-6e39-405c-810b-28658665639b admin admin] PATH_INFO: `/v3/projects/a6195ca39252498887f1456a16dd398d/users/5968ca8bc49a4f11b810e679baf03649/roles/a332ef951db949b0bad7019fbd28a1b9` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:37:32.514822 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d348ac9f-6e39-405c-810b-28658665639b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6195ca39252498887f1456a16dd398d, user_id=5968ca8bc49a4f11b810e679baf03649, role_id=a332ef951db949b0bad7019fbd28a1b9)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:37:32.517491 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d348ac9f-6e39-405c-810b-28658665639b admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:37:32.529396 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1317/2659] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:37:32 2022] PUT /identity/v3/projects/a6195ca39252498887f1456a16dd398d/users/5968ca8bc49a4f11b810e679baf03649/roles/a332ef951db949b0bad7019fbd28a1b9 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:37:32.540337 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ddf086-1599-4351-8232-55fa447f57e9 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:37:32.540703 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ddf086-1599-4351-8232-55fa447f57e9 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:37:32.541631 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ddf086-1599-4351-8232-55fa447f57e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:37:32.573783 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-06ddf086-1599-4351-8232-55fa447f57e9 None None] MFA Rules not processed for user `5968ca8bc49a4f11b810e679baf03649`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:37:32.575048 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-06ddf086-1599-4351-8232-55fa447f57e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:37:32.654081 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1343/2660] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:37:32 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:37:32.666991 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d348ac9f-6e39-405c-810b-28658665639b admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:37:32.668706 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-d348ac9f-6e39-405c-810b-28658665639b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:37:32.766045 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d348ac9f-6e39-405c-810b-28658665639b admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:37:32.771366 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d931fdb6-2452-43d5-8070-68abb44472ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e79503178ac54e62ba385467d5617ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:37:32.771975 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d931fdb6-2452-43d5-8070-68abb44472ec service cinder] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:37:32.772362 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d931fdb6-2452-43d5-8070-68abb44472ec service cinder] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:37:32.772681 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d931fdb6-2452-43d5-8070-68abb44472ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:37:32.785067 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d931fdb6-2452-43d5-8070-68abb44472ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:37:32.786561 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d931fdb6-2452-43d5-8070-68abb44472ec service cinder] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:37:32.797712 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1318/2661] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:37:32 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:37:32.917973 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ddf086-1599-4351-8232-55fa447f57e9 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:37:32.928703 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ddf086-1599-4351-8232-55fa447f57e9 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:37:32.933343 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1675ba-66be-42c3-a450-0a99907a03cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e79503178ac54e62ba385467d5617ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:37:32.933978 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1675ba-66be-42c3-a450-0a99907a03cd service cinder] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:37:32.934245 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1675ba-66be-42c3-a450-0a99907a03cd service cinder] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:37:32.934512 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1675ba-66be-42c3-a450-0a99907a03cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:37:33.005497 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1675ba-66be-42c3-a450-0a99907a03cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:37:33.006878 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1675ba-66be-42c3-a450-0a99907a03cd service cinder] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:37:33.017381 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1344/2662] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:37:32 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:37:38.669953 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d931fdb6-2452-43d5-8070-68abb44472ec service cinder] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:37:38.769809 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d931fdb6-2452-43d5-8070-68abb44472ec service cinder] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:37:38.776855 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f428e5c-e303-48ca-a4a7-aa3e3bb70310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:37:38.777755 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f428e5c-e303-48ca-a4a7-aa3e3bb70310 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:37:38.778208 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f428e5c-e303-48ca-a4a7-aa3e3bb70310 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:37:38.778677 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f428e5c-e303-48ca-a4a7-aa3e3bb70310 admin admin] PATH_INFO: `/v3/users/b03c062926ab4b108608486c8961c328` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:37:38.780432 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f428e5c-e303-48ca-a4a7-aa3e3bb70310 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b03c062926ab4b108608486c8961c328)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:37:38.782910 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f428e5c-e303-48ca-a4a7-aa3e3bb70310 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:37:38.837647 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:37:38.863240 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-0f428e5c-e303-48ca-a4a7-aa3e3bb70310 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b03c062926ab4b108608486c8961c328'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:37:38.886331 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-0f428e5c-e303-48ca-a4a7-aa3e3bb70310 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b03c062926ab4b108608486c8961c328'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:37:38.887504 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-0f428e5c-e303-48ca-a4a7-aa3e3bb70310 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b03c062926ab4b108608486c8961c328'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:37:38.902747 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-0f428e5c-e303-48ca-a4a7-aa3e3bb70310 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b03c062926ab4b108608486c8961c328'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:37:38.903981 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-0f428e5c-e303-48ca-a4a7-aa3e3bb70310 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b03c062926ab4b108608486c8961c328'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:37:38.928057 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1319/2663] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:37:38 2022] DELETE /identity/v3/users/b03c062926ab4b108608486c8961c328 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:37:38.934284 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56817270-0943-4870-b4a8-6229c29b6cb2 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:37:38.935219 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56817270-0943-4870-b4a8-6229c29b6cb2 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:37:38.935219 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56817270-0943-4870-b4a8-6229c29b6cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:37:38.964512 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-56817270-0943-4870-b4a8-6229c29b6cb2 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:37:38.967546 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-56817270-0943-4870-b4a8-6229c29b6cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:37:39.016007 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=100 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:37:39.073883 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1345/2664] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:37:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:37:39.084811 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f428e5c-e303-48ca-a4a7-aa3e3bb70310 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:37:39.087237 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-0f428e5c-e303-48ca-a4a7-aa3e3bb70310 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:37:39.202325 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f428e5c-e303-48ca-a4a7-aa3e3bb70310 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:37:39.206740 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa15ac-c40f-4d1d-ac01-344c13a96a63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:37:39.207405 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa15ac-c40f-4d1d-ac01-344c13a96a63 service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:37:39.207692 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa15ac-c40f-4d1d-ac01-344c13a96a63 service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:37:39.207965 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa15ac-c40f-4d1d-ac01-344c13a96a63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:37:39.222008 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aa15ac-c40f-4d1d-ac01-344c13a96a63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:37:39.223607 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aa15ac-c40f-4d1d-ac01-344c13a96a63 service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:37:39.239560 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1320/2665] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:37:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:37:39.745812 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56817270-0943-4870-b4a8-6229c29b6cb2 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:37:39.748957 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-56817270-0943-4870-b4a8-6229c29b6cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:37:39.768704 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56817270-0943-4870-b4a8-6229c29b6cb2 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:37:39.778345 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687d9667-595e-481a-8068-c34bdfb70e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:37:39.779067 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d9667-595e-481a-8068-c34bdfb70e0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:37:39.779366 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d9667-595e-481a-8068-c34bdfb70e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:37:39.779791 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d9667-595e-481a-8068-c34bdfb70e0f admin admin] PATH_INFO: `/v3/projects/c001c34c9b604640ab7880171faa8c3a` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:37:39.781143 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687d9667-595e-481a-8068-c34bdfb70e0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c001c34c9b604640ab7880171faa8c3a)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:37:39.783466 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687d9667-595e-481a-8068-c34bdfb70e0f admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:37:39.866959 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-687d9667-595e-481a-8068-c34bdfb70e0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c001c34c9b604640ab7880171faa8c3a', 'request_id': 'req-687d9667-595e-481a-8068-c34bdfb70e0f'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:37:39.879395 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-687d9667-595e-481a-8068-c34bdfb70e0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c001c34c9b604640ab7880171faa8c3a', 'request_id': 'req-687d9667-595e-481a-8068-c34bdfb70e0f'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:37:39.898621 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-687d9667-595e-481a-8068-c34bdfb70e0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c001c34c9b604640ab7880171faa8c3a', 'request_id': 'req-687d9667-595e-481a-8068-c34bdfb70e0f'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:37:39.924939 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-687d9667-595e-481a-8068-c34bdfb70e0f admin admin] The token cache is being invalidate because project c001c34c9b604640ab7880171faa8c3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:37:39.925455 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-687d9667-595e-481a-8068-c34bdfb70e0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:37:39.926744 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-687d9667-595e-481a-8068-c34bdfb70e0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:37:39.933727 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1346/2666] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:37:39 2022] DELETE /identity/v3/projects/c001c34c9b604640ab7880171faa8c3a => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:37:39.935701 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa15ac-c40f-4d1d-ac01-344c13a96a63 service neutron] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:37:39.950702 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa15ac-c40f-4d1d-ac01-344c13a96a63 service neutron] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:37:40.049608 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1e338e-5252-446d-8a36-24934c2d9e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:37:40.050323 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1e338e-5252-446d-8a36-24934c2d9e10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:37:40.050608 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1e338e-5252-446d-8a36-24934c2d9e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:37:40.050919 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1e338e-5252-446d-8a36-24934c2d9e10 admin admin] PATH_INFO: `/v3/users/5968ca8bc49a4f11b810e679baf03649` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:37:40.052404 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1e338e-5252-446d-8a36-24934c2d9e10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5968ca8bc49a4f11b810e679baf03649)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:37:40.054359 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1e338e-5252-446d-8a36-24934c2d9e10 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:37:40.117273 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-6f1e338e-5252-446d-8a36-24934c2d9e10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5968ca8bc49a4f11b810e679baf03649'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:37:40.125232 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:37:40.134061 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-6f1e338e-5252-446d-8a36-24934c2d9e10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5968ca8bc49a4f11b810e679baf03649'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:37:40.135550 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-6f1e338e-5252-446d-8a36-24934c2d9e10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5968ca8bc49a4f11b810e679baf03649'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:37:40.144555 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-6f1e338e-5252-446d-8a36-24934c2d9e10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5968ca8bc49a4f11b810e679baf03649'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:37:40.145292 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-6f1e338e-5252-446d-8a36-24934c2d9e10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5968ca8bc49a4f11b810e679baf03649'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:37:40.162078 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1321/2667] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:37:39 2022] DELETE /identity/v3/users/5968ca8bc49a4f11b810e679baf03649 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:37:40.961652 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687d9667-595e-481a-8068-c34bdfb70e0f admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:37:40.964833 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-687d9667-595e-481a-8068-c34bdfb70e0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:37:41.032038 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d7d399-5f2c-4198-aeb3-de3edeeeabcb None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:37:41.032885 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d7d399-5f2c-4198-aeb3-de3edeeeabcb None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:37:41.032885 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d7d399-5f2c-4198-aeb3-de3edeeeabcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:37:41.043212 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687d9667-595e-481a-8068-c34bdfb70e0f admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:37:41.055276 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-c8d7d399-5f2c-4198-aeb3-de3edeeeabcb None None] MFA Rules not processed for user `d277532df42244c693b5e51e9fd0c459`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:37:41.056624 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-c8d7d399-5f2c-4198-aeb3-de3edeeeabcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:37:41.131035 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1322/2668] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:37:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:37:41.150078 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c058a2f-97a5-4b37-9a8b-ff6c98eec633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:37:41.152050 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c058a2f-97a5-4b37-9a8b-ff6c98eec633 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:37:41.152612 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c058a2f-97a5-4b37-9a8b-ff6c98eec633 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:37:41.153061 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c058a2f-97a5-4b37-9a8b-ff6c98eec633 admin admin] PATH_INFO: `/v3/projects/a6195ca39252498887f1456a16dd398d` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:37:41.155141 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c058a2f-97a5-4b37-9a8b-ff6c98eec633 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6195ca39252498887f1456a16dd398d)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:37:41.158592 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c058a2f-97a5-4b37-9a8b-ff6c98eec633 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:37:41.237631 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-0c058a2f-97a5-4b37-9a8b-ff6c98eec633 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6195ca39252498887f1456a16dd398d', 'request_id': 'req-0c058a2f-97a5-4b37-9a8b-ff6c98eec633'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:37:41.240884 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:37:41.255675 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-0c058a2f-97a5-4b37-9a8b-ff6c98eec633 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6195ca39252498887f1456a16dd398d', 'request_id': 'req-0c058a2f-97a5-4b37-9a8b-ff6c98eec633'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:37:41.270325 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-0c058a2f-97a5-4b37-9a8b-ff6c98eec633 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6195ca39252498887f1456a16dd398d', 'request_id': 'req-0c058a2f-97a5-4b37-9a8b-ff6c98eec633'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:37:41.292419 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-0c058a2f-97a5-4b37-9a8b-ff6c98eec633 admin admin] The token cache is being invalidate because project a6195ca39252498887f1456a16dd398d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:37:41.292943 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-0c058a2f-97a5-4b37-9a8b-ff6c98eec633 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:37:41.294076 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-0c058a2f-97a5-4b37-9a8b-ff6c98eec633 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:37:41.296756 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1347/2669] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:37:40 2022] DELETE /identity/v3/projects/a6195ca39252498887f1456a16dd398d => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:37:41.303814 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169dd398-9d3e-48af-b7f7-aa7b0e0b845a None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:37:41.304349 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169dd398-9d3e-48af-b7f7-aa7b0e0b845a None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:37:41.304768 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169dd398-9d3e-48af-b7f7-aa7b0e0b845a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:37:41.329856 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-169dd398-9d3e-48af-b7f7-aa7b0e0b845a None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:37:41.331172 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-169dd398-9d3e-48af-b7f7-aa7b0e0b845a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:37:41.429640 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1323/2670] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:37:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:37:41.448019 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a5cafa-5d42-491c-8245-e2226f7384a5 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:37:41.448332 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a5cafa-5d42-491c-8245-e2226f7384a5 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:37:41.448492 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a5cafa-5d42-491c-8245-e2226f7384a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:37:41.482814 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-e7a5cafa-5d42-491c-8245-e2226f7384a5 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:37:41.484685 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-e7a5cafa-5d42-491c-8245-e2226f7384a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:37:41.499907 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1348/2671] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:37:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:37:41.506368 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169dd398-9d3e-48af-b7f7-aa7b0e0b845a None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:37:41.523360 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169dd398-9d3e-48af-b7f7-aa7b0e0b845a None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:37:41.529428 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab27bd6c-71d0-4809-a43a-a86aad505e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:37:41.530075 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab27bd6c-71d0-4809-a43a-a86aad505e73 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:37:41.530347 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab27bd6c-71d0-4809-a43a-a86aad505e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:37:41.530611 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab27bd6c-71d0-4809-a43a-a86aad505e73 admin admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:37:41.531311 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab27bd6c-71d0-4809-a43a-a86aad505e73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:37:41.531713 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab27bd6c-71d0-4809-a43a-a86aad505e73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:37:41.535351 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab27bd6c-71d0-4809-a43a-a86aad505e73 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:37:41.552992 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1324/2672] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 12:37:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:37:41.558293 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a5cafa-5d42-491c-8245-e2226f7384a5 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:37:41.568438 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a5cafa-5d42-491c-8245-e2226f7384a5 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:37:41.579565 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d392cb18-594a-470a-bc77-d9424ede40c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:37:41.580211 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d392cb18-594a-470a-bc77-d9424ede40c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:37:41.580484 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d392cb18-594a-470a-bc77-d9424ede40c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:37:41.580748 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d392cb18-594a-470a-bc77-d9424ede40c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:37:41.581402 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d392cb18-594a-470a-bc77-d9424ede40c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:37:41.583375 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d392cb18-594a-470a-bc77-d9424ede40c1 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:37:41.622603 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1349/2673] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:37:41 2022] POST /identity/v3/projects => generated 371 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:37:41.629873 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab27bd6c-71d0-4809-a43a-a86aad505e73 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:37:41.648514 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab27bd6c-71d0-4809-a43a-a86aad505e73 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:37:41.745115 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b2bc1-6c33-4c27-8fcb-4e8768efa43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:37:41.746188 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b2bc1-6c33-4c27-8fcb-4e8768efa43a admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:37:41.746623 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b2bc1-6c33-4c27-8fcb-4e8768efa43a admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:37:41.747104 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b2bc1-6c33-4c27-8fcb-4e8768efa43a admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:37:41.747923 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719b2bc1-6c33-4c27-8fcb-4e8768efa43a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:37:41.751087 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719b2bc1-6c33-4c27-8fcb-4e8768efa43a admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:37:41.763872 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:37:41.785201 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1325/2674] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:37:41 2022] POST /identity/v3/users => generated 286 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:37:41.789794 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d392cb18-594a-470a-bc77-d9424ede40c1 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:37:41.809760 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d392cb18-594a-470a-bc77-d9424ede40c1 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:37:41.819462 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240c4474-1629-4945-9a32-b20311b8c5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:37:41.820541 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c4474-1629-4945-9a32-b20311b8c5c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:37:41.821039 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c4474-1629-4945-9a32-b20311b8c5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:37:41.821524 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c4474-1629-4945-9a32-b20311b8c5c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:37:41.823371 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240c4474-1629-4945-9a32-b20311b8c5c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:37:41.826532 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240c4474-1629-4945-9a32-b20311b8c5c9 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:37:41.851028 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1350/2675] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:37:41 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:37:41.853903 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b2bc1-6c33-4c27-8fcb-4e8768efa43a admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:37:41.866387 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b2bc1-6c33-4c27-8fcb-4e8768efa43a admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:37:41.872211 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d385d06b-d2de-4af6-a566-a47432677bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:37:41.872803 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d385d06b-d2de-4af6-a566-a47432677bcc admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:37:41.873104 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d385d06b-d2de-4af6-a566-a47432677bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:37:41.873337 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d385d06b-d2de-4af6-a566-a47432677bcc admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:37:41.874095 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d385d06b-d2de-4af6-a566-a47432677bcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:37:41.875689 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d385d06b-d2de-4af6-a566-a47432677bcc admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:37:41.892763 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1326/2676] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:37:41 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:37:41.894698 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240c4474-1629-4945-9a32-b20311b8c5c9 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:37:41.907970 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240c4474-1629-4945-9a32-b20311b8c5c9 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:37:41.913068 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9b193b-fbd0-4447-b72f-60ec7b0717db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:37:41.913939 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b193b-fbd0-4447-b72f-60ec7b0717db admin admin] REQUEST_METHOD: `PUT` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:37:41.914267 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b193b-fbd0-4447-b72f-60ec7b0717db admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:37:41.914478 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b193b-fbd0-4447-b72f-60ec7b0717db admin admin] PATH_INFO: `/v3/projects/c5c8e3638b084b768d8ba4b0202af99d/users/b4ca778b2f2f45c29cc99cbbe190d76a/roles/b5cfd7a855a448359e9017f51d32b6fc` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:37:41.935810 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9b193b-fbd0-4447-b72f-60ec7b0717db admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5c8e3638b084b768d8ba4b0202af99d, user_id=b4ca778b2f2f45c29cc99cbbe190d76a, role_id=b5cfd7a855a448359e9017f51d32b6fc)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:37:41.938471 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9b193b-fbd0-4447-b72f-60ec7b0717db admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:37:41.960771 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1351/2677] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:37:41 2022] PUT /identity/v3/projects/c5c8e3638b084b768d8ba4b0202af99d/users/b4ca778b2f2f45c29cc99cbbe190d76a/roles/b5cfd7a855a448359e9017f51d32b6fc => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:37:41.975586 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fef6c0-9cf2-419b-9a40-66e9b23bdd7d None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:37:41.976314 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fef6c0-9cf2-419b-9a40-66e9b23bdd7d None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:37:41.976671 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fef6c0-9cf2-419b-9a40-66e9b23bdd7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:37:42.010688 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-78fef6c0-9cf2-419b-9a40-66e9b23bdd7d None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:37:42.012796 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-78fef6c0-9cf2-419b-9a40-66e9b23bdd7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:37:42.135376 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1327/2678] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:37:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:37:42.152586 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9b193b-fbd0-4447-b72f-60ec7b0717db admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:37:42.154450 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-3e9b193b-fbd0-4447-b72f-60ec7b0717db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:37:42.273877 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9b193b-fbd0-4447-b72f-60ec7b0717db admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:37:42.281767 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef270594-240d-4fa8-8f76-8250febf838e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:37:42.282536 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef270594-240d-4fa8-8f76-8250febf838e service neutron] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:37:42.282978 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef270594-240d-4fa8-8f76-8250febf838e service neutron] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:37:42.283367 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef270594-240d-4fa8-8f76-8250febf838e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:37:42.299075 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef270594-240d-4fa8-8f76-8250febf838e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:37:42.301908 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef270594-240d-4fa8-8f76-8250febf838e service neutron] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:37:42.325093 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1352/2679] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:37:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:37:43.237322 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fef6c0-9cf2-419b-9a40-66e9b23bdd7d None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:37:43.242167 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-78fef6c0-9cf2-419b-9a40-66e9b23bdd7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:37:43.412919 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b86b5-6a1a-4057-a458-070a124d40e0 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:37:43.414454 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b86b5-6a1a-4057-a458-070a124d40e0 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:37:43.415285 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b86b5-6a1a-4057-a458-070a124d40e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:37:43.436025 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fef6c0-9cf2-419b-9a40-66e9b23bdd7d None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:37:43.448013 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7c2034-8081-4ba9-976b-48e8774bc22d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6deab40ae6244d4b9affa47b274aea3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:37:43.449143 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7c2034-8081-4ba9-976b-48e8774bc22d service placement] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:37:43.449143 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7c2034-8081-4ba9-976b-48e8774bc22d service placement] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:37:43.449143 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7c2034-8081-4ba9-976b-48e8774bc22d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:37:43.452929 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-2c7c2034-8081-4ba9-976b-48e8774bc22d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:37:43.468255 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7c2034-8081-4ba9-976b-48e8774bc22d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:37:43.470167 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7c2034-8081-4ba9-976b-48e8774bc22d service placement] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:37:43.480223 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-710b86b5-6a1a-4057-a458-070a124d40e0 None None] MFA Rules not processed for user `b4ca778b2f2f45c29cc99cbbe190d76a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:37:43.483369 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-710b86b5-6a1a-4057-a458-070a124d40e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:37:43.483600 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1328/2680] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:37:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:37:43.593055 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1353/2681] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:37:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:37:43.620135 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7c2034-8081-4ba9-976b-48e8774bc22d service placement] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:37:43.622253 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-2c7c2034-8081-4ba9-976b-48e8774bc22d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:37:43.772192 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7c2034-8081-4ba9-976b-48e8774bc22d service placement] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:37:43.780287 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6728086-d03d-46fb-9418-a3bf9709bfa2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e79503178ac54e62ba385467d5617ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:37:43.782653 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6728086-d03d-46fb-9418-a3bf9709bfa2 service cinder] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:37:43.783335 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6728086-d03d-46fb-9418-a3bf9709bfa2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:37:43.784210 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6728086-d03d-46fb-9418-a3bf9709bfa2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:37:43.797984 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:37:43.802220 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6728086-d03d-46fb-9418-a3bf9709bfa2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:37:43.807424 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6728086-d03d-46fb-9418-a3bf9709bfa2 service cinder] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:37:43.854896 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1329/2682] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:37:43 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:37:48.761284 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e534b-4a56-4f5a-aa60-d38993afeb03 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:37:48.762055 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e534b-4a56-4f5a-aa60-d38993afeb03 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:37:48.762321 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e534b-4a56-4f5a-aa60-d38993afeb03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:37:48.804040 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-0b7e534b-4a56-4f5a-aa60-d38993afeb03 None None] MFA Rules not processed for user `b4ca778b2f2f45c29cc99cbbe190d76a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:37:48.805882 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-0b7e534b-4a56-4f5a-aa60-d38993afeb03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:37:48.823631 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1354/2683] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:37:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:37:53.844051 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=2 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:37:58.390101 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6728086-d03d-46fb-9418-a3bf9709bfa2 service cinder] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:37:58.391682 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-a6728086-d03d-46fb-9418-a3bf9709bfa2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:37:58.430658 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6728086-d03d-46fb-9418-a3bf9709bfa2 service cinder] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:37:58.435318 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b6664d-f548-442d-9bf9-02d19a17cfcc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e79503178ac54e62ba385467d5617ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:37:58.435948 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b6664d-f548-442d-9bf9-02d19a17cfcc service cinder] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:37:58.436217 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b6664d-f548-442d-9bf9-02d19a17cfcc service cinder] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:37:58.436482 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b6664d-f548-442d-9bf9-02d19a17cfcc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:37:58.438357 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-07b6664d-f548-442d-9bf9-02d19a17cfcc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:37:58.505838 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b6664d-f548-442d-9bf9-02d19a17cfcc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:37:58.508525 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b6664d-f548-442d-9bf9-02d19a17cfcc service cinder] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:37:58.521738 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1330/2684] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:37:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:37:58.795522 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=2 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:38:06.785072 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa77970-0ff4-4a50-ad1d-d9a084942f47 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:38:06.785765 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa77970-0ff4-4a50-ad1d-d9a084942f47 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:38:06.785860 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa77970-0ff4-4a50-ad1d-d9a084942f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:38:06.825995 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-6fa77970-0ff4-4a50-ad1d-d9a084942f47 None None] MFA Rules not processed for user `2e77671c123f434489d82da79212d0ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:38:06.827673 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-6fa77970-0ff4-4a50-ad1d-d9a084942f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:38:06.839483 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1355/2685] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:38:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:38:08.515109 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=37 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:38:12.350044 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3791b7e3-8e25-4731-92bf-c76a2f58e7cd None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:38:12.351075 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3791b7e3-8e25-4731-92bf-c76a2f58e7cd None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:38:12.351833 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3791b7e3-8e25-4731-92bf-c76a2f58e7cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:38:12.372295 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-3791b7e3-8e25-4731-92bf-c76a2f58e7cd None None] MFA Rules not processed for user `b4ca778b2f2f45c29cc99cbbe190d76a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:38:12.373451 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-3791b7e3-8e25-4731-92bf-c76a2f58e7cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:38:12.381140 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1331/2686] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:38:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:38:16.806247 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=3 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:38:22.365639 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=3 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:38:23.170762 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb702e-b584-4cf8-946c-9282d53412fe None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:38:23.171395 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb702e-b584-4cf8-946c-9282d53412fe None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:38:23.171395 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb702e-b584-4cf8-946c-9282d53412fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:38:23.191855 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-07cb702e-b584-4cf8-946c-9282d53412fe None None] MFA Rules not processed for user `c4fb81a9221d435a8d9e38ab138cad4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:38:23.193432 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-07cb702e-b584-4cf8-946c-9282d53412fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:38:23.280536 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1356/2687] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:38:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:38:30.937547 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3791b7e3-8e25-4731-92bf-c76a2f58e7cd None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:38:30.960028 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3791b7e3-8e25-4731-92bf-c76a2f58e7cd None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:38:30.964226 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ec74a3-119f-45e5-a1e4-d6e524d672cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:38:30.964845 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ec74a3-119f-45e5-a1e4-d6e524d672cf service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:38:30.965119 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ec74a3-119f-45e5-a1e4-d6e524d672cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:38:30.965387 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ec74a3-119f-45e5-a1e4-d6e524d672cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:38:30.967167 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-54ec74a3-119f-45e5-a1e4-d6e524d672cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:38:31.032916 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ec74a3-119f-45e5-a1e4-d6e524d672cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:38:31.034370 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ec74a3-119f-45e5-a1e4-d6e524d672cf service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:38:31.045732 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1332/2688] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:38:30 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:38:33.265537 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=25 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:38:41.040529 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=34 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:38:42.529546 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be1486-a15a-423a-a914-689bdb7a35f4 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:38:42.530081 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be1486-a15a-423a-a914-689bdb7a35f4 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:38:42.530081 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be1486-a15a-423a-a914-689bdb7a35f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:38:42.561298 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-69be1486-a15a-423a-a914-689bdb7a35f4 None None] MFA Rules not processed for user `149aa48acd504354a1d021885ca51334`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:38:42.562536 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-69be1486-a15a-423a-a914-689bdb7a35f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:38:42.641491 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1357/2689] 10.222.0.79 () {58 vars in 1009 bytes} [Wed Aug 31 12:38:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:38:42.690226 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ec74a3-119f-45e5-a1e4-d6e524d672cf service neutron] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:38:42.691751 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-54ec74a3-119f-45e5-a1e4-d6e524d672cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:38:42.769397 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ec74a3-119f-45e5-a1e4-d6e524d672cf service neutron] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:38:42.774961 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37e8c5b-b2b5-48d2-a7fd-460a19975190 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896540cc14f40b08d05ade32cfd0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:38:42.775585 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e8c5b-b2b5-48d2-a7fd-460a19975190 service swift] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:38:42.775863 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e8c5b-b2b5-48d2-a7fd-460a19975190 service swift] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:38:42.776132 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e8c5b-b2b5-48d2-a7fd-460a19975190 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:38:42.785978 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37e8c5b-b2b5-48d2-a7fd-460a19975190 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:38:42.787652 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37e8c5b-b2b5-48d2-a7fd-460a19975190 service swift] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:38:42.796995 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1333/2690] 10.222.0.79 () {60 vars in 1384 bytes} [Wed Aug 31 12:38:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 12:38:52.633056 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=32 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:38:52.793928 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=32 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:38:57.967672 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3855e6d-8463-463f-870b-2619b089d5d9 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:38:57.968240 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3855e6d-8463-463f-870b-2619b089d5d9 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:38:57.968240 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3855e6d-8463-463f-870b-2619b089d5d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:38:57.987551 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-c3855e6d-8463-463f-870b-2619b089d5d9 None None] MFA Rules not processed for user `149aa48acd504354a1d021885ca51334`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:38:57.988735 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-c3855e6d-8463-463f-870b-2619b089d5d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:38:57.996438 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1358/2691] 10.222.0.79 () {58 vars in 967 bytes} [Wed Aug 31 12:38:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:38:58.011783 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37e8c5b-b2b5-48d2-a7fd-460a19975190 service swift] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:38:58.022479 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37e8c5b-b2b5-48d2-a7fd-460a19975190 service swift] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:38:58.028580 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b11512-de0d-4607-beee-0cef34fee472 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896540cc14f40b08d05ade32cfd0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:38:58.029204 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b11512-de0d-4607-beee-0cef34fee472 service swift] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:38:58.029489 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b11512-de0d-4607-beee-0cef34fee472 service swift] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:38:58.029756 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b11512-de0d-4607-beee-0cef34fee472 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:38:58.040267 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b11512-de0d-4607-beee-0cef34fee472 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:38:58.041876 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b11512-de0d-4607-beee-0cef34fee472 service swift] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:38:58.049976 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1334/2692] 10.222.0.79 () {60 vars in 1384 bytes} [Wed Aug 31 12:38:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 12:38:59.947046 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3855e6d-8463-463f-870b-2619b089d5d9 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:38:59.948628 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-c3855e6d-8463-463f-870b-2619b089d5d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:38:59.963791 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3855e6d-8463-463f-870b-2619b089d5d9 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:38:59.968727 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb04d33-6011-4750-a7bb-0c214e77e43c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6deab40ae6244d4b9affa47b274aea3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:38:59.969340 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb04d33-6011-4750-a7bb-0c214e77e43c service placement] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:38:59.969614 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb04d33-6011-4750-a7bb-0c214e77e43c service placement] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:38:59.969888 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb04d33-6011-4750-a7bb-0c214e77e43c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:38:59.971650 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-deb04d33-6011-4750-a7bb-0c214e77e43c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:38:59.984702 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb04d33-6011-4750-a7bb-0c214e77e43c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:38:59.986297 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb04d33-6011-4750-a7bb-0c214e77e43c service placement] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:38:59.998435 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1359/2693] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:38:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:39:00.054240 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b11512-de0d-4607-beee-0cef34fee472 service swift] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:39:00.065578 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b11512-de0d-4607-beee-0cef34fee472 service swift] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:39:00.070671 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef7f22-247e-4e5b-9d49-cc5ac5b8777b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:39:00.071502 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef7f22-247e-4e5b-9d49-cc5ac5b8777b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:39:00.071787 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef7f22-247e-4e5b-9d49-cc5ac5b8777b admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:39:00.072052 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef7f22-247e-4e5b-9d49-cc5ac5b8777b admin admin] PATH_INFO: `/v3/users/b4ca778b2f2f45c29cc99cbbe190d76a` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:39:00.073204 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ef7f22-247e-4e5b-9d49-cc5ac5b8777b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4ca778b2f2f45c29cc99cbbe190d76a)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:39:00.075156 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ef7f22-247e-4e5b-9d49-cc5ac5b8777b admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:39:00.133496 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-93ef7f22-247e-4e5b-9d49-cc5ac5b8777b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4ca778b2f2f45c29cc99cbbe190d76a'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:39:00.150758 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-93ef7f22-247e-4e5b-9d49-cc5ac5b8777b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4ca778b2f2f45c29cc99cbbe190d76a'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:39:00.151723 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-93ef7f22-247e-4e5b-9d49-cc5ac5b8777b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4ca778b2f2f45c29cc99cbbe190d76a'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:39:00.163037 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-93ef7f22-247e-4e5b-9d49-cc5ac5b8777b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4ca778b2f2f45c29cc99cbbe190d76a'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:39:00.163874 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-93ef7f22-247e-4e5b-9d49-cc5ac5b8777b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4ca778b2f2f45c29cc99cbbe190d76a'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:39:00.181874 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1335/2694] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:39:00 2022] DELETE /identity/v3/users/b4ca778b2f2f45c29cc99cbbe190d76a => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:39:00.815542 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb04d33-6011-4750-a7bb-0c214e77e43c service placement] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:39:00.831520 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb04d33-6011-4750-a7bb-0c214e77e43c service placement] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:39:00.910118 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db40cc7-5d1a-45d2-8e2f-6f63bff0b3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:39:00.911388 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db40cc7-5d1a-45d2-8e2f-6f63bff0b3c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:39:00.911894 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db40cc7-5d1a-45d2-8e2f-6f63bff0b3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:39:00.912592 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db40cc7-5d1a-45d2-8e2f-6f63bff0b3c5 admin admin] PATH_INFO: `/v3/projects/c5c8e3638b084b768d8ba4b0202af99d` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:39:00.914515 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db40cc7-5d1a-45d2-8e2f-6f63bff0b3c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5c8e3638b084b768d8ba4b0202af99d)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:39:00.917802 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db40cc7-5d1a-45d2-8e2f-6f63bff0b3c5 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:39:00.987918 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-2db40cc7-5d1a-45d2-8e2f-6f63bff0b3c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5c8e3638b084b768d8ba4b0202af99d', 'request_id': 'req-2db40cc7-5d1a-45d2-8e2f-6f63bff0b3c5'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:39:01.001733 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-2db40cc7-5d1a-45d2-8e2f-6f63bff0b3c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5c8e3638b084b768d8ba4b0202af99d', 'request_id': 'req-2db40cc7-5d1a-45d2-8e2f-6f63bff0b3c5'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:39:01.011292 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-2db40cc7-5d1a-45d2-8e2f-6f63bff0b3c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5c8e3638b084b768d8ba4b0202af99d', 'request_id': 'req-2db40cc7-5d1a-45d2-8e2f-6f63bff0b3c5'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:39:01.022217 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-2db40cc7-5d1a-45d2-8e2f-6f63bff0b3c5 admin admin] The token cache is being invalidate because project c5c8e3638b084b768d8ba4b0202af99d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:39:01.022635 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-2db40cc7-5d1a-45d2-8e2f-6f63bff0b3c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:39:01.023431 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-2db40cc7-5d1a-45d2-8e2f-6f63bff0b3c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:39:01.025957 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1360/2695] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:39:00 2022] DELETE /identity/v3/projects/c5c8e3638b084b768d8ba4b0202af99d => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:39:01.032059 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efe7a58-bad5-4d03-a7fa-adbf447afd77 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:39:01.032350 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efe7a58-bad5-4d03-a7fa-adbf447afd77 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:39:01.032654 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efe7a58-bad5-4d03-a7fa-adbf447afd77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:39:01.055118 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-9efe7a58-bad5-4d03-a7fa-adbf447afd77 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:39:01.057021 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-9efe7a58-bad5-4d03-a7fa-adbf447afd77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:39:01.124007 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1336/2696] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:39:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:39:01.131911 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c915c1-3eb3-467c-9bec-b9dabac4d539 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:39:01.132205 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c915c1-3eb3-467c-9bec-b9dabac4d539 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:39:01.132470 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c915c1-3eb3-467c-9bec-b9dabac4d539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:39:01.155578 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-b0c915c1-3eb3-467c-9bec-b9dabac4d539 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:39:01.156796 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-b0c915c1-3eb3-467c-9bec-b9dabac4d539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:39:01.165449 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1361/2697] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:39:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:39:01.170118 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efe7a58-bad5-4d03-a7fa-adbf447afd77 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:39:01.181053 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efe7a58-bad5-4d03-a7fa-adbf447afd77 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:39:01.186955 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abef0196-1f95-4962-ac23-57f40a66c2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:39:01.187571 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef0196-1f95-4962-ac23-57f40a66c2a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:39:01.187850 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef0196-1f95-4962-ac23-57f40a66c2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:39:01.188121 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef0196-1f95-4962-ac23-57f40a66c2a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:39:01.188777 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abef0196-1f95-4962-ac23-57f40a66c2a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:39:01.189081 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abef0196-1f95-4962-ac23-57f40a66c2a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:39:01.190689 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abef0196-1f95-4962-ac23-57f40a66c2a7 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:39:01.203645 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1337/2698] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 12:39:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:39:01.207987 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c915c1-3eb3-467c-9bec-b9dabac4d539 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:39:01.218671 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c915c1-3eb3-467c-9bec-b9dabac4d539 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:39:01.223344 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fbf6ee-83f1-4ea1-9a6c-66b7d16e97d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:39:01.223946 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fbf6ee-83f1-4ea1-9a6c-66b7d16e97d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:39:01.224223 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fbf6ee-83f1-4ea1-9a6c-66b7d16e97d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:39:01.224490 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fbf6ee-83f1-4ea1-9a6c-66b7d16e97d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:39:01.225118 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fbf6ee-83f1-4ea1-9a6c-66b7d16e97d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:39:01.227036 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fbf6ee-83f1-4ea1-9a6c-66b7d16e97d6 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:39:01.256502 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1362/2699] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:39:01 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:39:01.261913 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abef0196-1f95-4962-ac23-57f40a66c2a7 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:39:01.273722 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abef0196-1f95-4962-ac23-57f40a66c2a7 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:39:01.336320 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:39:01.358406 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68f0ae6-f73a-4336-840f-2168086ba053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:39:01.358910 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f0ae6-f73a-4336-840f-2168086ba053 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:39:01.359288 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f0ae6-f73a-4336-840f-2168086ba053 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:39:01.359465 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f0ae6-f73a-4336-840f-2168086ba053 admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:39:01.360130 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68f0ae6-f73a-4336-840f-2168086ba053 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:39:01.362015 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68f0ae6-f73a-4336-840f-2168086ba053 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:39:01.389696 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1338/2700] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:39:01 2022] POST /identity/v3/users => generated 287 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:39:01.394151 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fbf6ee-83f1-4ea1-9a6c-66b7d16e97d6 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:39:01.405098 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fbf6ee-83f1-4ea1-9a6c-66b7d16e97d6 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:39:01.410225 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f663260-d4f6-4e00-a5a2-4e73451418de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:39:01.410934 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f663260-d4f6-4e00-a5a2-4e73451418de admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:39:01.411140 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f663260-d4f6-4e00-a5a2-4e73451418de admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:39:01.411417 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f663260-d4f6-4e00-a5a2-4e73451418de admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:39:01.412053 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f663260-d4f6-4e00-a5a2-4e73451418de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:39:01.413677 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f663260-d4f6-4e00-a5a2-4e73451418de admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:39:01.430172 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1363/2701] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:39:01.433055 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68f0ae6-f73a-4336-840f-2168086ba053 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:39:01.453285 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68f0ae6-f73a-4336-840f-2168086ba053 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:39:01.459192 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b80ec6-dce7-4e09-a1f1-48e6581ce5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:39:01.459961 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b80ec6-dce7-4e09-a1f1-48e6581ce5b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:39:01.460306 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b80ec6-dce7-4e09-a1f1-48e6581ce5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:39:01.460673 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b80ec6-dce7-4e09-a1f1-48e6581ce5b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:39:01.461334 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b80ec6-dce7-4e09-a1f1-48e6581ce5b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:39:01.463227 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b80ec6-dce7-4e09-a1f1-48e6581ce5b0 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:39:01.478394 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1339/2702] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 12:39:01.486535 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f663260-d4f6-4e00-a5a2-4e73451418de admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:39:01.506817 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f663260-d4f6-4e00-a5a2-4e73451418de admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:39:01.513014 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0917bde4-3159-40d3-bfe3-709217c07b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:39:01.513712 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0917bde4-3159-40d3-bfe3-709217c07b6e admin admin] REQUEST_METHOD: `PUT` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:39:01.513993 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0917bde4-3159-40d3-bfe3-709217c07b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:39:01.514287 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0917bde4-3159-40d3-bfe3-709217c07b6e admin admin] PATH_INFO: `/v3/projects/d23dd159ad95461099b69ada183ec8bd/users/92e71c359e5344239b14db5a1a3f3272/roles/b5cfd7a855a448359e9017f51d32b6fc` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:39:01.532655 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0917bde4-3159-40d3-bfe3-709217c07b6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d23dd159ad95461099b69ada183ec8bd, user_id=92e71c359e5344239b14db5a1a3f3272, role_id=b5cfd7a855a448359e9017f51d32b6fc)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:39:01.535372 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0917bde4-3159-40d3-bfe3-709217c07b6e admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:39:01.551375 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1364/2703] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:39:01 2022] PUT /identity/v3/projects/d23dd159ad95461099b69ada183ec8bd/users/92e71c359e5344239b14db5a1a3f3272/roles/b5cfd7a855a448359e9017f51d32b6fc => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:39:01.652295 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de89a39-a515-43dc-9f72-f1e646c9be2f None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:39:01.652700 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de89a39-a515-43dc-9f72-f1e646c9be2f None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:39:01.653173 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de89a39-a515-43dc-9f72-f1e646c9be2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:39:01.687645 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-8de89a39-a515-43dc-9f72-f1e646c9be2f None None] MFA Rules not processed for user `92e71c359e5344239b14db5a1a3f3272`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:39:01.688876 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-8de89a39-a515-43dc-9f72-f1e646c9be2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:39:01.761703 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1340/2704] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:39:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:39:01.773475 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0917bde4-3159-40d3-bfe3-709217c07b6e admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:39:01.775886 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-0917bde4-3159-40d3-bfe3-709217c07b6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:39:01.785762 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:39:01.839518 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0917bde4-3159-40d3-bfe3-709217c07b6e admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:39:01.843124 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d93e04c-7a25-4eed-8b44-612707361891 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e79503178ac54e62ba385467d5617ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:39:01.843750 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d93e04c-7a25-4eed-8b44-612707361891 service cinder] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:39:01.844025 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d93e04c-7a25-4eed-8b44-612707361891 service cinder] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:39:01.844297 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d93e04c-7a25-4eed-8b44-612707361891 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:39:01.853812 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d93e04c-7a25-4eed-8b44-612707361891 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:39:01.855289 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d93e04c-7a25-4eed-8b44-612707361891 service cinder] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:39:01.865183 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1365/2705] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:39:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:39:01.895110 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de89a39-a515-43dc-9f72-f1e646c9be2f None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:39:01.964409 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de89a39-a515-43dc-9f72-f1e646c9be2f None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:39:01.969057 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03624580-9fb6-434b-864f-61680119a8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:39:01.969716 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03624580-9fb6-434b-864f-61680119a8a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:39:01.969995 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03624580-9fb6-434b-864f-61680119a8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:39:01.970266 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03624580-9fb6-434b-864f-61680119a8a2 admin admin] PATH_INFO: `/v3/users/92e71c359e5344239b14db5a1a3f3272` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:39:01.971510 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03624580-9fb6-434b-864f-61680119a8a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92e71c359e5344239b14db5a1a3f3272)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:39:01.973443 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03624580-9fb6-434b-864f-61680119a8a2 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:39:02.028657 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-03624580-9fb6-434b-864f-61680119a8a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92e71c359e5344239b14db5a1a3f3272'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:39:02.036600 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:39:02.044546 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-03624580-9fb6-434b-864f-61680119a8a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92e71c359e5344239b14db5a1a3f3272'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:39:02.045736 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-03624580-9fb6-434b-864f-61680119a8a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92e71c359e5344239b14db5a1a3f3272'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:39:02.054189 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-03624580-9fb6-434b-864f-61680119a8a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92e71c359e5344239b14db5a1a3f3272'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:39:02.055145 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-03624580-9fb6-434b-864f-61680119a8a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92e71c359e5344239b14db5a1a3f3272'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:39:02.073507 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1341/2706] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:39:01 2022] DELETE /identity/v3/users/92e71c359e5344239b14db5a1a3f3272 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:39:02.078570 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d2dd87-6018-44ef-a014-26af9f975b5b None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:39:02.079474 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d2dd87-6018-44ef-a014-26af9f975b5b None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:39:02.079474 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d2dd87-6018-44ef-a014-26af9f975b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:39:02.099424 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-b0d2dd87-6018-44ef-a014-26af9f975b5b None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:39:02.100674 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-b0d2dd87-6018-44ef-a014-26af9f975b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:39:02.163181 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1366/2707] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:39:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:39:02.175599 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03624580-9fb6-434b-864f-61680119a8a2 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:39:02.177109 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-03624580-9fb6-434b-864f-61680119a8a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:39:02.249409 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03624580-9fb6-434b-864f-61680119a8a2 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:39:02.253105 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d1386c-6165-4614-8a9b-2f9b05a39032 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:39:02.253715 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d1386c-6165-4614-8a9b-2f9b05a39032 service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:39:02.253994 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d1386c-6165-4614-8a9b-2f9b05a39032 service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:39:02.254266 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d1386c-6165-4614-8a9b-2f9b05a39032 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:39:02.264138 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d1386c-6165-4614-8a9b-2f9b05a39032 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:39:02.265572 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d1386c-6165-4614-8a9b-2f9b05a39032 service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:39:02.275916 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1342/2708] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:39:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:39:02.581233 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d2dd87-6018-44ef-a014-26af9f975b5b None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:39:02.582742 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-b0d2dd87-6018-44ef-a014-26af9f975b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:39:02.596355 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d2dd87-6018-44ef-a014-26af9f975b5b None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:39:02.607684 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6200e3f0-bb17-421e-95ce-3d03d05cab2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:39:02.608777 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6200e3f0-bb17-421e-95ce-3d03d05cab2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:39:02.609219 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6200e3f0-bb17-421e-95ce-3d03d05cab2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:39:02.609656 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6200e3f0-bb17-421e-95ce-3d03d05cab2f admin admin] PATH_INFO: `/v3/projects/d23dd159ad95461099b69ada183ec8bd` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:39:02.611133 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6200e3f0-bb17-421e-95ce-3d03d05cab2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d23dd159ad95461099b69ada183ec8bd)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:39:02.613425 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6200e3f0-bb17-421e-95ce-3d03d05cab2f admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:39:02.672588 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-6200e3f0-bb17-421e-95ce-3d03d05cab2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd23dd159ad95461099b69ada183ec8bd', 'request_id': 'req-6200e3f0-bb17-421e-95ce-3d03d05cab2f'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:39:02.683168 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-6200e3f0-bb17-421e-95ce-3d03d05cab2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd23dd159ad95461099b69ada183ec8bd', 'request_id': 'req-6200e3f0-bb17-421e-95ce-3d03d05cab2f'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:39:02.693708 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-6200e3f0-bb17-421e-95ce-3d03d05cab2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd23dd159ad95461099b69ada183ec8bd', 'request_id': 'req-6200e3f0-bb17-421e-95ce-3d03d05cab2f'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:39:02.708911 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-6200e3f0-bb17-421e-95ce-3d03d05cab2f admin admin] The token cache is being invalidate because project d23dd159ad95461099b69ada183ec8bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:39:02.709270 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-6200e3f0-bb17-421e-95ce-3d03d05cab2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:39:02.710676 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-6200e3f0-bb17-421e-95ce-3d03d05cab2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:39:02.714378 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1367/2709] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:39:02 2022] DELETE /identity/v3/projects/d23dd159ad95461099b69ada183ec8bd => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:39:02.719468 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec4f577-e7c5-4cee-a4f2-594cdc8b7ad7 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:39:02.719756 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec4f577-e7c5-4cee-a4f2-594cdc8b7ad7 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:39:02.720040 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec4f577-e7c5-4cee-a4f2-594cdc8b7ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:39:02.742986 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-8ec4f577-e7c5-4cee-a4f2-594cdc8b7ad7 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:39:02.744961 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-8ec4f577-e7c5-4cee-a4f2-594cdc8b7ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:39:02.830925 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1343/2710] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:39:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:39:02.831562 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb516950-d879-4b6a-9440-b10129176507 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:39:02.831853 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb516950-d879-4b6a-9440-b10129176507 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:39:02.832132 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb516950-d879-4b6a-9440-b10129176507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:39:02.862629 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-fb516950-d879-4b6a-9440-b10129176507 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:39:02.863584 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-fb516950-d879-4b6a-9440-b10129176507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:39:02.874578 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1368/2711] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:39:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:39:02.879666 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec4f577-e7c5-4cee-a4f2-594cdc8b7ad7 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:39:02.900686 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec4f577-e7c5-4cee-a4f2-594cdc8b7ad7 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:39:02.907850 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5723c53-1cb9-465d-ab6b-c30e44d88f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:39:02.908517 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5723c53-1cb9-465d-ab6b-c30e44d88f27 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:39:02.908950 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5723c53-1cb9-465d-ab6b-c30e44d88f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:39:02.909294 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5723c53-1cb9-465d-ab6b-c30e44d88f27 admin admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:39:02.910316 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5723c53-1cb9-465d-ab6b-c30e44d88f27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:39:02.910778 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5723c53-1cb9-465d-ab6b-c30e44d88f27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:39:02.912501 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5723c53-1cb9-465d-ab6b-c30e44d88f27 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:39:02.925756 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1344/2712] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 12:39:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:39:02.930310 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb516950-d879-4b6a-9440-b10129176507 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:39:02.941029 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb516950-d879-4b6a-9440-b10129176507 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:39:02.947514 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcadc2a-e0cd-4f35-8e46-9a421e3a90dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:39:02.948132 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcadc2a-e0cd-4f35-8e46-9a421e3a90dd admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:39:02.949179 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcadc2a-e0cd-4f35-8e46-9a421e3a90dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:39:02.949487 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcadc2a-e0cd-4f35-8e46-9a421e3a90dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:39:02.950605 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcadc2a-e0cd-4f35-8e46-9a421e3a90dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:39:02.953701 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcadc2a-e0cd-4f35-8e46-9a421e3a90dd admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:39:02.991634 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1369/2713] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:39:02 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:39:02.994785 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5723c53-1cb9-465d-ab6b-c30e44d88f27 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:39:03.005062 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5723c53-1cb9-465d-ab6b-c30e44d88f27 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:39:03.057798 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:39:03.070251 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0819dac-0820-464e-81b8-16548643a40f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:39:03.071320 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0819dac-0820-464e-81b8-16548643a40f admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:39:03.071809 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0819dac-0820-464e-81b8-16548643a40f admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:39:03.072443 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0819dac-0820-464e-81b8-16548643a40f admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:39:03.073394 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0819dac-0820-464e-81b8-16548643a40f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:39:03.075503 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0819dac-0820-464e-81b8-16548643a40f admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:39:03.100690 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1345/2714] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:39:02 2022] POST /identity/v3/users => generated 287 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:39:03.105809 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcadc2a-e0cd-4f35-8e46-9a421e3a90dd admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:39:03.112666 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:39:03.119885 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcadc2a-e0cd-4f35-8e46-9a421e3a90dd admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:39:03.127476 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf43b96-1ed2-460f-bef0-3e6306592f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:39:03.128297 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf43b96-1ed2-460f-bef0-3e6306592f6e admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:39:03.128798 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf43b96-1ed2-460f-bef0-3e6306592f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:39:03.129331 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf43b96-1ed2-460f-bef0-3e6306592f6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:39:03.130055 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf43b96-1ed2-460f-bef0-3e6306592f6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:39:03.132682 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf43b96-1ed2-460f-bef0-3e6306592f6e admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:39:03.144088 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1370/2715] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:39:03 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:39:03.148953 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0819dac-0820-464e-81b8-16548643a40f admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:39:03.162130 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0819dac-0820-464e-81b8-16548643a40f admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:39:03.168133 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d623569e-da01-4a55-9f33-a6ab48ee00ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:39:03.168779 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d623569e-da01-4a55-9f33-a6ab48ee00ce admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:39:03.169057 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d623569e-da01-4a55-9f33-a6ab48ee00ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:39:03.169359 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d623569e-da01-4a55-9f33-a6ab48ee00ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:39:03.170024 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d623569e-da01-4a55-9f33-a6ab48ee00ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:39:03.171720 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d623569e-da01-4a55-9f33-a6ab48ee00ce admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:39:03.182871 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1346/2716] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:39:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:39:03.187224 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf43b96-1ed2-460f-bef0-3e6306592f6e admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:39:03.197441 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf43b96-1ed2-460f-bef0-3e6306592f6e admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:39:03.202367 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36073811-b164-434b-94ec-21fcea512c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:39:03.203072 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36073811-b164-434b-94ec-21fcea512c3b admin admin] REQUEST_METHOD: `PUT` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:39:03.203348 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36073811-b164-434b-94ec-21fcea512c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:39:03.203609 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36073811-b164-434b-94ec-21fcea512c3b admin admin] PATH_INFO: `/v3/projects/7836bc76fed84b15b99afd31cb4a4b86/users/6af5196048374fe7b2d70fe972c31abb/roles/b5cfd7a855a448359e9017f51d32b6fc` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:39:03.219548 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36073811-b164-434b-94ec-21fcea512c3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7836bc76fed84b15b99afd31cb4a4b86, user_id=6af5196048374fe7b2d70fe972c31abb, role_id=b5cfd7a855a448359e9017f51d32b6fc)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:39:03.222192 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36073811-b164-434b-94ec-21fcea512c3b admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:39:03.236314 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1371/2717] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:39:03 2022] PUT /identity/v3/projects/7836bc76fed84b15b99afd31cb4a4b86/users/6af5196048374fe7b2d70fe972c31abb/roles/b5cfd7a855a448359e9017f51d32b6fc => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:39:03.247209 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bddd6f-afbd-4de4-b266-d36c66eebc83 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:39:03.247494 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bddd6f-afbd-4de4-b266-d36c66eebc83 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:39:03.247770 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bddd6f-afbd-4de4-b266-d36c66eebc83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:39:03.278147 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-89bddd6f-afbd-4de4-b266-d36c66eebc83 None None] MFA Rules not processed for user `6af5196048374fe7b2d70fe972c31abb`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:39:03.279393 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-89bddd6f-afbd-4de4-b266-d36c66eebc83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:39:03.349346 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1347/2718] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:39:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:39:03.360704 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36073811-b164-434b-94ec-21fcea512c3b admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:39:03.362446 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-36073811-b164-434b-94ec-21fcea512c3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:39:03.421728 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36073811-b164-434b-94ec-21fcea512c3b admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:39:03.425393 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0405a08-6d07-431b-b2f0-33858f19304f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e79503178ac54e62ba385467d5617ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:39:03.426044 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0405a08-6d07-431b-b2f0-33858f19304f service cinder] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:39:03.426322 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0405a08-6d07-431b-b2f0-33858f19304f service cinder] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:39:03.426591 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0405a08-6d07-431b-b2f0-33858f19304f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:39:03.436505 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0405a08-6d07-431b-b2f0-33858f19304f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:39:03.438100 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0405a08-6d07-431b-b2f0-33858f19304f service cinder] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:39:03.448221 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1372/2719] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:39:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:39:04.816900 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a6736-3ef8-4377-9ed9-d8cd1e05a88a None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:39:04.817428 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a6736-3ef8-4377-9ed9-d8cd1e05a88a None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:39:04.817428 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a6736-3ef8-4377-9ed9-d8cd1e05a88a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:39:04.836425 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-ad6a6736-3ef8-4377-9ed9-d8cd1e05a88a None None] MFA Rules not processed for user `6af5196048374fe7b2d70fe972c31abb`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:39:04.837802 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-ad6a6736-3ef8-4377-9ed9-d8cd1e05a88a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:39:04.844990 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1348/2720] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:39:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:39:13.443314 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=39,keystone:INSERT=1 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:39:14.831151 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=45,keystone:INSERT=3 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:39:24.636564 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706049d4-e593-4d03-ac9b-c4d9ab1027e8 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:39:24.637230 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706049d4-e593-4d03-ac9b-c4d9ab1027e8 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:39:24.637230 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706049d4-e593-4d03-ac9b-c4d9ab1027e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:39:24.659434 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-706049d4-e593-4d03-ac9b-c4d9ab1027e8 None None] MFA Rules not processed for user `149aa48acd504354a1d021885ca51334`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:39:24.660664 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-706049d4-e593-4d03-ac9b-c4d9ab1027e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:39:24.736608 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1373/2721] 10.222.0.79 () {58 vars in 1009 bytes} [Wed Aug 31 12:39:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:39:24.749958 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6a6736-3ef8-4377-9ed9-d8cd1e05a88a None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:39:24.751462 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-ad6a6736-3ef8-4377-9ed9-d8cd1e05a88a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:39:24.834578 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6a6736-3ef8-4377-9ed9-d8cd1e05a88a None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:39:24.840493 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d067fc-0b26-420d-94df-c9346440a1a5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896540cc14f40b08d05ade32cfd0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:39:24.841248 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d067fc-0b26-420d-94df-c9346440a1a5 service swift] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:39:24.841531 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d067fc-0b26-420d-94df-c9346440a1a5 service swift] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:39:24.842080 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d067fc-0b26-420d-94df-c9346440a1a5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:39:24.851052 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d067fc-0b26-420d-94df-c9346440a1a5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:39:24.852448 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d067fc-0b26-420d-94df-c9346440a1a5 service swift] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:39:24.863088 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1349/2722] 10.222.0.79 () {60 vars in 1384 bytes} [Wed Aug 31 12:39:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 12:39:25.419734 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ea6d3-0baf-4a19-83f8-24ceb4682bfa None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:39:25.419734 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ea6d3-0baf-4a19-83f8-24ceb4682bfa None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:39:25.419734 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ea6d3-0baf-4a19-83f8-24ceb4682bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:39:25.442585 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-5d1ea6d3-0baf-4a19-83f8-24ceb4682bfa None None] MFA Rules not processed for user `149aa48acd504354a1d021885ca51334`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:39:25.444067 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-5d1ea6d3-0baf-4a19-83f8-24ceb4682bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:39:25.467924 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1374/2723] 10.222.0.79 () {58 vars in 967 bytes} [Wed Aug 31 12:39:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:39:25.481613 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d067fc-0b26-420d-94df-c9346440a1a5 service swift] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:39:25.493598 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d067fc-0b26-420d-94df-c9346440a1a5 service swift] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:39:25.499800 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc9fd89-7fe9-4baf-bebb-26e1e36764b1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896540cc14f40b08d05ade32cfd0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:39:25.500573 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc9fd89-7fe9-4baf-bebb-26e1e36764b1 service swift] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:39:25.500864 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc9fd89-7fe9-4baf-bebb-26e1e36764b1 service swift] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:39:25.501228 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc9fd89-7fe9-4baf-bebb-26e1e36764b1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:39:25.510976 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc9fd89-7fe9-4baf-bebb-26e1e36764b1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:39:25.512636 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc9fd89-7fe9-4baf-bebb-26e1e36764b1 service swift] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:39:25.526350 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1350/2724] 10.222.0.79 () {60 vars in 1384 bytes} [Wed Aug 31 12:39:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 31 12:39:25.832220 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a0581-90b3-4e0e-80f0-543ed288a847 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:39:25.832712 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a0581-90b3-4e0e-80f0-543ed288a847 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:39:25.832712 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a0581-90b3-4e0e-80f0-543ed288a847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:39:25.852993 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-658a0581-90b3-4e0e-80f0-543ed288a847 None None] MFA Rules not processed for user `149aa48acd504354a1d021885ca51334`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:39:25.854471 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-658a0581-90b3-4e0e-80f0-543ed288a847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:39:25.864588 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1375/2725] 10.222.0.79 () {58 vars in 1009 bytes} [Wed Aug 31 12:39:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:39:25.882210 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc9fd89-7fe9-4baf-bebb-26e1e36764b1 service swift] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:39:25.894563 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc9fd89-7fe9-4baf-bebb-26e1e36764b1 service swift] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:39:25.901248 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7597cc-02a7-4109-993a-f20d8af7bd1a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896540cc14f40b08d05ade32cfd0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:39:25.901863 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7597cc-02a7-4109-993a-f20d8af7bd1a service swift] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:39:25.902144 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7597cc-02a7-4109-993a-f20d8af7bd1a service swift] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:39:25.902413 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7597cc-02a7-4109-993a-f20d8af7bd1a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:39:25.911589 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7597cc-02a7-4109-993a-f20d8af7bd1a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:39:25.913202 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7597cc-02a7-4109-993a-f20d8af7bd1a service swift] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:39:25.924576 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1351/2726] 10.222.0.79 () {60 vars in 1384 bytes} [Wed Aug 31 12:39:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 12:39:26.301643 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a79aa-573a-4463-a59f-9e77bfa5965c None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:39:26.302012 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a79aa-573a-4463-a59f-9e77bfa5965c None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:39:26.302353 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a79aa-573a-4463-a59f-9e77bfa5965c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:39:26.323474 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-2f2a79aa-573a-4463-a59f-9e77bfa5965c None None] MFA Rules not processed for user `149aa48acd504354a1d021885ca51334`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:39:26.324708 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-2f2a79aa-573a-4463-a59f-9e77bfa5965c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:39:26.332671 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1376/2727] 10.222.0.79 () {58 vars in 967 bytes} [Wed Aug 31 12:39:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:39:26.350031 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7597cc-02a7-4109-993a-f20d8af7bd1a service swift] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:39:26.361849 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7597cc-02a7-4109-993a-f20d8af7bd1a service swift] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:39:26.367081 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81dc465-059a-4493-8cba-5e68f555f5a8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896540cc14f40b08d05ade32cfd0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:39:26.367990 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81dc465-059a-4493-8cba-5e68f555f5a8 service swift] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:39:26.368267 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81dc465-059a-4493-8cba-5e68f555f5a8 service swift] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:39:26.368537 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81dc465-059a-4493-8cba-5e68f555f5a8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:39:26.377879 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81dc465-059a-4493-8cba-5e68f555f5a8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:39:26.379514 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81dc465-059a-4493-8cba-5e68f555f5a8 service swift] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:39:26.389293 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1352/2728] 10.222.0.79 () {60 vars in 1384 bytes} [Wed Aug 31 12:39:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 12:39:27.355150 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbbcede-e025-4d81-9862-2867c8840996 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:39:27.356449 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbbcede-e025-4d81-9862-2867c8840996 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:39:27.357468 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbbcede-e025-4d81-9862-2867c8840996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:39:27.387387 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-efbbcede-e025-4d81-9862-2867c8840996 None None] MFA Rules not processed for user `d277532df42244c693b5e51e9fd0c459`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:39:27.389277 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-efbbcede-e025-4d81-9862-2867c8840996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:39:27.463896 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1377/2729] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:39:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:39:27.589369 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81dc465-059a-4493-8cba-5e68f555f5a8 service swift] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:39:27.591246 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-e81dc465-059a-4493-8cba-5e68f555f5a8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:39:27.698978 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81dc465-059a-4493-8cba-5e68f555f5a8 service swift] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:39:27.708758 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e669c0-d02b-4575-a5ec-9e44bdac5dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:39:27.709402 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e669c0-d02b-4575-a5ec-9e44bdac5dfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:39:27.709676 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e669c0-d02b-4575-a5ec-9e44bdac5dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:39:27.709944 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e669c0-d02b-4575-a5ec-9e44bdac5dfd admin admin] PATH_INFO: `/v3/users/c4fb81a9221d435a8d9e38ab138cad4a` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:39:27.711193 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e669c0-d02b-4575-a5ec-9e44bdac5dfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4fb81a9221d435a8d9e38ab138cad4a)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:39:27.713344 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e669c0-d02b-4575-a5ec-9e44bdac5dfd admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:39:27.793149 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-67e669c0-d02b-4575-a5ec-9e44bdac5dfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4fb81a9221d435a8d9e38ab138cad4a'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:39:27.802109 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:39:27.816082 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-67e669c0-d02b-4575-a5ec-9e44bdac5dfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4fb81a9221d435a8d9e38ab138cad4a'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:39:27.819607 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-67e669c0-d02b-4575-a5ec-9e44bdac5dfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4fb81a9221d435a8d9e38ab138cad4a'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:39:27.836586 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-67e669c0-d02b-4575-a5ec-9e44bdac5dfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4fb81a9221d435a8d9e38ab138cad4a'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:39:27.836586 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-67e669c0-d02b-4575-a5ec-9e44bdac5dfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4fb81a9221d435a8d9e38ab138cad4a'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:39:27.855543 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1353/2730] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:39:27 2022] DELETE /identity/v3/users/c4fb81a9221d435a8d9e38ab138cad4a => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:39:28.099069 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbbcede-e025-4d81-9862-2867c8840996 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:39:28.126453 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbbcede-e025-4d81-9862-2867c8840996 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:39:28.220305 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96f984f-573e-48f6-8d7e-187f65eff97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:39:28.221034 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f984f-573e-48f6-8d7e-187f65eff97d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:39:28.221433 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f984f-573e-48f6-8d7e-187f65eff97d admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:39:28.221678 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f984f-573e-48f6-8d7e-187f65eff97d admin admin] PATH_INFO: `/v3/projects/812b75d0fa3241d38b2727efe253ca20` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:39:28.222902 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96f984f-573e-48f6-8d7e-187f65eff97d admin admin] RBAC: Authorizing `identity:delete_project(project_id=812b75d0fa3241d38b2727efe253ca20)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:39:28.225285 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96f984f-573e-48f6-8d7e-187f65eff97d admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:39:28.270714 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:39:28.290468 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-e96f984f-573e-48f6-8d7e-187f65eff97d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '812b75d0fa3241d38b2727efe253ca20', 'request_id': 'req-e96f984f-573e-48f6-8d7e-187f65eff97d'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:39:28.300150 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-e96f984f-573e-48f6-8d7e-187f65eff97d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '812b75d0fa3241d38b2727efe253ca20', 'request_id': 'req-e96f984f-573e-48f6-8d7e-187f65eff97d'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:39:28.317931 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-e96f984f-573e-48f6-8d7e-187f65eff97d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '812b75d0fa3241d38b2727efe253ca20', 'request_id': 'req-e96f984f-573e-48f6-8d7e-187f65eff97d'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:39:28.331294 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-e96f984f-573e-48f6-8d7e-187f65eff97d admin admin] The token cache is being invalidate because project 812b75d0fa3241d38b2727efe253ca20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:39:28.331646 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-e96f984f-573e-48f6-8d7e-187f65eff97d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:39:28.332316 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-e96f984f-573e-48f6-8d7e-187f65eff97d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:39:28.335642 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1378/2731] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:39:28 2022] DELETE /identity/v3/projects/812b75d0fa3241d38b2727efe253ca20 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:39:29.088918 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e669c0-d02b-4575-a5ec-9e44bdac5dfd admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:39:29.090843 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-67e669c0-d02b-4575-a5ec-9e44bdac5dfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:39:29.107683 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e669c0-d02b-4575-a5ec-9e44bdac5dfd admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:39:29.177828 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73967206-95f7-4783-a629-d61c81d4db21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:39:29.178370 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73967206-95f7-4783-a629-d61c81d4db21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:39:29.178646 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73967206-95f7-4783-a629-d61c81d4db21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:39:29.178945 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73967206-95f7-4783-a629-d61c81d4db21 admin admin] PATH_INFO: `/v3/users/6af5196048374fe7b2d70fe972c31abb` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:39:29.180102 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73967206-95f7-4783-a629-d61c81d4db21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6af5196048374fe7b2d70fe972c31abb)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:39:29.182545 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73967206-95f7-4783-a629-d61c81d4db21 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:39:29.236415 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-73967206-95f7-4783-a629-d61c81d4db21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6af5196048374fe7b2d70fe972c31abb'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:39:29.249593 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-73967206-95f7-4783-a629-d61c81d4db21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6af5196048374fe7b2d70fe972c31abb'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:39:29.250327 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-73967206-95f7-4783-a629-d61c81d4db21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6af5196048374fe7b2d70fe972c31abb'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:39:29.257584 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-73967206-95f7-4783-a629-d61c81d4db21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6af5196048374fe7b2d70fe972c31abb'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:39:29.258282 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-73967206-95f7-4783-a629-d61c81d4db21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6af5196048374fe7b2d70fe972c31abb'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:39:29.272532 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1354/2732] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:39:29 2022] DELETE /identity/v3/users/6af5196048374fe7b2d70fe972c31abb => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:39:29.280274 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5746d40d-6b82-43d0-bc47-c3f9f1249e6d None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:39:29.280828 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5746d40d-6b82-43d0-bc47-c3f9f1249e6d None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:39:29.281107 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5746d40d-6b82-43d0-bc47-c3f9f1249e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:39:29.302792 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-5746d40d-6b82-43d0-bc47-c3f9f1249e6d None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:39:29.304056 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-5746d40d-6b82-43d0-bc47-c3f9f1249e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:39:29.388143 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1379/2733] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:39:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:39:29.397681 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73967206-95f7-4783-a629-d61c81d4db21 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:39:29.399905 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-73967206-95f7-4783-a629-d61c81d4db21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:39:29.508154 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:39:29.520260 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73967206-95f7-4783-a629-d61c81d4db21 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:39:29.535387 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029faf35-e82f-4bf1-bbf8-ae928ea8cea8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:39:29.536053 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029faf35-e82f-4bf1-bbf8-ae928ea8cea8 service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:39:29.536324 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029faf35-e82f-4bf1-bbf8-ae928ea8cea8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:39:29.536586 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029faf35-e82f-4bf1-bbf8-ae928ea8cea8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:39:29.554099 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029faf35-e82f-4bf1-bbf8-ae928ea8cea8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:39:29.557099 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029faf35-e82f-4bf1-bbf8-ae928ea8cea8 service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:39:29.581675 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1355/2734] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:39:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:39:29.919577 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5746d40d-6b82-43d0-bc47-c3f9f1249e6d None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:39:29.921905 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-5746d40d-6b82-43d0-bc47-c3f9f1249e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:39:29.940204 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5746d40d-6b82-43d0-bc47-c3f9f1249e6d None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:39:29.944897 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59e9807-77fe-4ee4-8ede-79a41a3bc0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:39:29.945818 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e9807-77fe-4ee4-8ede-79a41a3bc0e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:39:29.946119 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e9807-77fe-4ee4-8ede-79a41a3bc0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:39:29.946451 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e9807-77fe-4ee4-8ede-79a41a3bc0e0 admin admin] PATH_INFO: `/v3/projects/7836bc76fed84b15b99afd31cb4a4b86` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:39:29.948393 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59e9807-77fe-4ee4-8ede-79a41a3bc0e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7836bc76fed84b15b99afd31cb4a4b86)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:39:29.950416 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59e9807-77fe-4ee4-8ede-79a41a3bc0e0 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:39:30.021282 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-a59e9807-77fe-4ee4-8ede-79a41a3bc0e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7836bc76fed84b15b99afd31cb4a4b86', 'request_id': 'req-a59e9807-77fe-4ee4-8ede-79a41a3bc0e0'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:39:30.033294 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-a59e9807-77fe-4ee4-8ede-79a41a3bc0e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7836bc76fed84b15b99afd31cb4a4b86', 'request_id': 'req-a59e9807-77fe-4ee4-8ede-79a41a3bc0e0'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:39:30.043331 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-a59e9807-77fe-4ee4-8ede-79a41a3bc0e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7836bc76fed84b15b99afd31cb4a4b86', 'request_id': 'req-a59e9807-77fe-4ee4-8ede-79a41a3bc0e0'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:39:30.061138 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-a59e9807-77fe-4ee4-8ede-79a41a3bc0e0 admin admin] The token cache is being invalidate because project 7836bc76fed84b15b99afd31cb4a4b86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:39:30.061555 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-a59e9807-77fe-4ee4-8ede-79a41a3bc0e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:39:30.062309 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-a59e9807-77fe-4ee4-8ede-79a41a3bc0e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:39:30.063943 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1380/2735] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:39:29 2022] DELETE /identity/v3/projects/7836bc76fed84b15b99afd31cb4a4b86 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:39:30.069160 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e72d3b-8fd2-4686-a9e8-ac34d70aaae2 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:39:30.069681 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e72d3b-8fd2-4686-a9e8-ac34d70aaae2 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:39:30.070143 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e72d3b-8fd2-4686-a9e8-ac34d70aaae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:39:30.106106 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-34e72d3b-8fd2-4686-a9e8-ac34d70aaae2 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:39:30.107761 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-34e72d3b-8fd2-4686-a9e8-ac34d70aaae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:39:30.189956 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1356/2736] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:39:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:39:30.200420 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05207f3b-8694-4f4d-89a4-fa631c790aeb None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:39:30.200975 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05207f3b-8694-4f4d-89a4-fa631c790aeb None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:39:30.201447 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05207f3b-8694-4f4d-89a4-fa631c790aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:39:30.232235 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-05207f3b-8694-4f4d-89a4-fa631c790aeb None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:39:30.234275 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-05207f3b-8694-4f4d-89a4-fa631c790aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:39:30.252087 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1381/2737] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:39:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:39:30.253443 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e72d3b-8fd2-4686-a9e8-ac34d70aaae2 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:39:30.265585 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e72d3b-8fd2-4686-a9e8-ac34d70aaae2 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:39:30.270476 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947d040a-1861-4bdf-8731-69e6199d83a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:39:30.271139 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d040a-1861-4bdf-8731-69e6199d83a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:39:30.271419 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d040a-1861-4bdf-8731-69e6199d83a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:39:30.271725 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d040a-1861-4bdf-8731-69e6199d83a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:39:30.272384 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947d040a-1861-4bdf-8731-69e6199d83a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:39:30.272687 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947d040a-1861-4bdf-8731-69e6199d83a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:39:30.274349 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947d040a-1861-4bdf-8731-69e6199d83a7 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:39:30.289992 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1357/2738] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 12:39:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:39:30.295729 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05207f3b-8694-4f4d-89a4-fa631c790aeb None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:39:30.311697 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05207f3b-8694-4f4d-89a4-fa631c790aeb None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:39:30.318050 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2967ace-98a0-4fc2-bd5a-479d18b6298e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:39:30.318687 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2967ace-98a0-4fc2-bd5a-479d18b6298e admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:39:30.319006 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2967ace-98a0-4fc2-bd5a-479d18b6298e admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:39:30.319278 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2967ace-98a0-4fc2-bd5a-479d18b6298e admin admin] PATH_INFO: `/v3/projects` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:39:30.319940 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2967ace-98a0-4fc2-bd5a-479d18b6298e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:39:30.321883 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2967ace-98a0-4fc2-bd5a-479d18b6298e admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:39:30.384156 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1382/2739] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:39:30 2022] POST /identity/v3/projects => generated 373 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:39:30.386998 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947d040a-1861-4bdf-8731-69e6199d83a7 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:39:30.404689 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947d040a-1861-4bdf-8731-69e6199d83a7 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:39:30.481773 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81092968-d773-4a47-bf37-e9a4448a0fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:39:30.482611 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81092968-d773-4a47-bf37-e9a4448a0fbe admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:39:30.483021 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81092968-d773-4a47-bf37-e9a4448a0fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:39:30.483357 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81092968-d773-4a47-bf37-e9a4448a0fbe admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:39:30.485404 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81092968-d773-4a47-bf37-e9a4448a0fbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:39:30.491269 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81092968-d773-4a47-bf37-e9a4448a0fbe admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:39:30.534761 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1358/2740] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:39:30 2022] POST /identity/v3/users => generated 287 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:39:30.537547 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2967ace-98a0-4fc2-bd5a-479d18b6298e admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:39:30.550441 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2967ace-98a0-4fc2-bd5a-479d18b6298e admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:39:30.557679 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c19a835-e034-4f1f-8534-dfc6e12528e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:39:30.559492 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c19a835-e034-4f1f-8534-dfc6e12528e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:39:30.560044 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c19a835-e034-4f1f-8534-dfc6e12528e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:39:30.560462 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c19a835-e034-4f1f-8534-dfc6e12528e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:39:30.561267 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c19a835-e034-4f1f-8534-dfc6e12528e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:39:30.563116 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c19a835-e034-4f1f-8534-dfc6e12528e0 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:39:30.565062 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:39:30.581652 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1383/2741] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:39:30 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:39:30.585536 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81092968-d773-4a47-bf37-e9a4448a0fbe admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:39:30.597846 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81092968-d773-4a47-bf37-e9a4448a0fbe admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:39:30.613168 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d5c2c9-0792-418c-af98-50622e37b96b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:39:30.614037 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d5c2c9-0792-418c-af98-50622e37b96b admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:39:30.614468 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d5c2c9-0792-418c-af98-50622e37b96b admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:39:30.614972 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d5c2c9-0792-418c-af98-50622e37b96b admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:39:30.616126 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d5c2c9-0792-418c-af98-50622e37b96b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:39:30.618702 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d5c2c9-0792-418c-af98-50622e37b96b admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:39:30.640240 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1359/2742] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:39:30 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 12:39:30.645237 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c19a835-e034-4f1f-8534-dfc6e12528e0 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:39:30.657665 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c19a835-e034-4f1f-8534-dfc6e12528e0 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:39:30.663354 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38deb9be-f207-4d3c-bc5f-64722e6d9129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:39:30.664155 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38deb9be-f207-4d3c-bc5f-64722e6d9129 admin admin] REQUEST_METHOD: `PUT` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:39:30.664519 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38deb9be-f207-4d3c-bc5f-64722e6d9129 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:39:30.664871 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38deb9be-f207-4d3c-bc5f-64722e6d9129 admin admin] PATH_INFO: `/v3/projects/92cfd0189e5d478ca95f1b5a38809030/users/4bc9e1e27ad3412e856dfda13a4f7e51/roles/b5cfd7a855a448359e9017f51d32b6fc` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:39:30.696850 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38deb9be-f207-4d3c-bc5f-64722e6d9129 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92cfd0189e5d478ca95f1b5a38809030, user_id=4bc9e1e27ad3412e856dfda13a4f7e51, role_id=b5cfd7a855a448359e9017f51d32b6fc)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:39:30.703962 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38deb9be-f207-4d3c-bc5f-64722e6d9129 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:39:30.730524 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1384/2743] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:39:30 2022] PUT /identity/v3/projects/92cfd0189e5d478ca95f1b5a38809030/users/4bc9e1e27ad3412e856dfda13a4f7e51/roles/b5cfd7a855a448359e9017f51d32b6fc => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:39:30.737606 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c918e0-3b79-4c29-ae34-aa6a3be947a9 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:39:30.738294 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c918e0-3b79-4c29-ae34-aa6a3be947a9 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:39:30.738939 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c918e0-3b79-4c29-ae34-aa6a3be947a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:39:30.765755 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-01c918e0-3b79-4c29-ae34-aa6a3be947a9 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:39:30.767579 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-01c918e0-3b79-4c29-ae34-aa6a3be947a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:39:30.847107 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:39:30.870391 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1360/2744] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:39:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:39:30.880986 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38deb9be-f207-4d3c-bc5f-64722e6d9129 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:39:30.882441 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-38deb9be-f207-4d3c-bc5f-64722e6d9129 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:39:30.963592 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38deb9be-f207-4d3c-bc5f-64722e6d9129 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:39:30.969621 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b72c9d7-0c59-4f50-a919-91e10c91fa9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:39:30.970180 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72c9d7-0c59-4f50-a919-91e10c91fa9b service neutron] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:39:30.970463 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72c9d7-0c59-4f50-a919-91e10c91fa9b service neutron] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:39:30.970805 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72c9d7-0c59-4f50-a919-91e10c91fa9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:39:30.990750 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b72c9d7-0c59-4f50-a919-91e10c91fa9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:39:30.993761 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b72c9d7-0c59-4f50-a919-91e10c91fa9b service neutron] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:39:31.022192 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1385/2745] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:39:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:39:32.098152 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c918e0-3b79-4c29-ae34-aa6a3be947a9 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:39:32.100705 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-01c918e0-3b79-4c29-ae34-aa6a3be947a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:39:32.118595 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c918e0-3b79-4c29-ae34-aa6a3be947a9 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:39:32.125079 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecba974f-4a17-4ab4-9785-31490828fa7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:39:32.125687 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba974f-4a17-4ab4-9785-31490828fa7f service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:39:32.125955 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba974f-4a17-4ab4-9785-31490828fa7f service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:39:32.126577 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba974f-4a17-4ab4-9785-31490828fa7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:39:32.129370 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-ecba974f-4a17-4ab4-9785-31490828fa7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:39:32.254048 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecba974f-4a17-4ab4-9785-31490828fa7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:39:32.256464 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecba974f-4a17-4ab4-9785-31490828fa7f service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:39:32.281602 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1361/2746] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:39:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:39:33.523843 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b72c9d7-0c59-4f50-a919-91e10c91fa9b service neutron] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:39:33.533847 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b72c9d7-0c59-4f50-a919-91e10c91fa9b service neutron] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:39:33.540499 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c7ee95-e5e8-48fb-b87c-6f607f0ae430 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:39:33.542165 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c7ee95-e5e8-48fb-b87c-6f607f0ae430 service neutron] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:39:33.542965 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c7ee95-e5e8-48fb-b87c-6f607f0ae430 service neutron] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:39:33.543335 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c7ee95-e5e8-48fb-b87c-6f607f0ae430 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:39:33.545340 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-c7c7ee95-e5e8-48fb-b87c-6f607f0ae430 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:39:33.561884 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c7ee95-e5e8-48fb-b87c-6f607f0ae430 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:39:33.563824 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c7ee95-e5e8-48fb-b87c-6f607f0ae430 service neutron] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:39:33.577203 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1386/2747] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:39:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:39:36.098945 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b63e3-7e83-4368-adef-e5be2bb1090d None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:39:36.099562 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b63e3-7e83-4368-adef-e5be2bb1090d None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:39:36.100053 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b63e3-7e83-4368-adef-e5be2bb1090d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:39:36.163221 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-a46b63e3-7e83-4368-adef-e5be2bb1090d None None] MFA Rules not processed for user `4bc9e1e27ad3412e856dfda13a4f7e51`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:39:36.164654 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-a46b63e3-7e83-4368-adef-e5be2bb1090d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:39:36.262513 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c7ee95-e5e8-48fb-b87c-6f607f0ae430 service neutron] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:39:36.265808 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1362/2748] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:39:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:39:36.278494 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c7ee95-e5e8-48fb-b87c-6f607f0ae430 service neutron] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:39:36.285256 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2736355-70cf-49f7-adbf-64736b9da5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:39:36.285901 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2736355-70cf-49f7-adbf-64736b9da5aa admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:39:36.286184 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2736355-70cf-49f7-adbf-64736b9da5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:39:36.286927 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2736355-70cf-49f7-adbf-64736b9da5aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:39:36.287136 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2736355-70cf-49f7-adbf-64736b9da5aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:39:36.289119 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2736355-70cf-49f7-adbf-64736b9da5aa admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:39:36.339509 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1387/2749] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:39:36 2022] POST /identity/v3/projects => generated 371 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:39:36.341657 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b63e3-7e83-4368-adef-e5be2bb1090d None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:39:36.355798 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b63e3-7e83-4368-adef-e5be2bb1090d None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:39:36.468781 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:39:36.487905 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba36f74-4878-4f75-a943-bf49e3f21161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:39:36.488779 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba36f74-4878-4f75-a943-bf49e3f21161 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:39:36.489139 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba36f74-4878-4f75-a943-bf49e3f21161 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:39:36.489477 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba36f74-4878-4f75-a943-bf49e3f21161 admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:39:36.490740 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba36f74-4878-4f75-a943-bf49e3f21161 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:39:36.492480 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba36f74-4878-4f75-a943-bf49e3f21161 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:39:36.531482 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1363/2750] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:39:36 2022] POST /identity/v3/users => generated 292 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:39:36.537312 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2736355-70cf-49f7-adbf-64736b9da5aa admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:39:36.548681 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2736355-70cf-49f7-adbf-64736b9da5aa admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:39:36.553367 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b30a8d-9499-40d8-9136-86390c8787a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:39:36.553999 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b30a8d-9499-40d8-9136-86390c8787a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:39:36.557414 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b30a8d-9499-40d8-9136-86390c8787a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:39:36.557414 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b30a8d-9499-40d8-9136-86390c8787a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:39:36.557414 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b30a8d-9499-40d8-9136-86390c8787a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:39:36.557414 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b30a8d-9499-40d8-9136-86390c8787a7 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:39:36.569342 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1388/2751] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:39:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:39:36.576452 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba36f74-4878-4f75-a943-bf49e3f21161 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:39:36.593427 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba36f74-4878-4f75-a943-bf49e3f21161 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:39:36.599731 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddb5dbb-2692-4e90-be59-1193b6c4b03e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:39:36.600631 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb5dbb-2692-4e90-be59-1193b6c4b03e admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:39:36.601041 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb5dbb-2692-4e90-be59-1193b6c4b03e admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:39:36.601212 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb5dbb-2692-4e90-be59-1193b6c4b03e admin admin] PATH_INFO: `/v3/projects/f47322ae6e78410d957597e234ee9994/users/07704d2604da4c89b3a7035456bc182a/roles/a332ef951db949b0bad7019fbd28a1b9` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:39:36.624760 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddb5dbb-2692-4e90-be59-1193b6c4b03e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f47322ae6e78410d957597e234ee9994, user_id=07704d2604da4c89b3a7035456bc182a, role_id=a332ef951db949b0bad7019fbd28a1b9)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:39:36.627542 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddb5dbb-2692-4e90-be59-1193b6c4b03e admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:39:36.653958 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1364/2752] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:39:36 2022] PUT /identity/v3/projects/f47322ae6e78410d957597e234ee9994/users/07704d2604da4c89b3a7035456bc182a/roles/a332ef951db949b0bad7019fbd28a1b9 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:39:36.661292 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b30a8d-9499-40d8-9136-86390c8787a7 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:39:36.683001 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b30a8d-9499-40d8-9136-86390c8787a7 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:39:36.783310 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fc1d58-e139-4fc3-b6d5-501f3deec3fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:39:36.784056 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc1d58-e139-4fc3-b6d5-501f3deec3fa admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:39:36.784519 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc1d58-e139-4fc3-b6d5-501f3deec3fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:39:36.784961 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc1d58-e139-4fc3-b6d5-501f3deec3fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:39:36.786049 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fc1d58-e139-4fc3-b6d5-501f3deec3fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:39:36.787927 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fc1d58-e139-4fc3-b6d5-501f3deec3fa admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:39:36.800044 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1389/2753] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:39:36 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:39:36.805098 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddb5dbb-2692-4e90-be59-1193b6c4b03e admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:39:36.819595 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddb5dbb-2692-4e90-be59-1193b6c4b03e admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:39:36.825410 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6379e7cc-2611-485f-9e0a-f26a1d76f2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:39:36.826095 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6379e7cc-2611-485f-9e0a-f26a1d76f2f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:39:36.826368 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6379e7cc-2611-485f-9e0a-f26a1d76f2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:39:36.826635 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6379e7cc-2611-485f-9e0a-f26a1d76f2f2 admin admin] PATH_INFO: `/v3/projects/f47322ae6e78410d957597e234ee9994/users/07704d2604da4c89b3a7035456bc182a/roles/a332ef951db949b0bad7019fbd28a1b9` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:39:36.828640 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6379e7cc-2611-485f-9e0a-f26a1d76f2f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f47322ae6e78410d957597e234ee9994, user_id=07704d2604da4c89b3a7035456bc182a, role_id=a332ef951db949b0bad7019fbd28a1b9)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:39:36.831404 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6379e7cc-2611-485f-9e0a-f26a1d76f2f2 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:39:36.842669 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1365/2754] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:39:36 2022] PUT /identity/v3/projects/f47322ae6e78410d957597e234ee9994/users/07704d2604da4c89b3a7035456bc182a/roles/a332ef951db949b0bad7019fbd28a1b9 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:39:43.099640 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c81dcb-7403-45f0-9b50-721171063b51 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:39:43.100206 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c81dcb-7403-45f0-9b50-721171063b51 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:39:43.100596 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c81dcb-7403-45f0-9b50-721171063b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:39:43.148885 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-51c81dcb-7403-45f0-9b50-721171063b51 None None] MFA Rules not processed for user `07704d2604da4c89b3a7035456bc182a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:39:43.151217 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-51c81dcb-7403-45f0-9b50-721171063b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:39:43.173839 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:39:43.248469 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1390/2755] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:39:43 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:39:43.266589 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6379e7cc-2611-485f-9e0a-f26a1d76f2f2 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:39:43.270054 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-6379e7cc-2611-485f-9e0a-f26a1d76f2f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:39:43.383168 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6379e7cc-2611-485f-9e0a-f26a1d76f2f2 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:39:43.401808 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316099f1-7e04-4740-9a3f-f5b52f37260b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62401c8e1457450590f4147e0665265a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:39:43.402352 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316099f1-7e04-4740-9a3f-f5b52f37260b service nova] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:39:43.402629 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316099f1-7e04-4740-9a3f-f5b52f37260b service nova] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:39:43.403120 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316099f1-7e04-4740-9a3f-f5b52f37260b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:39:43.525634 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316099f1-7e04-4740-9a3f-f5b52f37260b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:39:43.528147 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316099f1-7e04-4740-9a3f-f5b52f37260b service nova] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:39:43.540187 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1366/2756] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:39:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:39:45.255305 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14781882-ed28-4256-aa0f-e95e3191adef None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:39:45.255887 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14781882-ed28-4256-aa0f-e95e3191adef None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:39:45.255989 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14781882-ed28-4256-aa0f-e95e3191adef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:39:45.279371 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-14781882-ed28-4256-aa0f-e95e3191adef None None] MFA Rules not processed for user `4bc9e1e27ad3412e856dfda13a4f7e51`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:39:45.281464 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-14781882-ed28-4256-aa0f-e95e3191adef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:39:45.289920 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1391/2757] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:39:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:39:53.535854 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=76,keystone:INSERT=5 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:39:55.271479 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=26 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:40:15.790134 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316099f1-7e04-4740-9a3f-f5b52f37260b service nova] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:15.801883 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316099f1-7e04-4740-9a3f-f5b52f37260b service nova] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:15.809192 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12637799-bb08-4931-a1df-045597edc38b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62401c8e1457450590f4147e0665265a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:15.809829 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12637799-bb08-4931-a1df-045597edc38b service nova] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:15.810104 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12637799-bb08-4931-a1df-045597edc38b service nova] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:15.810371 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12637799-bb08-4931-a1df-045597edc38b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:15.812253 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-12637799-bb08-4931-a1df-045597edc38b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:40:15.875322 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12637799-bb08-4931-a1df-045597edc38b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:15.876919 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12637799-bb08-4931-a1df-045597edc38b service nova] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:15.888072 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1367/2758] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:40:15 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:40:17.183469 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14781882-ed28-4256-aa0f-e95e3191adef None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:17.313172 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14781882-ed28-4256-aa0f-e95e3191adef None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:17.318383 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c6584f-4b2f-4441-a1e4-b168ffb8584c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:17.319438 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6584f-4b2f-4441-a1e4-b168ffb8584c service neutron] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:17.320135 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6584f-4b2f-4441-a1e4-b168ffb8584c service neutron] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:17.320264 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6584f-4b2f-4441-a1e4-b168ffb8584c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:17.322693 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-21c6584f-4b2f-4441-a1e4-b168ffb8584c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:40:17.348125 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c6584f-4b2f-4441-a1e4-b168ffb8584c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:17.360062 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c6584f-4b2f-4441-a1e4-b168ffb8584c service neutron] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:17.380953 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1392/2759] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:40:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:40:18.079767 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12637799-bb08-4931-a1df-045597edc38b service nova] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:18.091453 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12637799-bb08-4931-a1df-045597edc38b service nova] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:18.095352 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a45f5e2-2af8-4493-acfe-32f502a02941 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:18.096659 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a45f5e2-2af8-4493-acfe-32f502a02941 service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:18.096659 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a45f5e2-2af8-4493-acfe-32f502a02941 service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:18.096659 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a45f5e2-2af8-4493-acfe-32f502a02941 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:18.109077 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a45f5e2-2af8-4493-acfe-32f502a02941 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:18.110884 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a45f5e2-2af8-4493-acfe-32f502a02941 service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:18.131625 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1368/2760] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:40:18 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:40:25.405712 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c6584f-4b2f-4441-a1e4-b168ffb8584c service neutron] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:25.435360 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c6584f-4b2f-4441-a1e4-b168ffb8584c service neutron] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:25.442564 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41d54ae-c849-447a-8224-467d7f9be62d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62401c8e1457450590f4147e0665265a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:25.443705 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d54ae-c849-447a-8224-467d7f9be62d service nova] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:25.444142 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d54ae-c849-447a-8224-467d7f9be62d service nova] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:25.444419 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d54ae-c849-447a-8224-467d7f9be62d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:25.446378 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-d41d54ae-c849-447a-8224-467d7f9be62d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:40:25.472682 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41d54ae-c849-447a-8224-467d7f9be62d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:25.474990 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41d54ae-c849-447a-8224-467d7f9be62d service nova] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:25.488781 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1393/2761] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:40:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:40:28.122940 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=34 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:40:28.439724 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a45f5e2-2af8-4493-acfe-32f502a02941 service neutron] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:28.453854 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a45f5e2-2af8-4493-acfe-32f502a02941 service neutron] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:28.457808 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e479a35a-6231-4c2c-834d-44e86ef31903 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:28.458431 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e479a35a-6231-4c2c-834d-44e86ef31903 service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:28.458780 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e479a35a-6231-4c2c-834d-44e86ef31903 service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:28.459154 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e479a35a-6231-4c2c-834d-44e86ef31903 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:28.460932 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-e479a35a-6231-4c2c-834d-44e86ef31903 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:40:28.527175 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e479a35a-6231-4c2c-834d-44e86ef31903 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:28.528610 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e479a35a-6231-4c2c-834d-44e86ef31903 service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:28.538343 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1369/2762] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:40:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:40:35.326666 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41d54ae-c849-447a-8224-467d7f9be62d service nova] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:35.328254 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-d41d54ae-c849-447a-8224-467d7f9be62d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:40:35.350467 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41d54ae-c849-447a-8224-467d7f9be62d service nova] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:35.361530 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab11761-c532-4d4b-af21-4e89affe6df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:35.362623 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab11761-c532-4d4b-af21-4e89affe6df3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:35.363500 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab11761-c532-4d4b-af21-4e89affe6df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:35.363500 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab11761-c532-4d4b-af21-4e89affe6df3 admin admin] PATH_INFO: `/v3/users/2e77671c123f434489d82da79212d0ab` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:35.364580 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab11761-c532-4d4b-af21-4e89affe6df3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e77671c123f434489d82da79212d0ab)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:35.366720 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab11761-c532-4d4b-af21-4e89affe6df3 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:35.426423 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-5ab11761-c532-4d4b-af21-4e89affe6df3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e77671c123f434489d82da79212d0ab'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:35.439817 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-5ab11761-c532-4d4b-af21-4e89affe6df3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e77671c123f434489d82da79212d0ab'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:35.449765 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-5ab11761-c532-4d4b-af21-4e89affe6df3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e77671c123f434489d82da79212d0ab'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:35.450644 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-5ab11761-c532-4d4b-af21-4e89affe6df3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e77671c123f434489d82da79212d0ab'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:35.459004 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-5ab11761-c532-4d4b-af21-4e89affe6df3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e77671c123f434489d82da79212d0ab'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:35.465506 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1394/2763] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:40:35 2022] DELETE /identity/v3/users/2e77671c123f434489d82da79212d0ab => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:40:35.659848 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e479a35a-6231-4c2c-834d-44e86ef31903 service neutron] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:35.670749 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e479a35a-6231-4c2c-834d-44e86ef31903 service neutron] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:35.676185 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab11761-c532-4d4b-af21-4e89affe6df3 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:35.677898 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-5ab11761-c532-4d4b-af21-4e89affe6df3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:40:35.737418 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174a24b1-63d6-4c0d-a398-054f377b4110 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:35.738147 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a24b1-63d6-4c0d-a398-054f377b4110 service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:35.739239 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a24b1-63d6-4c0d-a398-054f377b4110 service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:35.739533 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a24b1-63d6-4c0d-a398-054f377b4110 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:35.741416 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-174a24b1-63d6-4c0d-a398-054f377b4110 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:40:35.759119 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab11761-c532-4d4b-af21-4e89affe6df3 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:35.764810 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e730c-bf92-42a1-bd8f-14a7562bd5e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:35.765459 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e730c-bf92-42a1-bd8f-14a7562bd5e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:35.765749 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e730c-bf92-42a1-bd8f-14a7562bd5e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:35.766091 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e730c-bf92-42a1-bd8f-14a7562bd5e1 admin admin] PATH_INFO: `/v3/projects/b364169c30154cc8af7c9a37bebc8040` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:35.767271 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774e730c-bf92-42a1-bd8f-14a7562bd5e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b364169c30154cc8af7c9a37bebc8040)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:35.769192 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774e730c-bf92-42a1-bd8f-14a7562bd5e1 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:35.771798 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:40:35.812530 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174a24b1-63d6-4c0d-a398-054f377b4110 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:35.814007 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174a24b1-63d6-4c0d-a398-054f377b4110 service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:35.821969 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-774e730c-bf92-42a1-bd8f-14a7562bd5e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b364169c30154cc8af7c9a37bebc8040', 'request_id': 'req-774e730c-bf92-42a1-bd8f-14a7562bd5e1'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:35.825213 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1370/2764] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:40:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:40:35.831992 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-774e730c-bf92-42a1-bd8f-14a7562bd5e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b364169c30154cc8af7c9a37bebc8040', 'request_id': 'req-774e730c-bf92-42a1-bd8f-14a7562bd5e1'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:35.843231 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-774e730c-bf92-42a1-bd8f-14a7562bd5e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b364169c30154cc8af7c9a37bebc8040', 'request_id': 'req-774e730c-bf92-42a1-bd8f-14a7562bd5e1'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:35.859724 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-774e730c-bf92-42a1-bd8f-14a7562bd5e1 admin admin] The token cache is being invalidate because project b364169c30154cc8af7c9a37bebc8040 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:40:35.860016 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-774e730c-bf92-42a1-bd8f-14a7562bd5e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:35.860955 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-774e730c-bf92-42a1-bd8f-14a7562bd5e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:35.862992 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1395/2765] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:40:35 2022] DELETE /identity/v3/projects/b364169c30154cc8af7c9a37bebc8040 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:40:35.868189 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174a24b1-63d6-4c0d-a398-054f377b4110 service neutron] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:35.879548 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174a24b1-63d6-4c0d-a398-054f377b4110 service neutron] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:35.925922 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:40:35.944719 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7309cf-2ceb-4432-83c4-3b7a0dae1880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:35.945369 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7309cf-2ceb-4432-83c4-3b7a0dae1880 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:35.945651 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7309cf-2ceb-4432-83c4-3b7a0dae1880 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:35.945926 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7309cf-2ceb-4432-83c4-3b7a0dae1880 admin admin] PATH_INFO: `/v3/users/93b517b50ee34de492e7b30795dee1f6` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:35.947173 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7309cf-2ceb-4432-83c4-3b7a0dae1880 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93b517b50ee34de492e7b30795dee1f6)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:35.949582 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7309cf-2ceb-4432-83c4-3b7a0dae1880 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:36.013316 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-7d7309cf-2ceb-4432-83c4-3b7a0dae1880 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93b517b50ee34de492e7b30795dee1f6'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:36.031652 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-7d7309cf-2ceb-4432-83c4-3b7a0dae1880 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93b517b50ee34de492e7b30795dee1f6'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:36.032512 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-7d7309cf-2ceb-4432-83c4-3b7a0dae1880 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93b517b50ee34de492e7b30795dee1f6'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:36.039918 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-7d7309cf-2ceb-4432-83c4-3b7a0dae1880 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93b517b50ee34de492e7b30795dee1f6'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:36.040687 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-7d7309cf-2ceb-4432-83c4-3b7a0dae1880 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93b517b50ee34de492e7b30795dee1f6'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:36.063194 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1371/2766] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:40:35 2022] DELETE /identity/v3/users/93b517b50ee34de492e7b30795dee1f6 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:40:36.250761 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e730c-bf92-42a1-bd8f-14a7562bd5e1 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:36.252599 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-774e730c-bf92-42a1-bd8f-14a7562bd5e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:40:36.266424 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e730c-bf92-42a1-bd8f-14a7562bd5e1 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:36.325394 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e22083-c3b8-45bd-a60f-2bdced99e1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:36.326032 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e22083-c3b8-45bd-a60f-2bdced99e1c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:36.326313 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e22083-c3b8-45bd-a60f-2bdced99e1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:36.326591 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e22083-c3b8-45bd-a60f-2bdced99e1c7 admin admin] PATH_INFO: `/v3/projects/10514b67cfa543949fa29fcc752f7b51` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:36.327748 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e22083-c3b8-45bd-a60f-2bdced99e1c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10514b67cfa543949fa29fcc752f7b51)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:36.329663 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e22083-c3b8-45bd-a60f-2bdced99e1c7 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:36.379773 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-b5e22083-c3b8-45bd-a60f-2bdced99e1c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10514b67cfa543949fa29fcc752f7b51', 'request_id': 'req-b5e22083-c3b8-45bd-a60f-2bdced99e1c7'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:36.388015 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-b5e22083-c3b8-45bd-a60f-2bdced99e1c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10514b67cfa543949fa29fcc752f7b51', 'request_id': 'req-b5e22083-c3b8-45bd-a60f-2bdced99e1c7'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:36.394488 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-b5e22083-c3b8-45bd-a60f-2bdced99e1c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10514b67cfa543949fa29fcc752f7b51', 'request_id': 'req-b5e22083-c3b8-45bd-a60f-2bdced99e1c7'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:36.406148 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-b5e22083-c3b8-45bd-a60f-2bdced99e1c7 admin admin] The token cache is being invalidate because project 10514b67cfa543949fa29fcc752f7b51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:40:36.406377 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-b5e22083-c3b8-45bd-a60f-2bdced99e1c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:36.407070 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-b5e22083-c3b8-45bd-a60f-2bdced99e1c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:36.408575 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1396/2767] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:40:36 2022] DELETE /identity/v3/projects/10514b67cfa543949fa29fcc752f7b51 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:40:39.201897 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7309cf-2ceb-4432-83c4-3b7a0dae1880 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:39.203414 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-7d7309cf-2ceb-4432-83c4-3b7a0dae1880 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:40:39.218080 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7309cf-2ceb-4432-83c4-3b7a0dae1880 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:39.279495 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d473097c-17e5-46b9-b8e9-a68682087343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:39.280132 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d473097c-17e5-46b9-b8e9-a68682087343 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:39.280409 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d473097c-17e5-46b9-b8e9-a68682087343 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:39.280680 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d473097c-17e5-46b9-b8e9-a68682087343 admin admin] PATH_INFO: `/v3/users/d277532df42244c693b5e51e9fd0c459` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:39.281803 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d473097c-17e5-46b9-b8e9-a68682087343 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d277532df42244c693b5e51e9fd0c459)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:39.283746 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d473097c-17e5-46b9-b8e9-a68682087343 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:39.328980 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-d473097c-17e5-46b9-b8e9-a68682087343 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd277532df42244c693b5e51e9fd0c459'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:39.341280 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-d473097c-17e5-46b9-b8e9-a68682087343 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd277532df42244c693b5e51e9fd0c459'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:39.341955 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-d473097c-17e5-46b9-b8e9-a68682087343 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd277532df42244c693b5e51e9fd0c459'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:39.343202 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:40:39.350669 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-d473097c-17e5-46b9-b8e9-a68682087343 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd277532df42244c693b5e51e9fd0c459'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:39.351423 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-d473097c-17e5-46b9-b8e9-a68682087343 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd277532df42244c693b5e51e9fd0c459'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:39.365034 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1372/2768] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:40:39 2022] DELETE /identity/v3/users/d277532df42244c693b5e51e9fd0c459 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:40:39.535608 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e22083-c3b8-45bd-a60f-2bdced99e1c7 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:39.537183 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-b5e22083-c3b8-45bd-a60f-2bdced99e1c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:40:39.549864 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e22083-c3b8-45bd-a60f-2bdced99e1c7 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:39.569428 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:40:39.612584 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd97acf-5722-41f4-bcc1-29f6d053ce2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:39.613222 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd97acf-5722-41f4-bcc1-29f6d053ce2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:39.613505 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd97acf-5722-41f4-bcc1-29f6d053ce2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:39.613770 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd97acf-5722-41f4-bcc1-29f6d053ce2d admin admin] PATH_INFO: `/v3/projects/8f6da846ab4f45a6ac4b2e34bf52abfc` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:39.614916 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd97acf-5722-41f4-bcc1-29f6d053ce2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f6da846ab4f45a6ac4b2e34bf52abfc)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:39.616913 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd97acf-5722-41f4-bcc1-29f6d053ce2d admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:39.664907 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-1bd97acf-5722-41f4-bcc1-29f6d053ce2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f6da846ab4f45a6ac4b2e34bf52abfc', 'request_id': 'req-1bd97acf-5722-41f4-bcc1-29f6d053ce2d'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:39.674232 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-1bd97acf-5722-41f4-bcc1-29f6d053ce2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f6da846ab4f45a6ac4b2e34bf52abfc', 'request_id': 'req-1bd97acf-5722-41f4-bcc1-29f6d053ce2d'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:39.687409 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-1bd97acf-5722-41f4-bcc1-29f6d053ce2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f6da846ab4f45a6ac4b2e34bf52abfc', 'request_id': 'req-1bd97acf-5722-41f4-bcc1-29f6d053ce2d'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:39.699551 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-1bd97acf-5722-41f4-bcc1-29f6d053ce2d admin admin] The token cache is being invalidate because project 8f6da846ab4f45a6ac4b2e34bf52abfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:40:39.699841 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-1bd97acf-5722-41f4-bcc1-29f6d053ce2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:39.700531 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-1bd97acf-5722-41f4-bcc1-29f6d053ce2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:39.702029 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1397/2769] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:40:39 2022] DELETE /identity/v3/projects/8f6da846ab4f45a6ac4b2e34bf52abfc => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:40:39.708189 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e513d7-8f52-4f74-aae1-38e0263d33ac None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:39.708694 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e513d7-8f52-4f74-aae1-38e0263d33ac None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:39.709188 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e513d7-8f52-4f74-aae1-38e0263d33ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:39.738236 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-e4e513d7-8f52-4f74-aae1-38e0263d33ac None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:40:39.739496 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-e4e513d7-8f52-4f74-aae1-38e0263d33ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:40:39.802624 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1373/2770] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:40:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:40:39.810802 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2283822b-0e31-47e1-9edc-7315e5370426 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:39.811126 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2283822b-0e31-47e1-9edc-7315e5370426 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:39.811436 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2283822b-0e31-47e1-9edc-7315e5370426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:39.831867 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-2283822b-0e31-47e1-9edc-7315e5370426 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:40:39.833081 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-2283822b-0e31-47e1-9edc-7315e5370426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:40:39.842266 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1398/2771] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:40:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:40:39.846549 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e513d7-8f52-4f74-aae1-38e0263d33ac None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:39.856413 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e513d7-8f52-4f74-aae1-38e0263d33ac None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:39.861809 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f6c8be-1328-4bbc-b1b2-6823390f5fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:39.862510 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6c8be-1328-4bbc-b1b2-6823390f5fe3 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:39.862783 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6c8be-1328-4bbc-b1b2-6823390f5fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:39.863078 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6c8be-1328-4bbc-b1b2-6823390f5fe3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:39.863720 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f6c8be-1328-4bbc-b1b2-6823390f5fe3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:40:39.864018 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f6c8be-1328-4bbc-b1b2-6823390f5fe3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:39.865606 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f6c8be-1328-4bbc-b1b2-6823390f5fe3 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:39.878139 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1374/2772] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 12:40:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:40:39.882556 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2283822b-0e31-47e1-9edc-7315e5370426 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:39.893625 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2283822b-0e31-47e1-9edc-7315e5370426 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:39.898828 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921c1aec-4953-469c-952e-3df379dc3135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:39.899476 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c1aec-4953-469c-952e-3df379dc3135 admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:39.899755 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c1aec-4953-469c-952e-3df379dc3135 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:39.900023 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c1aec-4953-469c-952e-3df379dc3135 admin admin] PATH_INFO: `/v3/projects` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:39.900672 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921c1aec-4953-469c-952e-3df379dc3135 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:39.903378 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921c1aec-4953-469c-952e-3df379dc3135 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:39.930901 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1399/2773] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:40:39 2022] POST /identity/v3/projects => generated 403 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:40:39.935329 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f6c8be-1328-4bbc-b1b2-6823390f5fe3 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:39.945695 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f6c8be-1328-4bbc-b1b2-6823390f5fe3 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:40.010104 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0efdc14-1c05-428b-9c59-b3578a478f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:40.010834 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0efdc14-1c05-428b-9c59-b3578a478f6a admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:40.011929 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0efdc14-1c05-428b-9c59-b3578a478f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:40.012206 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0efdc14-1c05-428b-9c59-b3578a478f6a admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:40.012837 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0efdc14-1c05-428b-9c59-b3578a478f6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:40.014745 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0efdc14-1c05-428b-9c59-b3578a478f6a admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:40.037129 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1375/2774] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:40:39 2022] POST /identity/v3/users => generated 302 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:40:40.041473 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921c1aec-4953-469c-952e-3df379dc3135 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:40.052540 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921c1aec-4953-469c-952e-3df379dc3135 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:40.057231 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e810900-cc5b-4569-81a8-4eb732f2076a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:40.058001 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e810900-cc5b-4569-81a8-4eb732f2076a admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:40.058301 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e810900-cc5b-4569-81a8-4eb732f2076a admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:40.058610 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e810900-cc5b-4569-81a8-4eb732f2076a admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:40.059329 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e810900-cc5b-4569-81a8-4eb732f2076a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:40.060933 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e810900-cc5b-4569-81a8-4eb732f2076a admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:40.071377 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1400/2775] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:40:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:40:40.076228 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0efdc14-1c05-428b-9c59-b3578a478f6a admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:40.087414 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0efdc14-1c05-428b-9c59-b3578a478f6a admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:40.092914 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ab8e93-76f1-41cb-aa01-77244c684590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:40.093563 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab8e93-76f1-41cb-aa01-77244c684590 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:40.093933 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab8e93-76f1-41cb-aa01-77244c684590 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:40.094212 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab8e93-76f1-41cb-aa01-77244c684590 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:40.094871 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ab8e93-76f1-41cb-aa01-77244c684590 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:40.096462 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ab8e93-76f1-41cb-aa01-77244c684590 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:40.108411 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1376/2776] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:40:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 12:40:40.113370 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e810900-cc5b-4569-81a8-4eb732f2076a admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:40.124423 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e810900-cc5b-4569-81a8-4eb732f2076a admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:40.129290 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ea124c-7e77-482d-b6fd-83fdb1cb1ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:40.129897 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea124c-7e77-482d-b6fd-83fdb1cb1ac1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:40.130179 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea124c-7e77-482d-b6fd-83fdb1cb1ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:40.130458 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea124c-7e77-482d-b6fd-83fdb1cb1ac1 admin admin] PATH_INFO: `/v3/projects/5e8885b9d9834611b73af8adcc93e0b2/users/482ebc7c7ba443b3b844c754a8516ec0/roles/b5cfd7a855a448359e9017f51d32b6fc` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:40.145774 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ea124c-7e77-482d-b6fd-83fdb1cb1ac1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e8885b9d9834611b73af8adcc93e0b2, user_id=482ebc7c7ba443b3b844c754a8516ec0, role_id=b5cfd7a855a448359e9017f51d32b6fc)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:40.148462 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ea124c-7e77-482d-b6fd-83fdb1cb1ac1 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:40.162987 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1401/2777] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:40:40 2022] PUT /identity/v3/projects/5e8885b9d9834611b73af8adcc93e0b2/users/482ebc7c7ba443b3b844c754a8516ec0/roles/b5cfd7a855a448359e9017f51d32b6fc => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:40:40.168936 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06462c66-c5b3-49cb-8264-c8f191b57877 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:40.169216 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06462c66-c5b3-49cb-8264-c8f191b57877 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:40.169479 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06462c66-c5b3-49cb-8264-c8f191b57877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:40.188950 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-06462c66-c5b3-49cb-8264-c8f191b57877 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:40:40.190161 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-06462c66-c5b3-49cb-8264-c8f191b57877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:40:40.234015 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:40:40.251049 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1377/2778] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:40:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:40:40.261312 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ea124c-7e77-482d-b6fd-83fdb1cb1ac1 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:40.263073 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-18ea124c-7e77-482d-b6fd-83fdb1cb1ac1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:40:40.317478 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:40:40.321714 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ea124c-7e77-482d-b6fd-83fdb1cb1ac1 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:40.326525 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efa5e38-1d30-414c-b776-5657736643cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:40.327234 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efa5e38-1d30-414c-b776-5657736643cf service neutron] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:40.327745 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efa5e38-1d30-414c-b776-5657736643cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:40.328190 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efa5e38-1d30-414c-b776-5657736643cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:40.337340 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efa5e38-1d30-414c-b776-5657736643cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:40.338761 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efa5e38-1d30-414c-b776-5657736643cf service neutron] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:40.349146 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1402/2779] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:40:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:40:41.019259 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f51f61-534e-4050-936d-92f320a71da7 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:41.019542 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f51f61-534e-4050-936d-92f320a71da7 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:41.019812 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f51f61-534e-4050-936d-92f320a71da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:41.049412 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-c5f51f61-534e-4050-936d-92f320a71da7 None None] MFA Rules not processed for user `482ebc7c7ba443b3b844c754a8516ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:40:41.050787 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-c5f51f61-534e-4050-936d-92f320a71da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:40:41.119010 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1378/2780] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:40:41 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:40:41.123110 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efa5e38-1d30-414c-b776-5657736643cf service neutron] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:41.133304 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efa5e38-1d30-414c-b776-5657736643cf service neutron] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:41.138508 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8bb536-5174-42b3-bee8-04fcc1001a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:41.139174 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8bb536-5174-42b3-bee8-04fcc1001a6b admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:41.139453 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8bb536-5174-42b3-bee8-04fcc1001a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:41.139722 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8bb536-5174-42b3-bee8-04fcc1001a6b admin admin] PATH_INFO: `/v3/projects` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:41.140369 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8bb536-5174-42b3-bee8-04fcc1001a6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:41.142267 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8bb536-5174-42b3-bee8-04fcc1001a6b admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:41.172966 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1403/2781] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:40:41 2022] POST /identity/v3/projects => generated 403 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:40:41.177216 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f51f61-534e-4050-936d-92f320a71da7 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:41.189059 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f51f61-534e-4050-936d-92f320a71da7 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:41.252943 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b707ba4d-6486-488a-84e5-d68c0f7554d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:41.253614 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b707ba4d-6486-488a-84e5-d68c0f7554d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:41.253830 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b707ba4d-6486-488a-84e5-d68c0f7554d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:41.254104 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b707ba4d-6486-488a-84e5-d68c0f7554d6 admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:41.254742 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b707ba4d-6486-488a-84e5-d68c0f7554d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:41.256810 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b707ba4d-6486-488a-84e5-d68c0f7554d6 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:41.290455 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1379/2782] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:40:41 2022] POST /identity/v3/users => generated 308 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:40:41.291927 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8bb536-5174-42b3-bee8-04fcc1001a6b admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:41.304010 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8bb536-5174-42b3-bee8-04fcc1001a6b admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:41.310228 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6714ba-43bd-4e74-9877-f331b1c79e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:41.310867 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6714ba-43bd-4e74-9877-f331b1c79e41 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:41.311309 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6714ba-43bd-4e74-9877-f331b1c79e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:41.311592 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6714ba-43bd-4e74-9877-f331b1c79e41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:41.312261 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6714ba-43bd-4e74-9877-f331b1c79e41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:41.313868 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6714ba-43bd-4e74-9877-f331b1c79e41 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:41.325193 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1404/2783] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:40:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:40:41.329470 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b707ba4d-6486-488a-84e5-d68c0f7554d6 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:41.340757 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b707ba4d-6486-488a-84e5-d68c0f7554d6 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:41.345544 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69c36c6-14c0-42d0-9d67-97853bb157dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:41.346200 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c36c6-14c0-42d0-9d67-97853bb157dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:41.346480 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c36c6-14c0-42d0-9d67-97853bb157dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:41.346781 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c36c6-14c0-42d0-9d67-97853bb157dc admin admin] PATH_INFO: `/v3/projects/779928d0698a4019ac8174745df53378/users/a0545275017f4f7fbe041576a88471e0/roles/a332ef951db949b0bad7019fbd28a1b9` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:41.363920 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69c36c6-14c0-42d0-9d67-97853bb157dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=779928d0698a4019ac8174745df53378, user_id=a0545275017f4f7fbe041576a88471e0, role_id=a332ef951db949b0bad7019fbd28a1b9)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:41.366540 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69c36c6-14c0-42d0-9d67-97853bb157dc admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:41.380863 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1380/2784] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:40:41 2022] PUT /identity/v3/projects/779928d0698a4019ac8174745df53378/users/a0545275017f4f7fbe041576a88471e0/roles/a332ef951db949b0bad7019fbd28a1b9 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:40:41.384866 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6714ba-43bd-4e74-9877-f331b1c79e41 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:41.394774 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6714ba-43bd-4e74-9877-f331b1c79e41 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:41.451894 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd782673-38f2-4bbb-9b3e-9ae8a62a1450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:41.452512 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd782673-38f2-4bbb-9b3e-9ae8a62a1450 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:41.452788 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd782673-38f2-4bbb-9b3e-9ae8a62a1450 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:41.453057 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd782673-38f2-4bbb-9b3e-9ae8a62a1450 admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:41.453714 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd782673-38f2-4bbb-9b3e-9ae8a62a1450 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:41.455397 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd782673-38f2-4bbb-9b3e-9ae8a62a1450 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:41.465391 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1405/2785] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:40:41 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:40:41.469621 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69c36c6-14c0-42d0-9d67-97853bb157dc admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:41.480348 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69c36c6-14c0-42d0-9d67-97853bb157dc admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:41.485029 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b9859c-3cd4-4b84-a503-f6e3ee849177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:41.485676 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9859c-3cd4-4b84-a503-f6e3ee849177 admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:41.485954 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9859c-3cd4-4b84-a503-f6e3ee849177 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:41.486264 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9859c-3cd4-4b84-a503-f6e3ee849177 admin admin] PATH_INFO: `/v3/projects/779928d0698a4019ac8174745df53378/users/a0545275017f4f7fbe041576a88471e0/roles/a332ef951db949b0bad7019fbd28a1b9` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:41.488164 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b9859c-3cd4-4b84-a503-f6e3ee849177 admin admin] RBAC: Authorizing `identity:create_grant(project_id=779928d0698a4019ac8174745df53378, user_id=a0545275017f4f7fbe041576a88471e0, role_id=a332ef951db949b0bad7019fbd28a1b9)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:41.490757 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b9859c-3cd4-4b84-a503-f6e3ee849177 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:41.501945 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1381/2786] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:40:41 2022] PUT /identity/v3/projects/779928d0698a4019ac8174745df53378/users/a0545275017f4f7fbe041576a88471e0/roles/a332ef951db949b0bad7019fbd28a1b9 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:40:42.161960 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb4b7c7-0bfc-48de-a129-9226938a1681 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:42.162450 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb4b7c7-0bfc-48de-a129-9226938a1681 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:42.162550 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb4b7c7-0bfc-48de-a129-9226938a1681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:42.193245 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-6bb4b7c7-0bfc-48de-a129-9226938a1681 None None] MFA Rules not processed for user `a0545275017f4f7fbe041576a88471e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:40:42.194487 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-6bb4b7c7-0bfc-48de-a129-9226938a1681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:40:42.271289 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1406/2787] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:40:42 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:40:43.356601 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b9859c-3cd4-4b84-a503-f6e3ee849177 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:43.392787 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:40:43.423453 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b9859c-3cd4-4b84-a503-f6e3ee849177 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:43.428057 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6746a22-abbb-40ca-ab99-e457cf498dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:43.428690 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6746a22-abbb-40ca-ab99-e457cf498dc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:43.428971 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6746a22-abbb-40ca-ab99-e457cf498dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:43.429245 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6746a22-abbb-40ca-ab99-e457cf498dc5 admin admin] PATH_INFO: `/v3/users/482ebc7c7ba443b3b844c754a8516ec0` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:43.430364 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6746a22-abbb-40ca-ab99-e457cf498dc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=482ebc7c7ba443b3b844c754a8516ec0)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:43.432310 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6746a22-abbb-40ca-ab99-e457cf498dc5 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:43.478956 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-c6746a22-abbb-40ca-ab99-e457cf498dc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '482ebc7c7ba443b3b844c754a8516ec0'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:43.491008 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-c6746a22-abbb-40ca-ab99-e457cf498dc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '482ebc7c7ba443b3b844c754a8516ec0'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:43.491677 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-c6746a22-abbb-40ca-ab99-e457cf498dc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '482ebc7c7ba443b3b844c754a8516ec0'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:43.499439 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-c6746a22-abbb-40ca-ab99-e457cf498dc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '482ebc7c7ba443b3b844c754a8516ec0'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:43.500061 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-c6746a22-abbb-40ca-ab99-e457cf498dc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '482ebc7c7ba443b3b844c754a8516ec0'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:43.512822 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1382/2788] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:40:43 2022] DELETE /identity/v3/users/482ebc7c7ba443b3b844c754a8516ec0 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:40:43.685188 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb4b7c7-0bfc-48de-a129-9226938a1681 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:43.703215 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb4b7c7-0bfc-48de-a129-9226938a1681 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:43.746734 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:40:43.767545 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f518b4-a413-4b2d-a628-1b8ae188d83c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:43.768188 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f518b4-a413-4b2d-a628-1b8ae188d83c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:43.768471 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f518b4-a413-4b2d-a628-1b8ae188d83c admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:43.768748 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f518b4-a413-4b2d-a628-1b8ae188d83c admin admin] PATH_INFO: `/v3/projects/5e8885b9d9834611b73af8adcc93e0b2` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:43.769877 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f518b4-a413-4b2d-a628-1b8ae188d83c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e8885b9d9834611b73af8adcc93e0b2)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:43.771867 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f518b4-a413-4b2d-a628-1b8ae188d83c admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:43.818814 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-31f518b4-a413-4b2d-a628-1b8ae188d83c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e8885b9d9834611b73af8adcc93e0b2', 'request_id': 'req-31f518b4-a413-4b2d-a628-1b8ae188d83c'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:43.826743 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-31f518b4-a413-4b2d-a628-1b8ae188d83c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e8885b9d9834611b73af8adcc93e0b2', 'request_id': 'req-31f518b4-a413-4b2d-a628-1b8ae188d83c'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:43.833002 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-31f518b4-a413-4b2d-a628-1b8ae188d83c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e8885b9d9834611b73af8adcc93e0b2', 'request_id': 'req-31f518b4-a413-4b2d-a628-1b8ae188d83c'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:43.843098 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-31f518b4-a413-4b2d-a628-1b8ae188d83c admin admin] The token cache is being invalidate because project 5e8885b9d9834611b73af8adcc93e0b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:40:43.843389 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-31f518b4-a413-4b2d-a628-1b8ae188d83c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:43.844044 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-31f518b4-a413-4b2d-a628-1b8ae188d83c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:43.845543 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1407/2789] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:40:43 2022] DELETE /identity/v3/projects/5e8885b9d9834611b73af8adcc93e0b2 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:40:43.849534 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6746a22-abbb-40ca-ab99-e457cf498dc5 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:43.850948 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-c6746a22-abbb-40ca-ab99-e457cf498dc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:40:43.864708 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6746a22-abbb-40ca-ab99-e457cf498dc5 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:43.920247 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316449a2-25e0-4e76-8554-9b8fa37115ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:43.920826 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316449a2-25e0-4e76-8554-9b8fa37115ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:43.921103 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316449a2-25e0-4e76-8554-9b8fa37115ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:43.921374 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316449a2-25e0-4e76-8554-9b8fa37115ab admin admin] PATH_INFO: `/v3/users/a0545275017f4f7fbe041576a88471e0` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:43.922612 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316449a2-25e0-4e76-8554-9b8fa37115ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0545275017f4f7fbe041576a88471e0)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:43.924661 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316449a2-25e0-4e76-8554-9b8fa37115ab admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:43.978163 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-316449a2-25e0-4e76-8554-9b8fa37115ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0545275017f4f7fbe041576a88471e0'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:43.983190 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:40:43.992305 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-316449a2-25e0-4e76-8554-9b8fa37115ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0545275017f4f7fbe041576a88471e0'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:43.993208 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-316449a2-25e0-4e76-8554-9b8fa37115ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0545275017f4f7fbe041576a88471e0'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:44.001418 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-316449a2-25e0-4e76-8554-9b8fa37115ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0545275017f4f7fbe041576a88471e0'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:44.002066 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-316449a2-25e0-4e76-8554-9b8fa37115ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0545275017f4f7fbe041576a88471e0'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:44.016230 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1383/2790] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:40:43 2022] DELETE /identity/v3/users/a0545275017f4f7fbe041576a88471e0 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:40:44.199211 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f518b4-a413-4b2d-a628-1b8ae188d83c admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:44.200922 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-31f518b4-a413-4b2d-a628-1b8ae188d83c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:40:44.213701 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f518b4-a413-4b2d-a628-1b8ae188d83c admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:44.272933 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45253532-156c-437e-a6ba-71a21bc2f3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:44.273563 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45253532-156c-437e-a6ba-71a21bc2f3aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:44.273846 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45253532-156c-437e-a6ba-71a21bc2f3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:44.274121 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45253532-156c-437e-a6ba-71a21bc2f3aa admin admin] PATH_INFO: `/v3/projects/779928d0698a4019ac8174745df53378` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:44.275281 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45253532-156c-437e-a6ba-71a21bc2f3aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=779928d0698a4019ac8174745df53378)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:44.277291 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45253532-156c-437e-a6ba-71a21bc2f3aa admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:44.324357 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-45253532-156c-437e-a6ba-71a21bc2f3aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '779928d0698a4019ac8174745df53378', 'request_id': 'req-45253532-156c-437e-a6ba-71a21bc2f3aa'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:44.331766 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-45253532-156c-437e-a6ba-71a21bc2f3aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '779928d0698a4019ac8174745df53378', 'request_id': 'req-45253532-156c-437e-a6ba-71a21bc2f3aa'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:44.338598 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-45253532-156c-437e-a6ba-71a21bc2f3aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '779928d0698a4019ac8174745df53378', 'request_id': 'req-45253532-156c-437e-a6ba-71a21bc2f3aa'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:44.346957 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:40:44.351833 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-45253532-156c-437e-a6ba-71a21bc2f3aa admin admin] The token cache is being invalidate because project 779928d0698a4019ac8174745df53378 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:40:44.352857 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-45253532-156c-437e-a6ba-71a21bc2f3aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:44.353625 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-45253532-156c-437e-a6ba-71a21bc2f3aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:44.358585 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1408/2791] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:40:44 2022] DELETE /identity/v3/projects/779928d0698a4019ac8174745df53378 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:40:44.363459 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c03efb-6cb0-4945-93fb-93e6d3910c37 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:44.363967 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c03efb-6cb0-4945-93fb-93e6d3910c37 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:44.364073 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c03efb-6cb0-4945-93fb-93e6d3910c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:44.385554 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-d3c03efb-6cb0-4945-93fb-93e6d3910c37 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:40:44.386924 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-d3c03efb-6cb0-4945-93fb-93e6d3910c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:40:44.456119 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1384/2792] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:40:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:40:44.464581 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c8763-6587-448e-b121-8315dd2bec84 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:44.465072 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c8763-6587-448e-b121-8315dd2bec84 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:44.465360 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c8763-6587-448e-b121-8315dd2bec84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:44.486369 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-6b6c8763-6587-448e-b121-8315dd2bec84 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:40:44.487636 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-6b6c8763-6587-448e-b121-8315dd2bec84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:40:44.496503 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1409/2793] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:40:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:40:44.501145 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c03efb-6cb0-4945-93fb-93e6d3910c37 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:44.512289 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c03efb-6cb0-4945-93fb-93e6d3910c37 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:44.517157 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4590cbdf-0242-465b-a5a2-21bce239ef90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:44.517772 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4590cbdf-0242-465b-a5a2-21bce239ef90 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:44.518049 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4590cbdf-0242-465b-a5a2-21bce239ef90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:44.518320 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4590cbdf-0242-465b-a5a2-21bce239ef90 admin admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:44.519007 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4590cbdf-0242-465b-a5a2-21bce239ef90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:40:44.519308 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4590cbdf-0242-465b-a5a2-21bce239ef90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:44.520916 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4590cbdf-0242-465b-a5a2-21bce239ef90 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:44.533725 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1385/2794] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 12:40:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:40:44.538189 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6c8763-6587-448e-b121-8315dd2bec84 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:44.548399 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6c8763-6587-448e-b121-8315dd2bec84 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:44.553189 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d1142e-cc79-4c18-b842-9ab50876e6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:44.553798 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d1142e-cc79-4c18-b842-9ab50876e6ff admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:44.554067 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d1142e-cc79-4c18-b842-9ab50876e6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:44.554333 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d1142e-cc79-4c18-b842-9ab50876e6ff admin admin] PATH_INFO: `/v3/projects` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:44.555002 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d1142e-cc79-4c18-b842-9ab50876e6ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:44.556892 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d1142e-cc79-4c18-b842-9ab50876e6ff admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:44.583607 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1410/2795] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:40:44 2022] POST /identity/v3/projects => generated 369 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:40:44.587882 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4590cbdf-0242-465b-a5a2-21bce239ef90 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:44.598361 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4590cbdf-0242-465b-a5a2-21bce239ef90 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:44.653997 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8465f193-767d-49c7-963e-3bc921467361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:44.654606 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8465f193-767d-49c7-963e-3bc921467361 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:44.654908 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8465f193-767d-49c7-963e-3bc921467361 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:44.655182 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8465f193-767d-49c7-963e-3bc921467361 admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:44.655808 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8465f193-767d-49c7-963e-3bc921467361 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:44.657710 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8465f193-767d-49c7-963e-3bc921467361 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:44.679485 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1386/2796] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:40:44 2022] POST /identity/v3/users => generated 285 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:40:44.683859 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d1142e-cc79-4c18-b842-9ab50876e6ff admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:44.694719 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d1142e-cc79-4c18-b842-9ab50876e6ff admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:44.700061 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3e7824-0f64-4d6c-9129-80eb81e8acea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:44.700680 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e7824-0f64-4d6c-9129-80eb81e8acea admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:44.700965 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e7824-0f64-4d6c-9129-80eb81e8acea admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:44.701297 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e7824-0f64-4d6c-9129-80eb81e8acea admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:44.701944 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3e7824-0f64-4d6c-9129-80eb81e8acea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:44.703604 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3e7824-0f64-4d6c-9129-80eb81e8acea admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:44.714706 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1411/2797] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:40:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:40:44.718823 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8465f193-767d-49c7-963e-3bc921467361 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:44.728913 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8465f193-767d-49c7-963e-3bc921467361 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:44.734313 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5f253f-b1cb-411d-bb89-c1a77cba78bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:44.734952 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5f253f-b1cb-411d-bb89-c1a77cba78bb admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:44.735248 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5f253f-b1cb-411d-bb89-c1a77cba78bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:44.735521 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5f253f-b1cb-411d-bb89-c1a77cba78bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:44.736163 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5f253f-b1cb-411d-bb89-c1a77cba78bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:44.737783 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5f253f-b1cb-411d-bb89-c1a77cba78bb admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:44.748718 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1387/2798] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:40:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:40:44.752996 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3e7824-0f64-4d6c-9129-80eb81e8acea admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:44.763409 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3e7824-0f64-4d6c-9129-80eb81e8acea admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:44.768123 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cc65a1-8ce2-4549-8dc4-1703620107ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:44.768772 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc65a1-8ce2-4549-8dc4-1703620107ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:44.769054 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc65a1-8ce2-4549-8dc4-1703620107ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:44.769333 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc65a1-8ce2-4549-8dc4-1703620107ab admin admin] PATH_INFO: `/v3/projects/e58978bed4214bdb963c9632c4ee7361/users/f8da4c30de2947ff8dafa0961140c9a4/roles/b5cfd7a855a448359e9017f51d32b6fc` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:44.784998 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cc65a1-8ce2-4549-8dc4-1703620107ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=e58978bed4214bdb963c9632c4ee7361, user_id=f8da4c30de2947ff8dafa0961140c9a4, role_id=b5cfd7a855a448359e9017f51d32b6fc)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:44.787672 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cc65a1-8ce2-4549-8dc4-1703620107ab admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:44.801082 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1412/2799] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:40:44 2022] PUT /identity/v3/projects/e58978bed4214bdb963c9632c4ee7361/users/f8da4c30de2947ff8dafa0961140c9a4/roles/b5cfd7a855a448359e9017f51d32b6fc => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:40:44.812749 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c776288-929e-48d3-9c50-1fbf2793010d None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:44.813061 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c776288-929e-48d3-9c50-1fbf2793010d None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:44.813356 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c776288-929e-48d3-9c50-1fbf2793010d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:44.841099 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-8c776288-929e-48d3-9c50-1fbf2793010d None None] MFA Rules not processed for user `f8da4c30de2947ff8dafa0961140c9a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:40:44.842313 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-8c776288-929e-48d3-9c50-1fbf2793010d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:40:44.866714 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:40:44.910510 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1388/2800] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:40:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:40:44.915087 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cc65a1-8ce2-4549-8dc4-1703620107ab admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:44.979913 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cc65a1-8ce2-4549-8dc4-1703620107ab admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:44.984525 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afc0e90-fd74-4357-86a5-7bdc6add71bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:44.985138 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc0e90-fd74-4357-86a5-7bdc6add71bd admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:44.985416 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc0e90-fd74-4357-86a5-7bdc6add71bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:44.985688 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc0e90-fd74-4357-86a5-7bdc6add71bd admin admin] PATH_INFO: `/v3/projects` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:44.986324 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afc0e90-fd74-4357-86a5-7bdc6add71bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:44.988253 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afc0e90-fd74-4357-86a5-7bdc6add71bd admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:45.017096 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1413/2801] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:40:44 2022] POST /identity/v3/projects => generated 367 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:40:45.021422 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c776288-929e-48d3-9c50-1fbf2793010d None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:45.032579 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c776288-929e-48d3-9c50-1fbf2793010d None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:45.087300 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bddc5d-87ba-44ff-82ed-e6992a432451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:45.087904 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bddc5d-87ba-44ff-82ed-e6992a432451 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:45.088182 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bddc5d-87ba-44ff-82ed-e6992a432451 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:45.088454 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bddc5d-87ba-44ff-82ed-e6992a432451 admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:45.089873 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bddc5d-87ba-44ff-82ed-e6992a432451 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:45.091929 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bddc5d-87ba-44ff-82ed-e6992a432451 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:45.113232 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1389/2802] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:40:45 2022] POST /identity/v3/users => generated 290 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:40:45.117589 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afc0e90-fd74-4357-86a5-7bdc6add71bd admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:45.128536 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afc0e90-fd74-4357-86a5-7bdc6add71bd admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:45.133132 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7a0fcb-ebe9-4d15-86e9-8d6c641201a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:45.133725 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7a0fcb-ebe9-4d15-86e9-8d6c641201a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:45.134001 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7a0fcb-ebe9-4d15-86e9-8d6c641201a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:45.134268 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7a0fcb-ebe9-4d15-86e9-8d6c641201a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:45.135197 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7a0fcb-ebe9-4d15-86e9-8d6c641201a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:45.137304 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7a0fcb-ebe9-4d15-86e9-8d6c641201a0 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:45.151113 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1414/2803] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:40:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:40:45.153098 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bddc5d-87ba-44ff-82ed-e6992a432451 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:45.164630 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bddc5d-87ba-44ff-82ed-e6992a432451 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:45.169704 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dc77d9-c2e8-40fb-a943-8de07b93d7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:45.170372 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc77d9-c2e8-40fb-a943-8de07b93d7c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:45.170657 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc77d9-c2e8-40fb-a943-8de07b93d7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:45.170961 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc77d9-c2e8-40fb-a943-8de07b93d7c4 admin admin] PATH_INFO: `/v3/projects/2a314541acaa4b9d8b8cc91a3ef413ec/users/ab0b539437ad4eccb1f742674938fa4e/roles/a332ef951db949b0bad7019fbd28a1b9` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:45.187356 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dc77d9-c2e8-40fb-a943-8de07b93d7c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a314541acaa4b9d8b8cc91a3ef413ec, user_id=ab0b539437ad4eccb1f742674938fa4e, role_id=a332ef951db949b0bad7019fbd28a1b9)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:45.190031 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dc77d9-c2e8-40fb-a943-8de07b93d7c4 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:45.203717 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1390/2804] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:40:45 2022] PUT /identity/v3/projects/2a314541acaa4b9d8b8cc91a3ef413ec/users/ab0b539437ad4eccb1f742674938fa4e/roles/a332ef951db949b0bad7019fbd28a1b9 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:40:45.207967 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7a0fcb-ebe9-4d15-86e9-8d6c641201a0 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:45.219474 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7a0fcb-ebe9-4d15-86e9-8d6c641201a0 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:45.274979 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31736b3d-9466-4233-9ca9-bdcec2810d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:45.275626 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31736b3d-9466-4233-9ca9-bdcec2810d0e admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:45.275908 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31736b3d-9466-4233-9ca9-bdcec2810d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:45.276180 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31736b3d-9466-4233-9ca9-bdcec2810d0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:45.276894 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31736b3d-9466-4233-9ca9-bdcec2810d0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:45.278604 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31736b3d-9466-4233-9ca9-bdcec2810d0e admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:45.288381 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1415/2805] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:40:45 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:40:45.292526 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dc77d9-c2e8-40fb-a943-8de07b93d7c4 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:45.302738 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dc77d9-c2e8-40fb-a943-8de07b93d7c4 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:45.307315 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5371d577-3308-4a0e-a2a2-c46385a855e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:45.308474 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371d577-3308-4a0e-a2a2-c46385a855e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:45.308818 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371d577-3308-4a0e-a2a2-c46385a855e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:45.309117 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371d577-3308-4a0e-a2a2-c46385a855e2 admin admin] PATH_INFO: `/v3/projects/2a314541acaa4b9d8b8cc91a3ef413ec/users/ab0b539437ad4eccb1f742674938fa4e/roles/a332ef951db949b0bad7019fbd28a1b9` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:45.311092 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5371d577-3308-4a0e-a2a2-c46385a855e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a314541acaa4b9d8b8cc91a3ef413ec, user_id=ab0b539437ad4eccb1f742674938fa4e, role_id=a332ef951db949b0bad7019fbd28a1b9)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:45.313844 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5371d577-3308-4a0e-a2a2-c46385a855e2 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:45.324583 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1391/2806] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:40:45 2022] PUT /identity/v3/projects/2a314541acaa4b9d8b8cc91a3ef413ec/users/ab0b539437ad4eccb1f742674938fa4e/roles/a332ef951db949b0bad7019fbd28a1b9 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:40:45.334543 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331bdf1b-31d6-406c-bb01-e102aba1c531 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:45.334828 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331bdf1b-31d6-406c-bb01-e102aba1c531 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:45.335309 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331bdf1b-31d6-406c-bb01-e102aba1c531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:45.349153 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:40:45.364603 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-331bdf1b-31d6-406c-bb01-e102aba1c531 None None] MFA Rules not processed for user `ab0b539437ad4eccb1f742674938fa4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:40:45.365831 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-331bdf1b-31d6-406c-bb01-e102aba1c531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:40:45.433998 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1416/2807] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:40:45 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:40:45.444833 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5371d577-3308-4a0e-a2a2-c46385a855e2 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:45.446686 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-5371d577-3308-4a0e-a2a2-c46385a855e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:40:45.505059 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5371d577-3308-4a0e-a2a2-c46385a855e2 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:45.508718 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b2e49e-e2f0-4797-9759-74ec6b742681 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e79503178ac54e62ba385467d5617ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:45.509299 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2e49e-e2f0-4797-9759-74ec6b742681 service cinder] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:45.509575 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2e49e-e2f0-4797-9759-74ec6b742681 service cinder] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:45.509846 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2e49e-e2f0-4797-9759-74ec6b742681 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:45.519538 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b2e49e-e2f0-4797-9759-74ec6b742681 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:45.520955 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b2e49e-e2f0-4797-9759-74ec6b742681 service cinder] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:45.530555 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1392/2808] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:40:45 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:40:47.001863 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331bdf1b-31d6-406c-bb01-e102aba1c531 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:47.068402 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331bdf1b-31d6-406c-bb01-e102aba1c531 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:47.073409 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2320d634-5115-4912-a1c2-1b0087d1da18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:47.074207 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2320d634-5115-4912-a1c2-1b0087d1da18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:47.074490 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2320d634-5115-4912-a1c2-1b0087d1da18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:47.074766 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2320d634-5115-4912-a1c2-1b0087d1da18 admin admin] PATH_INFO: `/v3/users/f8da4c30de2947ff8dafa0961140c9a4` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:47.076009 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2320d634-5115-4912-a1c2-1b0087d1da18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8da4c30de2947ff8dafa0961140c9a4)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:47.077994 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2320d634-5115-4912-a1c2-1b0087d1da18 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:47.146791 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-2320d634-5115-4912-a1c2-1b0087d1da18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8da4c30de2947ff8dafa0961140c9a4'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:47.160354 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-2320d634-5115-4912-a1c2-1b0087d1da18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8da4c30de2947ff8dafa0961140c9a4'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:47.167732 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-2320d634-5115-4912-a1c2-1b0087d1da18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8da4c30de2947ff8dafa0961140c9a4'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:47.168537 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-2320d634-5115-4912-a1c2-1b0087d1da18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8da4c30de2947ff8dafa0961140c9a4'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:47.176776 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-2320d634-5115-4912-a1c2-1b0087d1da18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8da4c30de2947ff8dafa0961140c9a4'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:47.182973 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1417/2809] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:40:47 2022] DELETE /identity/v3/users/f8da4c30de2947ff8dafa0961140c9a4 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:40:47.187986 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85edc7b7-1083-444f-9504-4c49c10ece6b None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:47.188479 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85edc7b7-1083-444f-9504-4c49c10ece6b None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:47.188609 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85edc7b7-1083-444f-9504-4c49c10ece6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:47.209475 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-85edc7b7-1083-444f-9504-4c49c10ece6b None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:40:47.210719 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-85edc7b7-1083-444f-9504-4c49c10ece6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:40:47.224807 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:40:47.274043 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1393/2810] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:40:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:40:47.284682 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2320d634-5115-4912-a1c2-1b0087d1da18 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:47.286185 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-2320d634-5115-4912-a1c2-1b0087d1da18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:40:47.301153 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:40:47.349314 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2320d634-5115-4912-a1c2-1b0087d1da18 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:47.353177 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2669b06e-4f81-482a-ac88-2d011f144694 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:47.354459 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669b06e-4f81-482a-ac88-2d011f144694 service neutron] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:47.354459 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669b06e-4f81-482a-ac88-2d011f144694 service neutron] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:47.354459 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669b06e-4f81-482a-ac88-2d011f144694 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:47.365426 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2669b06e-4f81-482a-ac88-2d011f144694 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:47.366950 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2669b06e-4f81-482a-ac88-2d011f144694 service neutron] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:47.378071 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1418/2811] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:40:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:40:47.695425 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85edc7b7-1083-444f-9504-4c49c10ece6b None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:47.697018 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-85edc7b7-1083-444f-9504-4c49c10ece6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:40:47.711316 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85edc7b7-1083-444f-9504-4c49c10ece6b None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:47.717736 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33823ac1-465b-4931-8df4-9b120f3d92d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:47.718940 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33823ac1-465b-4931-8df4-9b120f3d92d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:47.719407 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33823ac1-465b-4931-8df4-9b120f3d92d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:47.719919 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33823ac1-465b-4931-8df4-9b120f3d92d8 admin admin] PATH_INFO: `/v3/projects/e58978bed4214bdb963c9632c4ee7361` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:47.721331 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33823ac1-465b-4931-8df4-9b120f3d92d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e58978bed4214bdb963c9632c4ee7361)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:47.723499 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33823ac1-465b-4931-8df4-9b120f3d92d8 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:47.780636 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-33823ac1-465b-4931-8df4-9b120f3d92d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e58978bed4214bdb963c9632c4ee7361', 'request_id': 'req-33823ac1-465b-4931-8df4-9b120f3d92d8'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:47.789025 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-33823ac1-465b-4931-8df4-9b120f3d92d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e58978bed4214bdb963c9632c4ee7361', 'request_id': 'req-33823ac1-465b-4931-8df4-9b120f3d92d8'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:47.796183 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-33823ac1-465b-4931-8df4-9b120f3d92d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e58978bed4214bdb963c9632c4ee7361', 'request_id': 'req-33823ac1-465b-4931-8df4-9b120f3d92d8'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:47.811945 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-33823ac1-465b-4931-8df4-9b120f3d92d8 admin admin] The token cache is being invalidate because project e58978bed4214bdb963c9632c4ee7361 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:40:47.812232 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-33823ac1-465b-4931-8df4-9b120f3d92d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:47.813218 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-33823ac1-465b-4931-8df4-9b120f3d92d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:47.815066 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1394/2812] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:40:47 2022] DELETE /identity/v3/projects/e58978bed4214bdb963c9632c4ee7361 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:40:47.819447 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2669b06e-4f81-482a-ac88-2d011f144694 service neutron] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:47.830158 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2669b06e-4f81-482a-ac88-2d011f144694 service neutron] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:47.898128 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ee3efc-d940-44f0-9ff4-1db8f28e2be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:47.899062 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ee3efc-d940-44f0-9ff4-1db8f28e2be6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:47.899530 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ee3efc-d940-44f0-9ff4-1db8f28e2be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:47.899920 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ee3efc-d940-44f0-9ff4-1db8f28e2be6 admin admin] PATH_INFO: `/v3/users/ab0b539437ad4eccb1f742674938fa4e` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:47.901185 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ee3efc-d940-44f0-9ff4-1db8f28e2be6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab0b539437ad4eccb1f742674938fa4e)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:47.903804 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ee3efc-d940-44f0-9ff4-1db8f28e2be6 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:47.958887 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-a1ee3efc-d940-44f0-9ff4-1db8f28e2be6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab0b539437ad4eccb1f742674938fa4e'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:47.973273 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-a1ee3efc-d940-44f0-9ff4-1db8f28e2be6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab0b539437ad4eccb1f742674938fa4e'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:47.981219 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-a1ee3efc-d940-44f0-9ff4-1db8f28e2be6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab0b539437ad4eccb1f742674938fa4e'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:47.982278 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-a1ee3efc-d940-44f0-9ff4-1db8f28e2be6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab0b539437ad4eccb1f742674938fa4e'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:47.990301 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-a1ee3efc-d940-44f0-9ff4-1db8f28e2be6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab0b539437ad4eccb1f742674938fa4e'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:47.998269 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1419/2813] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:40:47 2022] DELETE /identity/v3/users/ab0b539437ad4eccb1f742674938fa4e => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:40:48.300029 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33823ac1-465b-4931-8df4-9b120f3d92d8 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:48.301590 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-33823ac1-465b-4931-8df4-9b120f3d92d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:40:48.317220 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33823ac1-465b-4931-8df4-9b120f3d92d8 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:48.386966 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99c8929-1d38-476a-913c-ed97d77d4590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:48.387630 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c8929-1d38-476a-913c-ed97d77d4590 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:48.387911 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c8929-1d38-476a-913c-ed97d77d4590 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:48.388180 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c8929-1d38-476a-913c-ed97d77d4590 admin admin] PATH_INFO: `/v3/projects/2a314541acaa4b9d8b8cc91a3ef413ec` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:48.389375 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99c8929-1d38-476a-913c-ed97d77d4590 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a314541acaa4b9d8b8cc91a3ef413ec)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:48.391369 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99c8929-1d38-476a-913c-ed97d77d4590 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:48.445521 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:40:48.450049 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-b99c8929-1d38-476a-913c-ed97d77d4590 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a314541acaa4b9d8b8cc91a3ef413ec', 'request_id': 'req-b99c8929-1d38-476a-913c-ed97d77d4590'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:48.461236 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-b99c8929-1d38-476a-913c-ed97d77d4590 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a314541acaa4b9d8b8cc91a3ef413ec', 'request_id': 'req-b99c8929-1d38-476a-913c-ed97d77d4590'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:48.468476 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-b99c8929-1d38-476a-913c-ed97d77d4590 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a314541acaa4b9d8b8cc91a3ef413ec', 'request_id': 'req-b99c8929-1d38-476a-913c-ed97d77d4590'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:48.481044 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-b99c8929-1d38-476a-913c-ed97d77d4590 admin admin] The token cache is being invalidate because project 2a314541acaa4b9d8b8cc91a3ef413ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:40:48.481335 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-b99c8929-1d38-476a-913c-ed97d77d4590 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:48.482007 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-b99c8929-1d38-476a-913c-ed97d77d4590 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:48.483573 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1395/2814] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:40:48 2022] DELETE /identity/v3/projects/2a314541acaa4b9d8b8cc91a3ef413ec => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:40:48.489663 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2790f40-2af4-4fb1-b31e-f177051a0df8 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:48.490177 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2790f40-2af4-4fb1-b31e-f177051a0df8 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:48.490327 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2790f40-2af4-4fb1-b31e-f177051a0df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:48.513127 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-b2790f40-2af4-4fb1-b31e-f177051a0df8 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:40:48.514804 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-b2790f40-2af4-4fb1-b31e-f177051a0df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:40:48.547160 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:40:48.584563 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1420/2815] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:40:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:40:48.595055 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abce8b1-5263-42df-ad14-fbc9637634fa None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:48.595339 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abce8b1-5263-42df-ad14-fbc9637634fa None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:48.595631 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abce8b1-5263-42df-ad14-fbc9637634fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:48.617719 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-0abce8b1-5263-42df-ad14-fbc9637634fa None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:40:48.618998 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-0abce8b1-5263-42df-ad14-fbc9637634fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:40:48.627644 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1396/2816] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:40:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:40:48.632041 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2790f40-2af4-4fb1-b31e-f177051a0df8 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:48.642884 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2790f40-2af4-4fb1-b31e-f177051a0df8 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:48.648307 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e153df9-ef13-4d85-8d3a-2e43fcd17716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:48.648953 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e153df9-ef13-4d85-8d3a-2e43fcd17716 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:48.649234 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e153df9-ef13-4d85-8d3a-2e43fcd17716 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:48.649507 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e153df9-ef13-4d85-8d3a-2e43fcd17716 admin admin] PATH_INFO: `/v3/domains` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:48.650180 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e153df9-ef13-4d85-8d3a-2e43fcd17716 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:40:48.650516 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e153df9-ef13-4d85-8d3a-2e43fcd17716 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:48.653248 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e153df9-ef13-4d85-8d3a-2e43fcd17716 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:48.666802 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1421/2817] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 12:40:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:40:48.671491 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abce8b1-5263-42df-ad14-fbc9637634fa None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:48.683814 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abce8b1-5263-42df-ad14-fbc9637634fa None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:48.691311 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4de6b0-1462-4dbb-817b-9f99b7fafd86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:48.692027 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4de6b0-1462-4dbb-817b-9f99b7fafd86 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:48.692526 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4de6b0-1462-4dbb-817b-9f99b7fafd86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:48.692860 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4de6b0-1462-4dbb-817b-9f99b7fafd86 admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:48.693665 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4de6b0-1462-4dbb-817b-9f99b7fafd86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:48.695835 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4de6b0-1462-4dbb-817b-9f99b7fafd86 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:48.729604 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1397/2818] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:40:48 2022] POST /identity/v3/projects => generated 381 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:40:48.733807 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e153df9-ef13-4d85-8d3a-2e43fcd17716 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:48.744907 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e153df9-ef13-4d85-8d3a-2e43fcd17716 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:48.812703 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87616da9-46ed-41aa-9f65-fe891466ef71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:48.813339 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87616da9-46ed-41aa-9f65-fe891466ef71 admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:48.813653 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87616da9-46ed-41aa-9f65-fe891466ef71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:48.813931 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87616da9-46ed-41aa-9f65-fe891466ef71 admin admin] PATH_INFO: `/v3/users` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:48.814640 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87616da9-46ed-41aa-9f65-fe891466ef71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:48.816876 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87616da9-46ed-41aa-9f65-fe891466ef71 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:48.841533 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1422/2819] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:40:48 2022] POST /identity/v3/users => generated 291 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:40:48.846832 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4de6b0-1462-4dbb-817b-9f99b7fafd86 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:48.858764 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4de6b0-1462-4dbb-817b-9f99b7fafd86 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:48.865093 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3ab37f-c545-456d-bb55-aad3fb8cec7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:48.865724 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ab37f-c545-456d-bb55-aad3fb8cec7d admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:48.866003 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ab37f-c545-456d-bb55-aad3fb8cec7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:48.866297 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ab37f-c545-456d-bb55-aad3fb8cec7d admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:48.867001 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3ab37f-c545-456d-bb55-aad3fb8cec7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:48.868628 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3ab37f-c545-456d-bb55-aad3fb8cec7d admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:48.880377 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1398/2820] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:40:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 12:40:48.884680 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87616da9-46ed-41aa-9f65-fe891466ef71 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:48.896041 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87616da9-46ed-41aa-9f65-fe891466ef71 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:48.900870 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6473f38-7723-4cba-b5c6-697c5d6fdd36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:48.902586 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6473f38-7723-4cba-b5c6-697c5d6fdd36 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:48.903002 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6473f38-7723-4cba-b5c6-697c5d6fdd36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:48.903278 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6473f38-7723-4cba-b5c6-697c5d6fdd36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:48.903943 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6473f38-7723-4cba-b5c6-697c5d6fdd36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:48.905581 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6473f38-7723-4cba-b5c6-697c5d6fdd36 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:48.917777 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1423/2821] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:40:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:40:48.922044 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3ab37f-c545-456d-bb55-aad3fb8cec7d admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:48.932546 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3ab37f-c545-456d-bb55-aad3fb8cec7d admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:48.938889 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b50d4b-dfa1-41f1-91eb-ce371955a358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:48.939568 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b50d4b-dfa1-41f1-91eb-ce371955a358 admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:48.939850 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b50d4b-dfa1-41f1-91eb-ce371955a358 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:48.940129 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b50d4b-dfa1-41f1-91eb-ce371955a358 admin admin] PATH_INFO: `/v3/projects/43f5406ca4ec4d6082369455b088f122/users/9364cd4332874da495015775db13b2f2/roles/b5cfd7a855a448359e9017f51d32b6fc` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:48.958705 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b50d4b-dfa1-41f1-91eb-ce371955a358 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43f5406ca4ec4d6082369455b088f122, user_id=9364cd4332874da495015775db13b2f2, role_id=b5cfd7a855a448359e9017f51d32b6fc)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:48.961445 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b50d4b-dfa1-41f1-91eb-ce371955a358 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:48.977016 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1399/2822] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:40:48 2022] PUT /identity/v3/projects/43f5406ca4ec4d6082369455b088f122/users/9364cd4332874da495015775db13b2f2/roles/b5cfd7a855a448359e9017f51d32b6fc => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:40:49.045692 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a6d938-5fc3-41c0-9a76-c3f0a739047f None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:49.045959 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a6d938-5fc3-41c0-9a76-c3f0a739047f None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:49.046234 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a6d938-5fc3-41c0-9a76-c3f0a739047f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:49.075746 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-09a6d938-5fc3-41c0-9a76-c3f0a739047f None None] MFA Rules not processed for user `9364cd4332874da495015775db13b2f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:40:49.076963 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-09a6d938-5fc3-41c0-9a76-c3f0a739047f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:40:49.143962 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1424/2823] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:40:49 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:40:49.148462 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b50d4b-dfa1-41f1-91eb-ce371955a358 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:49.211262 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b50d4b-dfa1-41f1-91eb-ce371955a358 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:49.216589 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd5de2d-8e5a-4eb1-bacc-1fb55c68ee61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:49.217193 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd5de2d-8e5a-4eb1-bacc-1fb55c68ee61 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:49.217468 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd5de2d-8e5a-4eb1-bacc-1fb55c68ee61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:49.217734 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd5de2d-8e5a-4eb1-bacc-1fb55c68ee61 admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:49.218373 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd5de2d-8e5a-4eb1-bacc-1fb55c68ee61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:49.220294 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd5de2d-8e5a-4eb1-bacc-1fb55c68ee61 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:49.248354 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1400/2824] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:40:49 2022] POST /identity/v3/projects => generated 379 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:40:49.252440 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a6d938-5fc3-41c0-9a76-c3f0a739047f None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:49.263294 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a6d938-5fc3-41c0-9a76-c3f0a739047f None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:49.289659 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:40:49.322834 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdf3405-226b-457e-957f-bdd55e5d4a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:49.323554 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf3405-226b-457e-957f-bdd55e5d4a51 admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:49.323855 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf3405-226b-457e-957f-bdd55e5d4a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:49.324124 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf3405-226b-457e-957f-bdd55e5d4a51 admin admin] PATH_INFO: `/v3/users` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:49.325313 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdf3405-226b-457e-957f-bdd55e5d4a51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:49.326671 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdf3405-226b-457e-957f-bdd55e5d4a51 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:49.348344 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1425/2825] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:40:49 2022] POST /identity/v3/users => generated 296 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:40:49.352742 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd5de2d-8e5a-4eb1-bacc-1fb55c68ee61 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:49.364103 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd5de2d-8e5a-4eb1-bacc-1fb55c68ee61 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:49.369005 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e734542-2f43-4829-99ca-ab3ad542ac56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:49.369907 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e734542-2f43-4829-99ca-ab3ad542ac56 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:49.370187 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e734542-2f43-4829-99ca-ab3ad542ac56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:49.370458 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e734542-2f43-4829-99ca-ab3ad542ac56 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:49.371228 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e734542-2f43-4829-99ca-ab3ad542ac56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:49.372871 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e734542-2f43-4829-99ca-ab3ad542ac56 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:49.384704 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1401/2826] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:40:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 12:40:49.389927 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdf3405-226b-457e-957f-bdd55e5d4a51 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:49.399979 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdf3405-226b-457e-957f-bdd55e5d4a51 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:49.405539 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0cd35d-a643-408e-888c-28a8a03f57fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:49.406253 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0cd35d-a643-408e-888c-28a8a03f57fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:49.406535 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0cd35d-a643-408e-888c-28a8a03f57fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:49.406808 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0cd35d-a643-408e-888c-28a8a03f57fe admin admin] PATH_INFO: `/v3/projects/6c46e08927224807aa94bf64065fce44/users/3cca10f6780145a3a415b441fbe2d69b/roles/a332ef951db949b0bad7019fbd28a1b9` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:49.422717 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0cd35d-a643-408e-888c-28a8a03f57fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c46e08927224807aa94bf64065fce44, user_id=3cca10f6780145a3a415b441fbe2d69b, role_id=a332ef951db949b0bad7019fbd28a1b9)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:49.425411 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0cd35d-a643-408e-888c-28a8a03f57fe admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:49.437953 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1426/2827] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:40:49 2022] PUT /identity/v3/projects/6c46e08927224807aa94bf64065fce44/users/3cca10f6780145a3a415b441fbe2d69b/roles/a332ef951db949b0bad7019fbd28a1b9 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:40:49.444193 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e734542-2f43-4829-99ca-ab3ad542ac56 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:49.455016 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e734542-2f43-4829-99ca-ab3ad542ac56 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:49.496559 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:40:49.513441 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39f9d92-1f8b-4680-b048-ec3c54deeeff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:49.514047 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f9d92-1f8b-4680-b048-ec3c54deeeff admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:49.514347 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f9d92-1f8b-4680-b048-ec3c54deeeff admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:49.514613 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f9d92-1f8b-4680-b048-ec3c54deeeff admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:49.515272 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39f9d92-1f8b-4680-b048-ec3c54deeeff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:49.516851 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39f9d92-1f8b-4680-b048-ec3c54deeeff admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:49.527466 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1402/2828] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:40:49 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:40:49.531827 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0cd35d-a643-408e-888c-28a8a03f57fe admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:49.542000 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0cd35d-a643-408e-888c-28a8a03f57fe admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:49.546523 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db95af0f-7c7e-4da8-b1d8-2f33fbfb8cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:49.547202 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db95af0f-7c7e-4da8-b1d8-2f33fbfb8cfa admin admin] REQUEST_METHOD: `PUT` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:49.547480 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db95af0f-7c7e-4da8-b1d8-2f33fbfb8cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:49.547753 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db95af0f-7c7e-4da8-b1d8-2f33fbfb8cfa admin admin] PATH_INFO: `/v3/projects/6c46e08927224807aa94bf64065fce44/users/3cca10f6780145a3a415b441fbe2d69b/roles/a332ef951db949b0bad7019fbd28a1b9` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:49.549644 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db95af0f-7c7e-4da8-b1d8-2f33fbfb8cfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c46e08927224807aa94bf64065fce44, user_id=3cca10f6780145a3a415b441fbe2d69b, role_id=a332ef951db949b0bad7019fbd28a1b9)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:49.552329 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db95af0f-7c7e-4da8-b1d8-2f33fbfb8cfa admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:49.562657 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1427/2829] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:40:49 2022] PUT /identity/v3/projects/6c46e08927224807aa94bf64065fce44/users/3cca10f6780145a3a415b441fbe2d69b/roles/a332ef951db949b0bad7019fbd28a1b9 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:40:49.572348 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87bc78a-421e-48ba-9543-3596be0e2e99 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:49.572634 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87bc78a-421e-48ba-9543-3596be0e2e99 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:49.572974 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87bc78a-421e-48ba-9543-3596be0e2e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:49.601583 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-b87bc78a-421e-48ba-9543-3596be0e2e99 None None] MFA Rules not processed for user `3cca10f6780145a3a415b441fbe2d69b`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:40:49.602796 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-b87bc78a-421e-48ba-9543-3596be0e2e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:40:49.670847 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1403/2830] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:40:49 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:40:49.683754 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db95af0f-7c7e-4da8-b1d8-2f33fbfb8cfa admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:49.685625 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-db95af0f-7c7e-4da8-b1d8-2f33fbfb8cfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:40:49.746217 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db95af0f-7c7e-4da8-b1d8-2f33fbfb8cfa admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:49.749902 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3856da-efe0-411a-b6be-cfe94d19aabc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e79503178ac54e62ba385467d5617ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:49.750546 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3856da-efe0-411a-b6be-cfe94d19aabc service cinder] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:49.750828 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3856da-efe0-411a-b6be-cfe94d19aabc service cinder] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:49.751128 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3856da-efe0-411a-b6be-cfe94d19aabc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:49.761776 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3856da-efe0-411a-b6be-cfe94d19aabc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:49.763453 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3856da-efe0-411a-b6be-cfe94d19aabc service cinder] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:49.775078 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1428/2831] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:40:49 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:40:50.088566 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87bc78a-421e-48ba-9543-3596be0e2e99 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:50.099216 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87bc78a-421e-48ba-9543-3596be0e2e99 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:50.103820 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb5c6d7-1f34-43e1-89d6-7b6c4ea72d9c tempest-VolumeQuotaClassesTest-395534029 tempest-VolumeQuotaClassesTest-395534029-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cca10f6780145a3a415b441fbe2d69b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c46e08927224807aa94bf64065fce44', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:50.104416 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5c6d7-1f34-43e1-89d6-7b6c4ea72d9c tempest-VolumeQuotaClassesTest-395534029 tempest-VolumeQuotaClassesTest-395534029-project-admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:50.104700 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5c6d7-1f34-43e1-89d6-7b6c4ea72d9c tempest-VolumeQuotaClassesTest-395534029 tempest-VolumeQuotaClassesTest-395534029-project-admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:50.104998 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5c6d7-1f34-43e1-89d6-7b6c4ea72d9c tempest-VolumeQuotaClassesTest-395534029 tempest-VolumeQuotaClassesTest-395534029-project-admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:50.105637 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb5c6d7-1f34-43e1-89d6-7b6c4ea72d9c tempest-VolumeQuotaClassesTest-395534029 tempest-VolumeQuotaClassesTest-395534029-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:40:50.105933 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb5c6d7-1f34-43e1-89d6-7b6c4ea72d9c tempest-VolumeQuotaClassesTest-395534029 tempest-VolumeQuotaClassesTest-395534029-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:50.107709 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb5c6d7-1f34-43e1-89d6-7b6c4ea72d9c tempest-VolumeQuotaClassesTest-395534029 tempest-VolumeQuotaClassesTest-395534029-project-admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:50.119184 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1404/2832] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 12:40:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:40:50.124132 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3856da-efe0-411a-b6be-cfe94d19aabc service cinder] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:50.133266 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3856da-efe0-411a-b6be-cfe94d19aabc service cinder] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:50.138950 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3806ef28-f5e5-4b65-bf4c-d167f2d01ea8 tempest-VolumeQuotaClassesTest-395534029 tempest-VolumeQuotaClassesTest-395534029-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cca10f6780145a3a415b441fbe2d69b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c46e08927224807aa94bf64065fce44', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:50.139543 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3806ef28-f5e5-4b65-bf4c-d167f2d01ea8 tempest-VolumeQuotaClassesTest-395534029 tempest-VolumeQuotaClassesTest-395534029-project-admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:50.139824 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3806ef28-f5e5-4b65-bf4c-d167f2d01ea8 tempest-VolumeQuotaClassesTest-395534029 tempest-VolumeQuotaClassesTest-395534029-project-admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:50.140093 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3806ef28-f5e5-4b65-bf4c-d167f2d01ea8 tempest-VolumeQuotaClassesTest-395534029 tempest-VolumeQuotaClassesTest-395534029-project-admin] PATH_INFO: `/v3/projects` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:50.140723 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3806ef28-f5e5-4b65-bf4c-d167f2d01ea8 tempest-VolumeQuotaClassesTest-395534029 tempest-VolumeQuotaClassesTest-395534029-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:50.142580 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3806ef28-f5e5-4b65-bf4c-d167f2d01ea8 tempest-VolumeQuotaClassesTest-395534029 tempest-VolumeQuotaClassesTest-395534029-project-admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:50.171501 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1429/2833] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:40:50 2022] POST /identity/v3/projects => generated 354 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:40:50.175781 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb5c6d7-1f34-43e1-89d6-7b6c4ea72d9c tempest-VolumeQuotaClassesTest-395534029 tempest-VolumeQuotaClassesTest-395534029-project-admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:50.185881 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb5c6d7-1f34-43e1-89d6-7b6c4ea72d9c tempest-VolumeQuotaClassesTest-395534029 tempest-VolumeQuotaClassesTest-395534029-project-admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:50.242453 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd4aceb-de2f-4a37-ac94-dc4d60b14085 tempest-VolumeQuotaClassesTest-395534029 tempest-VolumeQuotaClassesTest-395534029-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cca10f6780145a3a415b441fbe2d69b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c46e08927224807aa94bf64065fce44', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:50.243089 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd4aceb-de2f-4a37-ac94-dc4d60b14085 tempest-VolumeQuotaClassesTest-395534029 tempest-VolumeQuotaClassesTest-395534029-project-admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:50.243371 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd4aceb-de2f-4a37-ac94-dc4d60b14085 tempest-VolumeQuotaClassesTest-395534029 tempest-VolumeQuotaClassesTest-395534029-project-admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:50.243635 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd4aceb-de2f-4a37-ac94-dc4d60b14085 tempest-VolumeQuotaClassesTest-395534029 tempest-VolumeQuotaClassesTest-395534029-project-admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:50.244277 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd4aceb-de2f-4a37-ac94-dc4d60b14085 tempest-VolumeQuotaClassesTest-395534029 tempest-VolumeQuotaClassesTest-395534029-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:40:50.244840 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd4aceb-de2f-4a37-ac94-dc4d60b14085 tempest-VolumeQuotaClassesTest-395534029 tempest-VolumeQuotaClassesTest-395534029-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:50.246428 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd4aceb-de2f-4a37-ac94-dc4d60b14085 tempest-VolumeQuotaClassesTest-395534029 tempest-VolumeQuotaClassesTest-395534029-project-admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:50.258371 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1405/2834] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 12:40:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:40:50.295536 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3806ef28-f5e5-4b65-bf4c-d167f2d01ea8 tempest-VolumeQuotaClassesTest-395534029 tempest-VolumeQuotaClassesTest-395534029-project-admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:50.305580 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3806ef28-f5e5-4b65-bf4c-d167f2d01ea8 tempest-VolumeQuotaClassesTest-395534029 tempest-VolumeQuotaClassesTest-395534029-project-admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:50.310113 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581186a4-470b-46cd-afad-03b4e260e23b tempest-VolumeQuotaClassesTest-395534029 tempest-VolumeQuotaClassesTest-395534029-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cca10f6780145a3a415b441fbe2d69b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c46e08927224807aa94bf64065fce44', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:50.310733 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581186a4-470b-46cd-afad-03b4e260e23b tempest-VolumeQuotaClassesTest-395534029 tempest-VolumeQuotaClassesTest-395534029-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:50.311051 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581186a4-470b-46cd-afad-03b4e260e23b tempest-VolumeQuotaClassesTest-395534029 tempest-VolumeQuotaClassesTest-395534029-project-admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:50.311321 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581186a4-470b-46cd-afad-03b4e260e23b tempest-VolumeQuotaClassesTest-395534029 tempest-VolumeQuotaClassesTest-395534029-project-admin] PATH_INFO: `/v3/projects/3a6452004f4148e68786804afbb599f4` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:50.312438 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581186a4-470b-46cd-afad-03b4e260e23b tempest-VolumeQuotaClassesTest-395534029 tempest-VolumeQuotaClassesTest-395534029-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3a6452004f4148e68786804afbb599f4)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:50.314356 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581186a4-470b-46cd-afad-03b4e260e23b tempest-VolumeQuotaClassesTest-395534029 tempest-VolumeQuotaClassesTest-395534029-project-admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:50.362507 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-581186a4-470b-46cd-afad-03b4e260e23b tempest-VolumeQuotaClassesTest-395534029 tempest-VolumeQuotaClassesTest-395534029-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a6452004f4148e68786804afbb599f4', 'request_id': 'req-581186a4-470b-46cd-afad-03b4e260e23b'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:50.370287 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-581186a4-470b-46cd-afad-03b4e260e23b tempest-VolumeQuotaClassesTest-395534029 tempest-VolumeQuotaClassesTest-395534029-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a6452004f4148e68786804afbb599f4', 'request_id': 'req-581186a4-470b-46cd-afad-03b4e260e23b'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:50.372149 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=88,keystone:INSERT=7,keystone:DELETE=5 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:40:50.379121 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-581186a4-470b-46cd-afad-03b4e260e23b tempest-VolumeQuotaClassesTest-395534029 tempest-VolumeQuotaClassesTest-395534029-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a6452004f4148e68786804afbb599f4', 'request_id': 'req-581186a4-470b-46cd-afad-03b4e260e23b'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:50.390527 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-581186a4-470b-46cd-afad-03b4e260e23b tempest-VolumeQuotaClassesTest-395534029 tempest-VolumeQuotaClassesTest-395534029-project-admin] The token cache is being invalidate because project 3a6452004f4148e68786804afbb599f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:40:50.390817 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-581186a4-470b-46cd-afad-03b4e260e23b tempest-VolumeQuotaClassesTest-395534029 tempest-VolumeQuotaClassesTest-395534029-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:50.391516 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-581186a4-470b-46cd-afad-03b4e260e23b tempest-VolumeQuotaClassesTest-395534029 tempest-VolumeQuotaClassesTest-395534029-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:50.393023 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1430/2835] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:40:50 2022] DELETE /identity/v3/projects/3a6452004f4148e68786804afbb599f4 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:40:50.590978 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd4aceb-de2f-4a37-ac94-dc4d60b14085 tempest-VolumeQuotaClassesTest-395534029 tempest-VolumeQuotaClassesTest-395534029-project-admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:50.592743 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-ffd4aceb-de2f-4a37-ac94-dc4d60b14085 tempest-VolumeQuotaClassesTest-395534029 tempest-VolumeQuotaClassesTest-395534029-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:40:50.640325 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:40:50.657448 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd4aceb-de2f-4a37-ac94-dc4d60b14085 tempest-VolumeQuotaClassesTest-395534029 tempest-VolumeQuotaClassesTest-395534029-project-admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:50.712585 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f40c1a3-703a-4d71-b632-dffe0ed5cce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:50.713217 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f40c1a3-703a-4d71-b632-dffe0ed5cce5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:50.713495 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f40c1a3-703a-4d71-b632-dffe0ed5cce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:50.713766 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f40c1a3-703a-4d71-b632-dffe0ed5cce5 admin admin] PATH_INFO: `/v3/users/9364cd4332874da495015775db13b2f2` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:50.715479 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f40c1a3-703a-4d71-b632-dffe0ed5cce5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9364cd4332874da495015775db13b2f2)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:50.717694 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f40c1a3-703a-4d71-b632-dffe0ed5cce5 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:50.765054 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-3f40c1a3-703a-4d71-b632-dffe0ed5cce5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9364cd4332874da495015775db13b2f2'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:50.784830 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-3f40c1a3-703a-4d71-b632-dffe0ed5cce5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9364cd4332874da495015775db13b2f2'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:50.785585 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-3f40c1a3-703a-4d71-b632-dffe0ed5cce5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9364cd4332874da495015775db13b2f2'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:50.792523 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-3f40c1a3-703a-4d71-b632-dffe0ed5cce5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9364cd4332874da495015775db13b2f2'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:50.793705 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-3f40c1a3-703a-4d71-b632-dffe0ed5cce5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9364cd4332874da495015775db13b2f2'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:50.807462 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1406/2836] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:40:50 2022] DELETE /identity/v3/users/9364cd4332874da495015775db13b2f2 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:40:50.812085 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a807f-1797-4cc7-8809-f9eff92e4c0c None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:50.812697 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a807f-1797-4cc7-8809-f9eff92e4c0c None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:50.812697 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a807f-1797-4cc7-8809-f9eff92e4c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:50.832344 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-4e4a807f-1797-4cc7-8809-f9eff92e4c0c None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:40:50.833684 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-4e4a807f-1797-4cc7-8809-f9eff92e4c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:40:50.901323 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1431/2837] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:40:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:40:50.911722 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f40c1a3-703a-4d71-b632-dffe0ed5cce5 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:50.913136 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-3f40c1a3-703a-4d71-b632-dffe0ed5cce5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:40:50.976849 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f40c1a3-703a-4d71-b632-dffe0ed5cce5 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:50.981066 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b8dd00-fcfc-471e-ae9d-50a9810f4213 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:50.981688 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b8dd00-fcfc-471e-ae9d-50a9810f4213 service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:50.981973 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b8dd00-fcfc-471e-ae9d-50a9810f4213 service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:50.982250 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b8dd00-fcfc-471e-ae9d-50a9810f4213 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:50.991550 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b8dd00-fcfc-471e-ae9d-50a9810f4213 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:50.992980 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b8dd00-fcfc-471e-ae9d-50a9810f4213 service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:51.003651 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1407/2838] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:40:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:40:51.270650 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a807f-1797-4cc7-8809-f9eff92e4c0c None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:51.272124 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-4e4a807f-1797-4cc7-8809-f9eff92e4c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:40:51.287122 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a807f-1797-4cc7-8809-f9eff92e4c0c None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:51.292402 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba94fef-1a65-4b7e-a82d-f8ddc0006bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:51.293203 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba94fef-1a65-4b7e-a82d-f8ddc0006bf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:51.293378 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba94fef-1a65-4b7e-a82d-f8ddc0006bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:51.293649 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba94fef-1a65-4b7e-a82d-f8ddc0006bf7 admin admin] PATH_INFO: `/v3/projects/43f5406ca4ec4d6082369455b088f122` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:51.295044 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba94fef-1a65-4b7e-a82d-f8ddc0006bf7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43f5406ca4ec4d6082369455b088f122)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:51.296970 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba94fef-1a65-4b7e-a82d-f8ddc0006bf7 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:51.345799 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-cba94fef-1a65-4b7e-a82d-f8ddc0006bf7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43f5406ca4ec4d6082369455b088f122', 'request_id': 'req-cba94fef-1a65-4b7e-a82d-f8ddc0006bf7'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:51.353238 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-cba94fef-1a65-4b7e-a82d-f8ddc0006bf7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43f5406ca4ec4d6082369455b088f122', 'request_id': 'req-cba94fef-1a65-4b7e-a82d-f8ddc0006bf7'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:51.359939 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-cba94fef-1a65-4b7e-a82d-f8ddc0006bf7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43f5406ca4ec4d6082369455b088f122', 'request_id': 'req-cba94fef-1a65-4b7e-a82d-f8ddc0006bf7'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:51.370350 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-cba94fef-1a65-4b7e-a82d-f8ddc0006bf7 admin admin] The token cache is being invalidate because project 43f5406ca4ec4d6082369455b088f122 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:40:51.370634 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-cba94fef-1a65-4b7e-a82d-f8ddc0006bf7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:51.372007 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-cba94fef-1a65-4b7e-a82d-f8ddc0006bf7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:51.373683 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1432/2839] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:40:51 2022] DELETE /identity/v3/projects/43f5406ca4ec4d6082369455b088f122 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:40:51.377730 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b8dd00-fcfc-471e-ae9d-50a9810f4213 service neutron] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:51.387893 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b8dd00-fcfc-471e-ae9d-50a9810f4213 service neutron] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:51.399052 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:40:51.451515 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14343ed-75b5-406b-93c2-3a9ada0ff9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:51.452153 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14343ed-75b5-406b-93c2-3a9ada0ff9da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:51.452432 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14343ed-75b5-406b-93c2-3a9ada0ff9da admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:51.452703 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14343ed-75b5-406b-93c2-3a9ada0ff9da admin admin] PATH_INFO: `/v3/users/3cca10f6780145a3a415b441fbe2d69b` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:51.453825 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14343ed-75b5-406b-93c2-3a9ada0ff9da admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cca10f6780145a3a415b441fbe2d69b)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:51.455803 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14343ed-75b5-406b-93c2-3a9ada0ff9da admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:51.502230 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-a14343ed-75b5-406b-93c2-3a9ada0ff9da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cca10f6780145a3a415b441fbe2d69b'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:51.514437 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-a14343ed-75b5-406b-93c2-3a9ada0ff9da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cca10f6780145a3a415b441fbe2d69b'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:51.515124 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-a14343ed-75b5-406b-93c2-3a9ada0ff9da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cca10f6780145a3a415b441fbe2d69b'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:51.522290 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-a14343ed-75b5-406b-93c2-3a9ada0ff9da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cca10f6780145a3a415b441fbe2d69b'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:51.522936 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-a14343ed-75b5-406b-93c2-3a9ada0ff9da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cca10f6780145a3a415b441fbe2d69b'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:51.535795 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1408/2840] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:40:51 2022] DELETE /identity/v3/users/3cca10f6780145a3a415b441fbe2d69b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:40:51.816838 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba94fef-1a65-4b7e-a82d-f8ddc0006bf7 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:51.818582 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-cba94fef-1a65-4b7e-a82d-f8ddc0006bf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:40:51.832611 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba94fef-1a65-4b7e-a82d-f8ddc0006bf7 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:51.894046 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c5b8f9-ffc6-4c24-99c7-9e7cf0fc25fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:51.894687 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c5b8f9-ffc6-4c24-99c7-9e7cf0fc25fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:51.895008 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c5b8f9-ffc6-4c24-99c7-9e7cf0fc25fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:51.895286 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c5b8f9-ffc6-4c24-99c7-9e7cf0fc25fe admin admin] PATH_INFO: `/v3/projects/6c46e08927224807aa94bf64065fce44` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:51.896411 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c5b8f9-ffc6-4c24-99c7-9e7cf0fc25fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c46e08927224807aa94bf64065fce44)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:51.898324 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c5b8f9-ffc6-4c24-99c7-9e7cf0fc25fe admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:51.909989 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:40:51.946041 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-83c5b8f9-ffc6-4c24-99c7-9e7cf0fc25fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c46e08927224807aa94bf64065fce44', 'request_id': 'req-83c5b8f9-ffc6-4c24-99c7-9e7cf0fc25fe'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:51.954518 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-83c5b8f9-ffc6-4c24-99c7-9e7cf0fc25fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c46e08927224807aa94bf64065fce44', 'request_id': 'req-83c5b8f9-ffc6-4c24-99c7-9e7cf0fc25fe'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:51.960628 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-83c5b8f9-ffc6-4c24-99c7-9e7cf0fc25fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c46e08927224807aa94bf64065fce44', 'request_id': 'req-83c5b8f9-ffc6-4c24-99c7-9e7cf0fc25fe'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:51.975095 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-83c5b8f9-ffc6-4c24-99c7-9e7cf0fc25fe admin admin] The token cache is being invalidate because project 6c46e08927224807aa94bf64065fce44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:40:51.975473 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-83c5b8f9-ffc6-4c24-99c7-9e7cf0fc25fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:51.976454 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-83c5b8f9-ffc6-4c24-99c7-9e7cf0fc25fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:51.980011 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1433/2841] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:40:51 2022] DELETE /identity/v3/projects/6c46e08927224807aa94bf64065fce44 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:40:51.985813 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e3a6e8-5488-4e8b-9362-63a7f7b4afff None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:51.986379 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e3a6e8-5488-4e8b-9362-63a7f7b4afff None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:51.987248 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e3a6e8-5488-4e8b-9362-63a7f7b4afff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:52.014113 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-70e3a6e8-5488-4e8b-9362-63a7f7b4afff None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:40:52.015472 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-70e3a6e8-5488-4e8b-9362-63a7f7b4afff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:40:52.077398 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1409/2842] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:40:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:40:52.086419 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f312be-22f9-4361-bfff-d51d06489af6 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:52.086702 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f312be-22f9-4361-bfff-d51d06489af6 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:52.087009 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f312be-22f9-4361-bfff-d51d06489af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:52.107951 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-19f312be-22f9-4361-bfff-d51d06489af6 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:40:52.109188 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-19f312be-22f9-4361-bfff-d51d06489af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:40:52.117129 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1434/2843] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:40:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:40:52.121955 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e3a6e8-5488-4e8b-9362-63a7f7b4afff None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:52.131641 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e3a6e8-5488-4e8b-9362-63a7f7b4afff None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:52.136154 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e805e98-4d75-4c82-8b6a-27a6058ac424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:52.136780 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e805e98-4d75-4c82-8b6a-27a6058ac424 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:52.137139 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e805e98-4d75-4c82-8b6a-27a6058ac424 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:52.137774 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e805e98-4d75-4c82-8b6a-27a6058ac424 admin admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:52.138175 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e805e98-4d75-4c82-8b6a-27a6058ac424 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:40:52.138450 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e805e98-4d75-4c82-8b6a-27a6058ac424 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:52.140055 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e805e98-4d75-4c82-8b6a-27a6058ac424 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:52.151888 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1410/2844] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 12:40:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:40:52.156880 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f312be-22f9-4361-bfff-d51d06489af6 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:52.166046 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f312be-22f9-4361-bfff-d51d06489af6 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:52.171428 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12982131-d97c-409e-a747-aef88fea73b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:52.172030 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12982131-d97c-409e-a747-aef88fea73b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:52.172308 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12982131-d97c-409e-a747-aef88fea73b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:52.172578 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12982131-d97c-409e-a747-aef88fea73b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:52.173217 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12982131-d97c-409e-a747-aef88fea73b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:52.175145 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12982131-d97c-409e-a747-aef88fea73b4 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:52.201995 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1435/2845] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:40:52 2022] POST /identity/v3/projects => generated 359 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:40:52.206263 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e805e98-4d75-4c82-8b6a-27a6058ac424 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:52.217739 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e805e98-4d75-4c82-8b6a-27a6058ac424 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:52.237174 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:40:52.276473 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ff6b79-e71e-4243-8b36-22e00ddc990b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:52.277080 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff6b79-e71e-4243-8b36-22e00ddc990b admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:52.277898 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff6b79-e71e-4243-8b36-22e00ddc990b admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:52.278312 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff6b79-e71e-4243-8b36-22e00ddc990b admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:52.279061 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ff6b79-e71e-4243-8b36-22e00ddc990b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:52.280968 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ff6b79-e71e-4243-8b36-22e00ddc990b admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:52.302708 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1411/2846] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:40:52 2022] POST /identity/v3/users => generated 280 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:40:52.307738 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12982131-d97c-409e-a747-aef88fea73b4 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:52.318453 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12982131-d97c-409e-a747-aef88fea73b4 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:52.323824 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5820e1-8575-4506-8f6d-99b25c39ed12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:52.325024 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5820e1-8575-4506-8f6d-99b25c39ed12 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:52.325360 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5820e1-8575-4506-8f6d-99b25c39ed12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:52.325819 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5820e1-8575-4506-8f6d-99b25c39ed12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:52.326453 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5820e1-8575-4506-8f6d-99b25c39ed12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:52.328235 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5820e1-8575-4506-8f6d-99b25c39ed12 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:52.338482 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1436/2847] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:40:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:40:52.343348 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ff6b79-e71e-4243-8b36-22e00ddc990b admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:52.353593 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ff6b79-e71e-4243-8b36-22e00ddc990b admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:52.358278 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348a0e20-b0cb-4576-94c0-6201af18fe3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:52.358910 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a0e20-b0cb-4576-94c0-6201af18fe3b admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:52.359195 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a0e20-b0cb-4576-94c0-6201af18fe3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:52.359473 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a0e20-b0cb-4576-94c0-6201af18fe3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:52.360109 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348a0e20-b0cb-4576-94c0-6201af18fe3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:52.361715 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348a0e20-b0cb-4576-94c0-6201af18fe3b admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:52.372818 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1412/2848] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:40:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:40:52.376948 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5820e1-8575-4506-8f6d-99b25c39ed12 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:52.387248 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5820e1-8575-4506-8f6d-99b25c39ed12 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:52.391866 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db04150-af0c-4d6d-9680-7c82dc16c356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:52.392508 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db04150-af0c-4d6d-9680-7c82dc16c356 admin admin] REQUEST_METHOD: `PUT` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:52.392789 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db04150-af0c-4d6d-9680-7c82dc16c356 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:52.393061 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db04150-af0c-4d6d-9680-7c82dc16c356 admin admin] PATH_INFO: `/v3/projects/84e65a58dcae4ded8ff8f85220530985/users/522d83a820484004b0c6151a70dc126b/roles/b5cfd7a855a448359e9017f51d32b6fc` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:52.408211 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db04150-af0c-4d6d-9680-7c82dc16c356 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84e65a58dcae4ded8ff8f85220530985, user_id=522d83a820484004b0c6151a70dc126b, role_id=b5cfd7a855a448359e9017f51d32b6fc)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:52.410868 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db04150-af0c-4d6d-9680-7c82dc16c356 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:52.423769 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1437/2849] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:40:52 2022] PUT /identity/v3/projects/84e65a58dcae4ded8ff8f85220530985/users/522d83a820484004b0c6151a70dc126b/roles/b5cfd7a855a448359e9017f51d32b6fc => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:40:52.433806 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd6015a-a146-4c67-a551-9c60a742933e None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:52.434352 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd6015a-a146-4c67-a551-9c60a742933e None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:52.434624 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd6015a-a146-4c67-a551-9c60a742933e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:52.463135 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-9cd6015a-a146-4c67-a551-9c60a742933e None None] MFA Rules not processed for user `522d83a820484004b0c6151a70dc126b`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:40:52.464299 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-9cd6015a-a146-4c67-a551-9c60a742933e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:40:52.529362 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1413/2850] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:40:52 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:40:52.562493 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db04150-af0c-4d6d-9680-7c82dc16c356 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:52.564235 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-1db04150-af0c-4d6d-9680-7c82dc16c356 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:40:52.621369 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db04150-af0c-4d6d-9680-7c82dc16c356 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:52.625009 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e962a3f-14e8-4ed3-b5ec-6cc83543f081 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e79503178ac54e62ba385467d5617ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:52.625622 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e962a3f-14e8-4ed3-b5ec-6cc83543f081 service cinder] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:52.625902 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e962a3f-14e8-4ed3-b5ec-6cc83543f081 service cinder] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:52.626173 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e962a3f-14e8-4ed3-b5ec-6cc83543f081 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:52.634330 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e962a3f-14e8-4ed3-b5ec-6cc83543f081 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:52.635784 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e962a3f-14e8-4ed3-b5ec-6cc83543f081 service cinder] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:52.645101 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1438/2851] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:40:52 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:40:52.661535 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd6015a-a146-4c67-a551-9c60a742933e None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:52.729383 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd6015a-a146-4c67-a551-9c60a742933e None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:52.733900 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1596b2-f729-4e4c-9cb1-a68d7d6012e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:52.734525 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1596b2-f729-4e4c-9cb1-a68d7d6012e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:52.734803 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1596b2-f729-4e4c-9cb1-a68d7d6012e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:52.735104 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1596b2-f729-4e4c-9cb1-a68d7d6012e6 admin admin] PATH_INFO: `/v3/users/522d83a820484004b0c6151a70dc126b` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:52.736235 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1596b2-f729-4e4c-9cb1-a68d7d6012e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=522d83a820484004b0c6151a70dc126b)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:52.738178 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1596b2-f729-4e4c-9cb1-a68d7d6012e6 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:52.773927 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:40:52.790033 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-ca1596b2-f729-4e4c-9cb1-a68d7d6012e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '522d83a820484004b0c6151a70dc126b'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:52.802247 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-ca1596b2-f729-4e4c-9cb1-a68d7d6012e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '522d83a820484004b0c6151a70dc126b'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:52.802969 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-ca1596b2-f729-4e4c-9cb1-a68d7d6012e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '522d83a820484004b0c6151a70dc126b'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:52.810479 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-ca1596b2-f729-4e4c-9cb1-a68d7d6012e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '522d83a820484004b0c6151a70dc126b'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:52.811130 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-ca1596b2-f729-4e4c-9cb1-a68d7d6012e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '522d83a820484004b0c6151a70dc126b'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:52.825227 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1414/2852] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:40:52 2022] DELETE /identity/v3/users/522d83a820484004b0c6151a70dc126b => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:40:52.829862 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3770bf-db69-4d02-add0-0438f4d2a97e None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:52.830341 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3770bf-db69-4d02-add0-0438f4d2a97e None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:52.830441 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3770bf-db69-4d02-add0-0438f4d2a97e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:52.849092 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-ff3770bf-db69-4d02-add0-0438f4d2a97e None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:40:52.850285 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-ff3770bf-db69-4d02-add0-0438f4d2a97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:40:52.884509 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:40:52.913399 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1439/2853] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:40:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:40:52.923340 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1596b2-f729-4e4c-9cb1-a68d7d6012e6 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:52.924742 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-ca1596b2-f729-4e4c-9cb1-a68d7d6012e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:40:52.983393 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1596b2-f729-4e4c-9cb1-a68d7d6012e6 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:52.987016 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8996d2cf-0035-425c-99d4-7c5e1bbaba84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:52.987630 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996d2cf-0035-425c-99d4-7c5e1bbaba84 service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:52.987908 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996d2cf-0035-425c-99d4-7c5e1bbaba84 service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:52.988180 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996d2cf-0035-425c-99d4-7c5e1bbaba84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:52.998569 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8996d2cf-0035-425c-99d4-7c5e1bbaba84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:53.000052 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8996d2cf-0035-425c-99d4-7c5e1bbaba84 service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:53.009973 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1415/2854] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:40:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:40:53.300047 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3770bf-db69-4d02-add0-0438f4d2a97e None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:53.301622 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-ff3770bf-db69-4d02-add0-0438f4d2a97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:40:53.314579 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3770bf-db69-4d02-add0-0438f4d2a97e None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:53.320378 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4445c3-35c4-41ef-92b8-437abd088090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:53.321127 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4445c3-35c4-41ef-92b8-437abd088090 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:53.321402 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4445c3-35c4-41ef-92b8-437abd088090 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:53.321667 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4445c3-35c4-41ef-92b8-437abd088090 admin admin] PATH_INFO: `/v3/projects/84e65a58dcae4ded8ff8f85220530985` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:53.322932 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4445c3-35c4-41ef-92b8-437abd088090 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84e65a58dcae4ded8ff8f85220530985)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:53.325396 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4445c3-35c4-41ef-92b8-437abd088090 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:53.373157 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-fa4445c3-35c4-41ef-92b8-437abd088090 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84e65a58dcae4ded8ff8f85220530985', 'request_id': 'req-fa4445c3-35c4-41ef-92b8-437abd088090'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:53.380506 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-fa4445c3-35c4-41ef-92b8-437abd088090 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84e65a58dcae4ded8ff8f85220530985', 'request_id': 'req-fa4445c3-35c4-41ef-92b8-437abd088090'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:53.387329 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-fa4445c3-35c4-41ef-92b8-437abd088090 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84e65a58dcae4ded8ff8f85220530985', 'request_id': 'req-fa4445c3-35c4-41ef-92b8-437abd088090'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:53.397902 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-fa4445c3-35c4-41ef-92b8-437abd088090 admin admin] The token cache is being invalidate because project 84e65a58dcae4ded8ff8f85220530985 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:40:53.398184 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-fa4445c3-35c4-41ef-92b8-437abd088090 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:53.398832 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-fa4445c3-35c4-41ef-92b8-437abd088090 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:40:53.400313 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1440/2855] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:40:53 2022] DELETE /identity/v3/projects/84e65a58dcae4ded8ff8f85220530985 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:40:53.406088 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dd9c7d-dc9f-4aab-8666-15e265ca49db None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:53.406373 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dd9c7d-dc9f-4aab-8666-15e265ca49db None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:53.406646 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dd9c7d-dc9f-4aab-8666-15e265ca49db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:53.426078 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-29dd9c7d-dc9f-4aab-8666-15e265ca49db None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:40:53.427334 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-29dd9c7d-dc9f-4aab-8666-15e265ca49db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:40:53.488481 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1416/2856] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:40:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:40:53.497080 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a112e52-30bb-4069-937b-b41aebaf0dea None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:53.497294 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a112e52-30bb-4069-937b-b41aebaf0dea None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:53.497565 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a112e52-30bb-4069-937b-b41aebaf0dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:53.518469 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-6a112e52-30bb-4069-937b-b41aebaf0dea None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:40:53.519730 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-6a112e52-30bb-4069-937b-b41aebaf0dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:40:53.528008 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1441/2857] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:40:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:40:53.532260 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dd9c7d-dc9f-4aab-8666-15e265ca49db None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:53.542055 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dd9c7d-dc9f-4aab-8666-15e265ca49db None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:53.546634 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f04b99-4f5d-4747-9476-6014e26925e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:53.547270 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f04b99-4f5d-4747-9476-6014e26925e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:53.547550 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f04b99-4f5d-4747-9476-6014e26925e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:53.547818 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f04b99-4f5d-4747-9476-6014e26925e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:53.548457 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f04b99-4f5d-4747-9476-6014e26925e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:40:53.548757 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f04b99-4f5d-4747-9476-6014e26925e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:53.550345 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f04b99-4f5d-4747-9476-6014e26925e6 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:53.562286 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1417/2858] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 12:40:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:40:53.566558 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a112e52-30bb-4069-937b-b41aebaf0dea None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:53.576843 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a112e52-30bb-4069-937b-b41aebaf0dea None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:53.581572 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be954ab-12f5-4142-8996-67bb069c22d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:53.582175 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be954ab-12f5-4142-8996-67bb069c22d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:53.582454 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be954ab-12f5-4142-8996-67bb069c22d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:53.582726 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be954ab-12f5-4142-8996-67bb069c22d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:53.583408 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be954ab-12f5-4142-8996-67bb069c22d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:53.585297 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be954ab-12f5-4142-8996-67bb069c22d7 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:53.611930 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1442/2859] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:40:53 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:40:53.616162 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f04b99-4f5d-4747-9476-6014e26925e6 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:53.627534 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f04b99-4f5d-4747-9476-6014e26925e6 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:53.665609 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:40:53.687937 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc011260-389b-4adf-a0d5-b4ebb604eaf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:53.688617 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc011260-389b-4adf-a0d5-b4ebb604eaf8 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:53.688903 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc011260-389b-4adf-a0d5-b4ebb604eaf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:53.689172 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc011260-389b-4adf-a0d5-b4ebb604eaf8 admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:53.689810 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc011260-389b-4adf-a0d5-b4ebb604eaf8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:53.691771 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc011260-389b-4adf-a0d5-b4ebb604eaf8 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:53.713702 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1418/2860] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:40:53 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:40:53.717995 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be954ab-12f5-4142-8996-67bb069c22d7 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:53.728628 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be954ab-12f5-4142-8996-67bb069c22d7 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:53.733420 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a7f28-fbcf-41dc-a609-f936b6fb0dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:53.734070 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a7f28-fbcf-41dc-a609-f936b6fb0dc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:53.734351 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a7f28-fbcf-41dc-a609-f936b6fb0dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:53.734625 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a7f28-fbcf-41dc-a609-f936b6fb0dc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:53.735308 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2a7f28-fbcf-41dc-a609-f936b6fb0dc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:53.736911 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2a7f28-fbcf-41dc-a609-f936b6fb0dc1 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:53.748158 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1443/2861] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:40:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:40:53.752282 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc011260-389b-4adf-a0d5-b4ebb604eaf8 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:53.762783 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc011260-389b-4adf-a0d5-b4ebb604eaf8 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:53.767390 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228fc27b-4f0f-48ed-ba41-632b685ba6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:53.767979 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228fc27b-4f0f-48ed-ba41-632b685ba6d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:53.768250 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228fc27b-4f0f-48ed-ba41-632b685ba6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:53.768513 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228fc27b-4f0f-48ed-ba41-632b685ba6d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:53.769143 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228fc27b-4f0f-48ed-ba41-632b685ba6d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:53.770809 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228fc27b-4f0f-48ed-ba41-632b685ba6d5 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:53.781025 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1419/2862] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:40:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:40:53.785180 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a7f28-fbcf-41dc-a609-f936b6fb0dc1 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:53.795275 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a7f28-fbcf-41dc-a609-f936b6fb0dc1 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:53.799851 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c09257-3001-4d6f-8925-010a16d79968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:53.800498 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c09257-3001-4d6f-8925-010a16d79968 admin admin] REQUEST_METHOD: `PUT` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:53.800776 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c09257-3001-4d6f-8925-010a16d79968 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:53.801042 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c09257-3001-4d6f-8925-010a16d79968 admin admin] PATH_INFO: `/v3/projects/ed3559fdf1ff4d27b96d68221a36ade8/users/a071f18562774de6a0d4fe5770383eaa/roles/b5cfd7a855a448359e9017f51d32b6fc` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:53.817555 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c09257-3001-4d6f-8925-010a16d79968 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed3559fdf1ff4d27b96d68221a36ade8, user_id=a071f18562774de6a0d4fe5770383eaa, role_id=b5cfd7a855a448359e9017f51d32b6fc)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:53.820272 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c09257-3001-4d6f-8925-010a16d79968 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:53.833876 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1444/2863] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:40:53 2022] PUT /identity/v3/projects/ed3559fdf1ff4d27b96d68221a36ade8/users/a071f18562774de6a0d4fe5770383eaa/roles/b5cfd7a855a448359e9017f51d32b6fc => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:40:53.845445 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23fa862-4ef1-4ec8-af15-36ee4f50ecbe None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:53.845721 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23fa862-4ef1-4ec8-af15-36ee4f50ecbe None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:53.845985 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23fa862-4ef1-4ec8-af15-36ee4f50ecbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:53.875914 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-d23fa862-4ef1-4ec8-af15-36ee4f50ecbe None None] MFA Rules not processed for user `a071f18562774de6a0d4fe5770383eaa`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:40:53.877122 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-d23fa862-4ef1-4ec8-af15-36ee4f50ecbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:40:53.939494 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1420/2864] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:40:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:40:53.944005 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c09257-3001-4d6f-8925-010a16d79968 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:54.010160 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:40:54.014294 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c09257-3001-4d6f-8925-010a16d79968 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:54.020870 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a2fbfd-7c73-41d3-8cfb-d249223bcca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:54.021747 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a2fbfd-7c73-41d3-8cfb-d249223bcca2 admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:54.022119 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a2fbfd-7c73-41d3-8cfb-d249223bcca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:54.022587 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a2fbfd-7c73-41d3-8cfb-d249223bcca2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:54.023338 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a2fbfd-7c73-41d3-8cfb-d249223bcca2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:54.025539 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a2fbfd-7c73-41d3-8cfb-d249223bcca2 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:54.059317 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1445/2865] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:40:53 2022] POST /identity/v3/projects => generated 375 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:40:54.065839 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23fa862-4ef1-4ec8-af15-36ee4f50ecbe None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:54.084523 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23fa862-4ef1-4ec8-af15-36ee4f50ecbe None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:54.142844 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f499def-2948-4c82-9d72-491db5b7280c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:54.143475 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f499def-2948-4c82-9d72-491db5b7280c admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:54.143751 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f499def-2948-4c82-9d72-491db5b7280c admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:54.144015 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f499def-2948-4c82-9d72-491db5b7280c admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:54.144641 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f499def-2948-4c82-9d72-491db5b7280c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:54.146543 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f499def-2948-4c82-9d72-491db5b7280c admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:54.168400 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1421/2866] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:40:54 2022] POST /identity/v3/users => generated 288 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:40:54.173049 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a2fbfd-7c73-41d3-8cfb-d249223bcca2 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:54.183283 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a2fbfd-7c73-41d3-8cfb-d249223bcca2 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:54.188003 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5527a582-13f6-45a4-bbe1-902ed8cd5508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:54.188604 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5527a582-13f6-45a4-bbe1-902ed8cd5508 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:54.188910 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5527a582-13f6-45a4-bbe1-902ed8cd5508 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:54.189152 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5527a582-13f6-45a4-bbe1-902ed8cd5508 admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:54.189785 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5527a582-13f6-45a4-bbe1-902ed8cd5508 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:54.191467 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5527a582-13f6-45a4-bbe1-902ed8cd5508 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:54.202291 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1446/2867] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:40:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:40:54.206474 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f499def-2948-4c82-9d72-491db5b7280c admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:54.217241 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f499def-2948-4c82-9d72-491db5b7280c admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:54.222266 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bed96b9-df0c-4520-b5b1-ef1597482a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:54.223029 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed96b9-df0c-4520-b5b1-ef1597482a5b admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:54.223309 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed96b9-df0c-4520-b5b1-ef1597482a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:54.223577 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed96b9-df0c-4520-b5b1-ef1597482a5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:54.224218 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bed96b9-df0c-4520-b5b1-ef1597482a5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:54.226139 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bed96b9-df0c-4520-b5b1-ef1597482a5b admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:54.236537 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1422/2868] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:40:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:40:54.240922 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5527a582-13f6-45a4-bbe1-902ed8cd5508 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:54.252073 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5527a582-13f6-45a4-bbe1-902ed8cd5508 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:54.256839 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d703bf-c06d-4a2e-890e-52892ce7dc37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:54.257521 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d703bf-c06d-4a2e-890e-52892ce7dc37 admin admin] REQUEST_METHOD: `PUT` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:54.257805 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d703bf-c06d-4a2e-890e-52892ce7dc37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:54.258117 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d703bf-c06d-4a2e-890e-52892ce7dc37 admin admin] PATH_INFO: `/v3/projects/46006835f2414393890f9f52ac8d0be4/users/1017e1c9949a4e5fa37b3793e4e9d40e/roles/b5cfd7a855a448359e9017f51d32b6fc` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:54.272855 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d703bf-c06d-4a2e-890e-52892ce7dc37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46006835f2414393890f9f52ac8d0be4, user_id=1017e1c9949a4e5fa37b3793e4e9d40e, role_id=b5cfd7a855a448359e9017f51d32b6fc)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:54.275521 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d703bf-c06d-4a2e-890e-52892ce7dc37 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:54.288500 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1447/2869] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:40:54 2022] PUT /identity/v3/projects/46006835f2414393890f9f52ac8d0be4/users/1017e1c9949a4e5fa37b3793e4e9d40e/roles/b5cfd7a855a448359e9017f51d32b6fc => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:40:54.299350 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b6c3df-b1b4-451b-865c-f14c87830943 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:54.299900 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b6c3df-b1b4-451b-865c-f14c87830943 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:54.300153 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b6c3df-b1b4-451b-865c-f14c87830943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:54.329168 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-54b6c3df-b1b4-451b-865c-f14c87830943 None None] MFA Rules not processed for user `1017e1c9949a4e5fa37b3793e4e9d40e`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:40:54.330386 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-54b6c3df-b1b4-451b-865c-f14c87830943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:40:54.343029 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:40:54.396821 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1423/2870] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:40:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:40:54.401473 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d703bf-c06d-4a2e-890e-52892ce7dc37 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:54.467854 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d703bf-c06d-4a2e-890e-52892ce7dc37 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:54.472602 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ad017-e494-47c1-ab7b-d2ce1d118dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:54.473217 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ad017-e494-47c1-ab7b-d2ce1d118dc4 admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:54.473499 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ad017-e494-47c1-ab7b-d2ce1d118dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:54.473773 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ad017-e494-47c1-ab7b-d2ce1d118dc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:54.474413 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6ad017-e494-47c1-ab7b-d2ce1d118dc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:54.476363 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6ad017-e494-47c1-ab7b-d2ce1d118dc4 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:54.504150 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1448/2871] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:40:54 2022] POST /identity/v3/projects => generated 375 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:40:54.508191 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b6c3df-b1b4-451b-865c-f14c87830943 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:54.519459 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b6c3df-b1b4-451b-865c-f14c87830943 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:54.583663 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10169dbc-f758-4592-b8c4-fddaa5d13e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:54.584190 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10169dbc-f758-4592-b8c4-fddaa5d13e48 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:54.584468 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10169dbc-f758-4592-b8c4-fddaa5d13e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:54.584736 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10169dbc-f758-4592-b8c4-fddaa5d13e48 admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:54.585368 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10169dbc-f758-4592-b8c4-fddaa5d13e48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:54.587294 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10169dbc-f758-4592-b8c4-fddaa5d13e48 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:54.609208 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1424/2872] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:40:54 2022] POST /identity/v3/users => generated 294 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:40:54.613234 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ad017-e494-47c1-ab7b-d2ce1d118dc4 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:54.624926 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ad017-e494-47c1-ab7b-d2ce1d118dc4 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:54.629508 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a7b93f-3e20-47e8-b9a7-2db7e7723718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:54.630118 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a7b93f-3e20-47e8-b9a7-2db7e7723718 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:54.630397 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a7b93f-3e20-47e8-b9a7-2db7e7723718 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:54.630667 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a7b93f-3e20-47e8-b9a7-2db7e7723718 admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:54.631339 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a7b93f-3e20-47e8-b9a7-2db7e7723718 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:54.632927 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a7b93f-3e20-47e8-b9a7-2db7e7723718 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:54.643654 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1449/2873] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:40:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:40:54.647903 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10169dbc-f758-4592-b8c4-fddaa5d13e48 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:54.658056 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10169dbc-f758-4592-b8c4-fddaa5d13e48 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:54.662748 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abb6b35-4912-4f46-91ed-df06ef722f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:54.663420 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb6b35-4912-4f46-91ed-df06ef722f67 admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:54.663733 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb6b35-4912-4f46-91ed-df06ef722f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:54.664016 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb6b35-4912-4f46-91ed-df06ef722f67 admin admin] PATH_INFO: `/v3/projects/3c46adf7870c452793c40b346b149fc9/users/5fa70b1dd99a4b388b4ee9d566d54940/roles/a332ef951db949b0bad7019fbd28a1b9` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:54.679279 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abb6b35-4912-4f46-91ed-df06ef722f67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c46adf7870c452793c40b346b149fc9, user_id=5fa70b1dd99a4b388b4ee9d566d54940, role_id=a332ef951db949b0bad7019fbd28a1b9)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:54.681954 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abb6b35-4912-4f46-91ed-df06ef722f67 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:54.696820 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1425/2874] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:40:54 2022] PUT /identity/v3/projects/3c46adf7870c452793c40b346b149fc9/users/5fa70b1dd99a4b388b4ee9d566d54940/roles/a332ef951db949b0bad7019fbd28a1b9 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:40:54.702152 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a7b93f-3e20-47e8-b9a7-2db7e7723718 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:54.712345 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a7b93f-3e20-47e8-b9a7-2db7e7723718 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:54.768975 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb13faf8-b3fc-45eb-862f-0e790bf28519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:54.769599 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13faf8-b3fc-45eb-862f-0e790bf28519 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:54.769876 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13faf8-b3fc-45eb-862f-0e790bf28519 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:54.770152 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13faf8-b3fc-45eb-862f-0e790bf28519 admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:54.770789 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb13faf8-b3fc-45eb-862f-0e790bf28519 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:54.772411 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb13faf8-b3fc-45eb-862f-0e790bf28519 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:54.785276 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1450/2875] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:40:54 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:40:54.789446 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abb6b35-4912-4f46-91ed-df06ef722f67 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:54.799795 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abb6b35-4912-4f46-91ed-df06ef722f67 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:54.804392 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6c113d-f970-4b47-a2d1-6282f0039065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:54.805038 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c113d-f970-4b47-a2d1-6282f0039065 admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:54.805316 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c113d-f970-4b47-a2d1-6282f0039065 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:54.805587 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c113d-f970-4b47-a2d1-6282f0039065 admin admin] PATH_INFO: `/v3/projects/3c46adf7870c452793c40b346b149fc9/users/5fa70b1dd99a4b388b4ee9d566d54940/roles/a332ef951db949b0bad7019fbd28a1b9` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:54.807535 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6c113d-f970-4b47-a2d1-6282f0039065 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c46adf7870c452793c40b346b149fc9, user_id=5fa70b1dd99a4b388b4ee9d566d54940, role_id=a332ef951db949b0bad7019fbd28a1b9)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:54.810414 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6c113d-f970-4b47-a2d1-6282f0039065 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:54.820772 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1426/2876] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:40:54 2022] PUT /identity/v3/projects/3c46adf7870c452793c40b346b149fc9/users/5fa70b1dd99a4b388b4ee9d566d54940/roles/a332ef951db949b0bad7019fbd28a1b9 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:40:54.832589 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8493d51d-dca6-4c08-8ceb-fece6cc0b510 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:54.832873 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8493d51d-dca6-4c08-8ceb-fece6cc0b510 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:54.833152 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8493d51d-dca6-4c08-8ceb-fece6cc0b510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:54.861556 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-8493d51d-dca6-4c08-8ceb-fece6cc0b510 None None] MFA Rules not processed for user `5fa70b1dd99a4b388b4ee9d566d54940`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:40:54.862682 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-8493d51d-dca6-4c08-8ceb-fece6cc0b510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:40:54.867809 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:40:54.930751 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1451/2877] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:40:54 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:40:54.942026 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6c113d-f970-4b47-a2d1-6282f0039065 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:54.943742 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-3c6c113d-f970-4b47-a2d1-6282f0039065 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:40:55.003274 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6c113d-f970-4b47-a2d1-6282f0039065 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:55.007390 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a904f-5f78-473b-9f07-e76cc127790d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e79503178ac54e62ba385467d5617ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:55.007990 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a904f-5f78-473b-9f07-e76cc127790d service cinder] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:55.008387 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a904f-5f78-473b-9f07-e76cc127790d service cinder] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:55.008603 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a904f-5f78-473b-9f07-e76cc127790d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:55.029461 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:40:55.065894 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98a904f-5f78-473b-9f07-e76cc127790d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:55.067413 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98a904f-5f78-473b-9f07-e76cc127790d service cinder] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:55.077156 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1427/2878] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:40:54 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:40:56.577596 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8493d51d-dca6-4c08-8ceb-fece6cc0b510 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:56.579043 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-8493d51d-dca6-4c08-8ceb-fece6cc0b510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:40:56.591875 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8493d51d-dca6-4c08-8ceb-fece6cc0b510 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:56.595387 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8b895e-ef0b-4dec-a46f-1d374ccf5578 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e79503178ac54e62ba385467d5617ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:56.595993 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b895e-ef0b-4dec-a46f-1d374ccf5578 service cinder] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:56.596270 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b895e-ef0b-4dec-a46f-1d374ccf5578 service cinder] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:56.596544 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b895e-ef0b-4dec-a46f-1d374ccf5578 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:56.653086 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8b895e-ef0b-4dec-a46f-1d374ccf5578 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:56.654778 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8b895e-ef0b-4dec-a46f-1d374ccf5578 service cinder] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:56.663700 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1452/2879] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:40:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:40:57.211670 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a904f-5f78-473b-9f07-e76cc127790d service cinder] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:40:57.220832 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a904f-5f78-473b-9f07-e76cc127790d service cinder] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:40:57.224533 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7c8b8b-4e19-4dce-8391-7fe8eef47a25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e79503178ac54e62ba385467d5617ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:40:57.225140 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c8b8b-4e19-4dce-8391-7fe8eef47a25 service cinder] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:40:57.225419 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c8b8b-4e19-4dce-8391-7fe8eef47a25 service cinder] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:40:57.225688 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c8b8b-4e19-4dce-8391-7fe8eef47a25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:40:57.235428 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7c8b8b-4e19-4dce-8391-7fe8eef47a25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:40:57.236854 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7c8b8b-4e19-4dce-8391-7fe8eef47a25 service cinder] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:40:57.246595 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1428/2880] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:40:57 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:41:01.124857 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8b895e-ef0b-4dec-a46f-1d374ccf5578 service cinder] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:41:01.187858 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8b895e-ef0b-4dec-a46f-1d374ccf5578 service cinder] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:41:01.192478 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761d08dd-eddd-4f5a-a381-0de64588e361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:41:01.193141 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d08dd-eddd-4f5a-a381-0de64588e361 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:41:01.193424 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d08dd-eddd-4f5a-a381-0de64588e361 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:41:01.193705 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d08dd-eddd-4f5a-a381-0de64588e361 admin admin] PATH_INFO: `/v3/users/a071f18562774de6a0d4fe5770383eaa` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:41:01.194870 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761d08dd-eddd-4f5a-a381-0de64588e361 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a071f18562774de6a0d4fe5770383eaa)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:41:01.196817 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761d08dd-eddd-4f5a-a381-0de64588e361 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:41:01.240486 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:41:01.242871 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-761d08dd-eddd-4f5a-a381-0de64588e361 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a071f18562774de6a0d4fe5770383eaa'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:41:01.256704 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-761d08dd-eddd-4f5a-a381-0de64588e361 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a071f18562774de6a0d4fe5770383eaa'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:41:01.263682 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-761d08dd-eddd-4f5a-a381-0de64588e361 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a071f18562774de6a0d4fe5770383eaa'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:41:01.264376 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-761d08dd-eddd-4f5a-a381-0de64588e361 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a071f18562774de6a0d4fe5770383eaa'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:41:01.272019 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-761d08dd-eddd-4f5a-a381-0de64588e361 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a071f18562774de6a0d4fe5770383eaa'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:41:01.277957 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1453/2881] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:41:01 2022] DELETE /identity/v3/users/a071f18562774de6a0d4fe5770383eaa => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:41:01.282659 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93047a-66bf-4456-96f8-79b0d0eac0e8 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:41:01.283173 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93047a-66bf-4456-96f8-79b0d0eac0e8 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:41:01.283338 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93047a-66bf-4456-96f8-79b0d0eac0e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:41:01.303243 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-1d93047a-66bf-4456-96f8-79b0d0eac0e8 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:41:01.304486 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-1d93047a-66bf-4456-96f8-79b0d0eac0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:41:01.364633 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1429/2882] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:41:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:41:01.374640 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761d08dd-eddd-4f5a-a381-0de64588e361 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:41:01.376122 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-761d08dd-eddd-4f5a-a381-0de64588e361 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:41:01.439139 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761d08dd-eddd-4f5a-a381-0de64588e361 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:41:01.442876 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d7ac2a-1cef-421d-8a8e-7738b483f359 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:41:01.443498 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d7ac2a-1cef-421d-8a8e-7738b483f359 service neutron] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:41:01.443780 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d7ac2a-1cef-421d-8a8e-7738b483f359 service neutron] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:41:01.444055 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d7ac2a-1cef-421d-8a8e-7738b483f359 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:41:01.455546 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d7ac2a-1cef-421d-8a8e-7738b483f359 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:41:01.457020 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d7ac2a-1cef-421d-8a8e-7738b483f359 service neutron] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:41:01.466642 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1454/2883] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:41:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:41:01.732686 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d93047a-66bf-4456-96f8-79b0d0eac0e8 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:41:01.733600 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-1d93047a-66bf-4456-96f8-79b0d0eac0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:41:01.745860 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d93047a-66bf-4456-96f8-79b0d0eac0e8 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:41:01.751615 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba7018f-da53-480e-999d-875786051630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:41:01.752259 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba7018f-da53-480e-999d-875786051630 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:41:01.752531 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba7018f-da53-480e-999d-875786051630 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:41:01.752802 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba7018f-da53-480e-999d-875786051630 admin admin] PATH_INFO: `/v3/projects/ed3559fdf1ff4d27b96d68221a36ade8` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:41:01.753928 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba7018f-da53-480e-999d-875786051630 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed3559fdf1ff4d27b96d68221a36ade8)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:41:01.755877 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba7018f-da53-480e-999d-875786051630 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:41:01.804565 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-7ba7018f-da53-480e-999d-875786051630 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed3559fdf1ff4d27b96d68221a36ade8', 'request_id': 'req-7ba7018f-da53-480e-999d-875786051630'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:41:01.812612 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-7ba7018f-da53-480e-999d-875786051630 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed3559fdf1ff4d27b96d68221a36ade8', 'request_id': 'req-7ba7018f-da53-480e-999d-875786051630'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:41:01.818958 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-7ba7018f-da53-480e-999d-875786051630 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed3559fdf1ff4d27b96d68221a36ade8', 'request_id': 'req-7ba7018f-da53-480e-999d-875786051630'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:41:01.829316 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-7ba7018f-da53-480e-999d-875786051630 admin admin] The token cache is being invalidate because project ed3559fdf1ff4d27b96d68221a36ade8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:41:01.829599 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-7ba7018f-da53-480e-999d-875786051630 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:41:01.830240 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-7ba7018f-da53-480e-999d-875786051630 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:41:01.831748 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1430/2884] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:41:01 2022] DELETE /identity/v3/projects/ed3559fdf1ff4d27b96d68221a36ade8 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:41:01.835718 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d7ac2a-1cef-421d-8a8e-7738b483f359 service neutron] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:41:01.845441 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d7ac2a-1cef-421d-8a8e-7738b483f359 service neutron] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:41:01.902190 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9e0d55-f6ef-42b1-9038-eaedeb7b07d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:41:01.903001 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e0d55-f6ef-42b1-9038-eaedeb7b07d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:41:01.903282 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e0d55-f6ef-42b1-9038-eaedeb7b07d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:41:01.903554 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e0d55-f6ef-42b1-9038-eaedeb7b07d8 admin admin] PATH_INFO: `/v3/users/1017e1c9949a4e5fa37b3793e4e9d40e` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:41:01.904687 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9e0d55-f6ef-42b1-9038-eaedeb7b07d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1017e1c9949a4e5fa37b3793e4e9d40e)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:41:01.906634 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9e0d55-f6ef-42b1-9038-eaedeb7b07d8 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:41:01.954112 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-8a9e0d55-f6ef-42b1-9038-eaedeb7b07d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1017e1c9949a4e5fa37b3793e4e9d40e'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:41:01.967081 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-8a9e0d55-f6ef-42b1-9038-eaedeb7b07d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1017e1c9949a4e5fa37b3793e4e9d40e'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:41:01.968791 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:41:01.978201 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-8a9e0d55-f6ef-42b1-9038-eaedeb7b07d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1017e1c9949a4e5fa37b3793e4e9d40e'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:41:01.979392 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-8a9e0d55-f6ef-42b1-9038-eaedeb7b07d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1017e1c9949a4e5fa37b3793e4e9d40e'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:41:01.988581 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-8a9e0d55-f6ef-42b1-9038-eaedeb7b07d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1017e1c9949a4e5fa37b3793e4e9d40e'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:41:01.995810 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1455/2885] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:41:01 2022] DELETE /identity/v3/users/1017e1c9949a4e5fa37b3793e4e9d40e => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:41:02.265193 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba7018f-da53-480e-999d-875786051630 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:41:02.266617 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-7ba7018f-da53-480e-999d-875786051630 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:41:02.280306 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba7018f-da53-480e-999d-875786051630 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:41:02.311654 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:41:02.339555 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815a9af6-8a3a-46c1-bcdf-e63fbff6cf67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:41:02.340903 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a9af6-8a3a-46c1-bcdf-e63fbff6cf67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:41:02.341112 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a9af6-8a3a-46c1-bcdf-e63fbff6cf67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:41:02.341381 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a9af6-8a3a-46c1-bcdf-e63fbff6cf67 admin admin] PATH_INFO: `/v3/projects/46006835f2414393890f9f52ac8d0be4` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:41:02.342492 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815a9af6-8a3a-46c1-bcdf-e63fbff6cf67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46006835f2414393890f9f52ac8d0be4)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:41:02.344411 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815a9af6-8a3a-46c1-bcdf-e63fbff6cf67 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:41:02.391530 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-815a9af6-8a3a-46c1-bcdf-e63fbff6cf67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46006835f2414393890f9f52ac8d0be4', 'request_id': 'req-815a9af6-8a3a-46c1-bcdf-e63fbff6cf67'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:41:02.398945 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-815a9af6-8a3a-46c1-bcdf-e63fbff6cf67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46006835f2414393890f9f52ac8d0be4', 'request_id': 'req-815a9af6-8a3a-46c1-bcdf-e63fbff6cf67'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:41:02.405798 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-815a9af6-8a3a-46c1-bcdf-e63fbff6cf67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46006835f2414393890f9f52ac8d0be4', 'request_id': 'req-815a9af6-8a3a-46c1-bcdf-e63fbff6cf67'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:41:02.415967 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-815a9af6-8a3a-46c1-bcdf-e63fbff6cf67 admin admin] The token cache is being invalidate because project 46006835f2414393890f9f52ac8d0be4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:41:02.416246 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-815a9af6-8a3a-46c1-bcdf-e63fbff6cf67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:41:02.416881 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-815a9af6-8a3a-46c1-bcdf-e63fbff6cf67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:41:02.419040 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1431/2886] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:41:02 2022] DELETE /identity/v3/projects/46006835f2414393890f9f52ac8d0be4 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:41:02.422999 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9e0d55-f6ef-42b1-9038-eaedeb7b07d8 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:41:02.424436 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-8a9e0d55-f6ef-42b1-9038-eaedeb7b07d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:41:02.437437 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9e0d55-f6ef-42b1-9038-eaedeb7b07d8 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:41:02.496599 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5833a005-b9cc-411b-b595-821482785810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:41:02.497225 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833a005-b9cc-411b-b595-821482785810 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:41:02.497500 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833a005-b9cc-411b-b595-821482785810 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:41:02.497769 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833a005-b9cc-411b-b595-821482785810 admin admin] PATH_INFO: `/v3/users/5fa70b1dd99a4b388b4ee9d566d54940` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:41:02.498911 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5833a005-b9cc-411b-b595-821482785810 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fa70b1dd99a4b388b4ee9d566d54940)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:41:02.500817 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5833a005-b9cc-411b-b595-821482785810 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:41:02.546113 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-5833a005-b9cc-411b-b595-821482785810 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fa70b1dd99a4b388b4ee9d566d54940'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:41:02.557792 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-5833a005-b9cc-411b-b595-821482785810 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fa70b1dd99a4b388b4ee9d566d54940'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:41:02.565603 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-5833a005-b9cc-411b-b595-821482785810 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fa70b1dd99a4b388b4ee9d566d54940'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:41:02.566317 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-5833a005-b9cc-411b-b595-821482785810 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fa70b1dd99a4b388b4ee9d566d54940'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:41:02.573846 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-5833a005-b9cc-411b-b595-821482785810 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fa70b1dd99a4b388b4ee9d566d54940'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:41:02.580181 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1456/2887] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:41:02 2022] DELETE /identity/v3/users/5fa70b1dd99a4b388b4ee9d566d54940 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:41:02.856815 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815a9af6-8a3a-46c1-bcdf-e63fbff6cf67 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:41:02.858261 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-815a9af6-8a3a-46c1-bcdf-e63fbff6cf67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:41:02.871959 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815a9af6-8a3a-46c1-bcdf-e63fbff6cf67 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:41:02.930539 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab072258-af5c-4247-8838-6c39e64faf8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:41:02.931202 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab072258-af5c-4247-8838-6c39e64faf8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:41:02.931477 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab072258-af5c-4247-8838-6c39e64faf8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:41:02.931745 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab072258-af5c-4247-8838-6c39e64faf8c admin admin] PATH_INFO: `/v3/projects/3c46adf7870c452793c40b346b149fc9` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:41:02.932848 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab072258-af5c-4247-8838-6c39e64faf8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c46adf7870c452793c40b346b149fc9)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:41:02.935283 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab072258-af5c-4247-8838-6c39e64faf8c admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:41:02.980879 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-ab072258-af5c-4247-8838-6c39e64faf8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c46adf7870c452793c40b346b149fc9', 'request_id': 'req-ab072258-af5c-4247-8838-6c39e64faf8c'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:41:02.987866 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-ab072258-af5c-4247-8838-6c39e64faf8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c46adf7870c452793c40b346b149fc9', 'request_id': 'req-ab072258-af5c-4247-8838-6c39e64faf8c'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:41:02.994506 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-ab072258-af5c-4247-8838-6c39e64faf8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c46adf7870c452793c40b346b149fc9', 'request_id': 'req-ab072258-af5c-4247-8838-6c39e64faf8c'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:41:03.000001 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:41:03.007455 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-ab072258-af5c-4247-8838-6c39e64faf8c admin admin] The token cache is being invalidate because project 3c46adf7870c452793c40b346b149fc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:41:03.007753 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-ab072258-af5c-4247-8838-6c39e64faf8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:41:03.008788 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-ab072258-af5c-4247-8838-6c39e64faf8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:41:03.010372 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1432/2888] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:41:02 2022] DELETE /identity/v3/projects/3c46adf7870c452793c40b346b149fc9 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:41:03.017951 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c801e7-cf9e-4ab2-8235-d32faf26d261 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:41:03.018233 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c801e7-cf9e-4ab2-8235-d32faf26d261 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:41:03.018505 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c801e7-cf9e-4ab2-8235-d32faf26d261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:41:03.039218 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-40c801e7-cf9e-4ab2-8235-d32faf26d261 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:41:03.040422 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-40c801e7-cf9e-4ab2-8235-d32faf26d261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:41:03.099905 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1457/2889] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:41:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:41:03.108500 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc935b5-7fc1-44d7-8468-5328800a134d None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:41:03.108860 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc935b5-7fc1-44d7-8468-5328800a134d None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:41:03.109219 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc935b5-7fc1-44d7-8468-5328800a134d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:41:03.129139 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-0dc935b5-7fc1-44d7-8468-5328800a134d None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:41:03.130352 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-0dc935b5-7fc1-44d7-8468-5328800a134d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:41:03.138450 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1433/2890] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:41:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:41:03.142881 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c801e7-cf9e-4ab2-8235-d32faf26d261 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:41:03.147695 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:41:03.154448 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c801e7-cf9e-4ab2-8235-d32faf26d261 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:41:03.160343 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ae483f-bec0-4e53-9833-5f0d60cde4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:41:03.160917 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae483f-bec0-4e53-9833-5f0d60cde4e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:41:03.161195 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae483f-bec0-4e53-9833-5f0d60cde4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:41:03.161581 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae483f-bec0-4e53-9833-5f0d60cde4e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:41:03.162136 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ae483f-bec0-4e53-9833-5f0d60cde4e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:41:03.162455 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ae483f-bec0-4e53-9833-5f0d60cde4e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:41:03.164062 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ae483f-bec0-4e53-9833-5f0d60cde4e3 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:41:03.176427 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1458/2891] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 12:41:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:41:03.180977 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc935b5-7fc1-44d7-8468-5328800a134d None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:41:03.190247 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc935b5-7fc1-44d7-8468-5328800a134d None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:41:03.194984 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801e8df3-1c3e-4a57-9b99-13c818c14d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:41:03.195583 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e8df3-1c3e-4a57-9b99-13c818c14d3d admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:41:03.195859 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e8df3-1c3e-4a57-9b99-13c818c14d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:41:03.196130 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e8df3-1c3e-4a57-9b99-13c818c14d3d admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:41:03.196763 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801e8df3-1c3e-4a57-9b99-13c818c14d3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:41:03.198678 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801e8df3-1c3e-4a57-9b99-13c818c14d3d admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:41:03.227224 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1434/2892] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:41:03 2022] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:41:03.232797 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ae483f-bec0-4e53-9833-5f0d60cde4e3 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:41:03.242696 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ae483f-bec0-4e53-9833-5f0d60cde4e3 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:41:03.299267 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef4ef64-bc9b-4728-a0a4-4f859453b67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:41:03.299879 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4ef64-bc9b-4728-a0a4-4f859453b67c admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:41:03.300160 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4ef64-bc9b-4728-a0a4-4f859453b67c admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:41:03.300429 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4ef64-bc9b-4728-a0a4-4f859453b67c admin admin] PATH_INFO: `/v3/users` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:41:03.301049 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef4ef64-bc9b-4728-a0a4-4f859453b67c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:41:03.302976 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef4ef64-bc9b-4728-a0a4-4f859453b67c admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:41:03.325038 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1459/2893] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:41:03 2022] POST /identity/v3/users => generated 291 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:41:03.329351 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801e8df3-1c3e-4a57-9b99-13c818c14d3d admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:41:03.339639 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801e8df3-1c3e-4a57-9b99-13c818c14d3d admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:41:03.345129 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e891d14c-8745-4f38-86cd-f6800fe0f901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:41:03.345731 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e891d14c-8745-4f38-86cd-f6800fe0f901 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:41:03.346027 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e891d14c-8745-4f38-86cd-f6800fe0f901 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:41:03.346277 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e891d14c-8745-4f38-86cd-f6800fe0f901 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:41:03.346949 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e891d14c-8745-4f38-86cd-f6800fe0f901 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:41:03.348537 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e891d14c-8745-4f38-86cd-f6800fe0f901 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:41:03.359397 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1435/2894] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:41:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:41:03.363257 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef4ef64-bc9b-4728-a0a4-4f859453b67c admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:41:03.374153 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef4ef64-bc9b-4728-a0a4-4f859453b67c admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:41:03.378793 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0922745a-733b-43f6-b1d8-088b1d9d1761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:41:03.379429 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922745a-733b-43f6-b1d8-088b1d9d1761 admin admin] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:41:03.379715 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922745a-733b-43f6-b1d8-088b1d9d1761 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:41:03.379988 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922745a-733b-43f6-b1d8-088b1d9d1761 admin admin] PATH_INFO: `/v3/roles` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:41:03.380658 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0922745a-733b-43f6-b1d8-088b1d9d1761 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:41:03.382253 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0922745a-733b-43f6-b1d8-088b1d9d1761 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:41:03.392913 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1460/2895] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:41:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:41:03.397015 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e891d14c-8745-4f38-86cd-f6800fe0f901 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:41:03.407078 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e891d14c-8745-4f38-86cd-f6800fe0f901 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:41:03.411658 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5327f45b-2bbc-4f5f-a1ab-b35f438d6ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:41:03.412303 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5327f45b-2bbc-4f5f-a1ab-b35f438d6ab7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:41:03.412579 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5327f45b-2bbc-4f5f-a1ab-b35f438d6ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:41:03.412844 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5327f45b-2bbc-4f5f-a1ab-b35f438d6ab7 admin admin] PATH_INFO: `/v3/projects/e8ba32b297b84802941b32e82f3a67e5/users/463ffd63f6d54b629e160c3476eae261/roles/b5cfd7a855a448359e9017f51d32b6fc` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:41:03.427477 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5327f45b-2bbc-4f5f-a1ab-b35f438d6ab7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8ba32b297b84802941b32e82f3a67e5, user_id=463ffd63f6d54b629e160c3476eae261, role_id=b5cfd7a855a448359e9017f51d32b6fc)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:41:03.430085 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5327f45b-2bbc-4f5f-a1ab-b35f438d6ab7 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:41:03.445750 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1436/2896] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:41:03 2022] PUT /identity/v3/projects/e8ba32b297b84802941b32e82f3a67e5/users/463ffd63f6d54b629e160c3476eae261/roles/b5cfd7a855a448359e9017f51d32b6fc => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:41:03.450936 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578cc6b9-c361-4392-a48d-388c8630e865 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:41:03.451372 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578cc6b9-c361-4392-a48d-388c8630e865 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:41:03.451486 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578cc6b9-c361-4392-a48d-388c8630e865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:41:03.470284 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-578cc6b9-c361-4392-a48d-388c8630e865 None None] MFA Rules not processed for user `ba867dda5cc7471abb8f3da6ca94b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:41:03.471528 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-578cc6b9-c361-4392-a48d-388c8630e865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:41:03.531154 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1461/2897] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:41:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:41:03.541061 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5327f45b-2bbc-4f5f-a1ab-b35f438d6ab7 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:41:03.542784 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-5327f45b-2bbc-4f5f-a1ab-b35f438d6ab7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:41:03.599519 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5327f45b-2bbc-4f5f-a1ab-b35f438d6ab7 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:41:03.603190 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f665eb3-b57d-474a-980d-cb9323936df2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:41:03.603791 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f665eb3-b57d-474a-980d-cb9323936df2 service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:41:03.604067 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f665eb3-b57d-474a-980d-cb9323936df2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:41:03.604336 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f665eb3-b57d-474a-980d-cb9323936df2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:41:03.613984 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f665eb3-b57d-474a-980d-cb9323936df2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:41:03.615415 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f665eb3-b57d-474a-980d-cb9323936df2 service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:41:03.625823 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1437/2898] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:41:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:41:07.638377 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6465e565-967a-45cf-affb-751e8fc73e88 None None] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:41:07.639384 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6465e565-967a-45cf-affb-751e8fc73e88 None None] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:41:07.639738 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6465e565-967a-45cf-affb-751e8fc73e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:41:07.670774 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.auth.core [None req-6465e565-967a-45cf-affb-751e8fc73e88 None None] MFA Rules not processed for user `463ffd63f6d54b629e160c3476eae261`. Rule list: `[]` (Enabled: `True`). {{(pid=81495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:41:07.672120 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-6465e565-967a-45cf-affb-751e8fc73e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:41:07.737516 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:41:07.747256 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1462/2899] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:41:07 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:41:07.749688 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f665eb3-b57d-474a-980d-cb9323936df2 service neutron] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:41:07.759549 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f665eb3-b57d-474a-980d-cb9323936df2 service neutron] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:41:07.764983 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c259e3c-28c9-4dc5-86c0-3d17e5520f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:41:07.766244 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c259e3c-28c9-4dc5-86c0-3d17e5520f94 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:41:07.766523 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c259e3c-28c9-4dc5-86c0-3d17e5520f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:41:07.766793 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c259e3c-28c9-4dc5-86c0-3d17e5520f94 admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:41:07.767473 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c259e3c-28c9-4dc5-86c0-3d17e5520f94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:41:07.769367 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c259e3c-28c9-4dc5-86c0-3d17e5520f94 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:41:07.799115 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1438/2900] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 12:41:07 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:41:07.803214 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6465e565-967a-45cf-affb-751e8fc73e88 None None] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:41:07.815545 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6465e565-967a-45cf-affb-751e8fc73e88 None None] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:41:07.877141 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2577643e-47c6-4e49-8d37-2e8df65cb39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:41:07.877715 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577643e-47c6-4e49-8d37-2e8df65cb39f admin admin] REQUEST_METHOD: `POST` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:41:07.879621 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577643e-47c6-4e49-8d37-2e8df65cb39f admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:41:07.879621 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577643e-47c6-4e49-8d37-2e8df65cb39f admin admin] PATH_INFO: `/v3/users` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:41:07.879621 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2577643e-47c6-4e49-8d37-2e8df65cb39f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:41:07.882750 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2577643e-47c6-4e49-8d37-2e8df65cb39f admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:41:07.904151 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1463/2901] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 12:41:07 2022] POST /identity/v3/users => generated 299 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:41:07.908176 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c259e3c-28c9-4dc5-86c0-3d17e5520f94 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:41:07.919386 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c259e3c-28c9-4dc5-86c0-3d17e5520f94 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:41:07.924241 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61976b31-8979-4b2f-96e9-9371a78e432f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:41:07.924852 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61976b31-8979-4b2f-96e9-9371a78e432f admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:41:07.925133 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61976b31-8979-4b2f-96e9-9371a78e432f admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:41:07.925485 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61976b31-8979-4b2f-96e9-9371a78e432f admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:41:07.926138 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61976b31-8979-4b2f-96e9-9371a78e432f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:41:07.927778 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61976b31-8979-4b2f-96e9-9371a78e432f admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:41:07.939690 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1439/2902] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:41:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:41:07.944422 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2577643e-47c6-4e49-8d37-2e8df65cb39f admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:41:07.955701 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2577643e-47c6-4e49-8d37-2e8df65cb39f admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:41:07.960828 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0cfc41-b878-4869-b0a9-dbb4bf4129a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:41:07.961574 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0cfc41-b878-4869-b0a9-dbb4bf4129a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:41:07.961794 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0cfc41-b878-4869-b0a9-dbb4bf4129a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:41:07.962089 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0cfc41-b878-4869-b0a9-dbb4bf4129a6 admin admin] PATH_INFO: `/v3/projects/c1e19c6c11b5458d8fd4cd4fd29d4973/users/36603b3e65c442b09f0c90e634e69ba5/roles/a332ef951db949b0bad7019fbd28a1b9` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:41:07.980086 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0cfc41-b878-4869-b0a9-dbb4bf4129a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1e19c6c11b5458d8fd4cd4fd29d4973, user_id=36603b3e65c442b09f0c90e634e69ba5, role_id=a332ef951db949b0bad7019fbd28a1b9)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:41:07.982772 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0cfc41-b878-4869-b0a9-dbb4bf4129a6 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:41:07.997187 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1464/2903] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:41:07 2022] PUT /identity/v3/projects/c1e19c6c11b5458d8fd4cd4fd29d4973/users/36603b3e65c442b09f0c90e634e69ba5/roles/a332ef951db949b0bad7019fbd28a1b9 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:41:08.001327 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61976b31-8979-4b2f-96e9-9371a78e432f admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:41:08.011397 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61976b31-8979-4b2f-96e9-9371a78e432f admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:41:08.070937 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f04145-6ab9-41f9-9778-84cd34868985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:41:08.071548 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f04145-6ab9-41f9-9778-84cd34868985 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:41:08.071841 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f04145-6ab9-41f9-9778-84cd34868985 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:41:08.072095 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f04145-6ab9-41f9-9778-84cd34868985 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:41:08.072728 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f04145-6ab9-41f9-9778-84cd34868985 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:41:08.074911 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f04145-6ab9-41f9-9778-84cd34868985 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:41:08.076342 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:41:08.086597 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1440/2904] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 12:41:08 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:41:08.092179 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0cfc41-b878-4869-b0a9-dbb4bf4129a6 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:41:08.102623 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0cfc41-b878-4869-b0a9-dbb4bf4129a6 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:41:08.108158 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944b31ec-127e-4b25-bfa5-b2cc36386ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:41:08.108818 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b31ec-127e-4b25-bfa5-b2cc36386ee7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:41:08.109100 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b31ec-127e-4b25-bfa5-b2cc36386ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:41:08.109380 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b31ec-127e-4b25-bfa5-b2cc36386ee7 admin admin] PATH_INFO: `/v3/projects/c1e19c6c11b5458d8fd4cd4fd29d4973/users/36603b3e65c442b09f0c90e634e69ba5/roles/a332ef951db949b0bad7019fbd28a1b9` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:41:08.111414 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944b31ec-127e-4b25-bfa5-b2cc36386ee7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1e19c6c11b5458d8fd4cd4fd29d4973, user_id=36603b3e65c442b09f0c90e634e69ba5, role_id=a332ef951db949b0bad7019fbd28a1b9)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:41:08.114199 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944b31ec-127e-4b25-bfa5-b2cc36386ee7 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:41:08.125466 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1465/2905] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 12:41:08 2022] PUT /identity/v3/projects/c1e19c6c11b5458d8fd4cd4fd29d4973/users/36603b3e65c442b09f0c90e634e69ba5/roles/a332ef951db949b0bad7019fbd28a1b9 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:41:12.686177 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12bc89c-7cb9-43a7-b55e-859488dae437 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:41:12.686709 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12bc89c-7cb9-43a7-b55e-859488dae437 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:41:12.686814 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12bc89c-7cb9-43a7-b55e-859488dae437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:41:12.721507 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-c12bc89c-7cb9-43a7-b55e-859488dae437 None None] MFA Rules not processed for user `36603b3e65c442b09f0c90e634e69ba5`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:41:12.722759 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-c12bc89c-7cb9-43a7-b55e-859488dae437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:41:12.808419 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1441/2906] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:41:12 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:41:12.823064 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944b31ec-127e-4b25-bfa5-b2cc36386ee7 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:41:12.825947 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-944b31ec-127e-4b25-bfa5-b2cc36386ee7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:41:12.927348 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944b31ec-127e-4b25-bfa5-b2cc36386ee7 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:41:12.931040 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b547832-de2b-4696-ae09-6ce0ef51ec47 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8b3bb8f689b45b99ed43f672264a26d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:41:12.931657 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b547832-de2b-4696-ae09-6ce0ef51ec47 service glance] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:41:12.931932 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b547832-de2b-4696-ae09-6ce0ef51ec47 service glance] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:41:12.932375 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b547832-de2b-4696-ae09-6ce0ef51ec47 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:41:12.983929 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:41:12.999837 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b547832-de2b-4696-ae09-6ce0ef51ec47 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:41:13.001338 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b547832-de2b-4696-ae09-6ce0ef51ec47 service glance] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:41:13.015192 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1466/2907] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:41:12 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:41:13.157437 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c130f853-13de-4f56-80a4-4193d1070a71 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:41:13.157960 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c130f853-13de-4f56-80a4-4193d1070a71 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:41:13.158236 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c130f853-13de-4f56-80a4-4193d1070a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:41:13.220724 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-c130f853-13de-4f56-80a4-4193d1070a71 None None] MFA Rules not processed for user `149aa48acd504354a1d021885ca51334`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:41:13.221980 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-c130f853-13de-4f56-80a4-4193d1070a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:41:13.315048 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1442/2908] 10.222.0.79 () {58 vars in 1009 bytes} [Wed Aug 31 12:41:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:41:13.360238 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b547832-de2b-4696-ae09-6ce0ef51ec47 service glance] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:41:13.361690 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-0b547832-de2b-4696-ae09-6ce0ef51ec47 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:41:13.459073 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b547832-de2b-4696-ae09-6ce0ef51ec47 service glance] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:41:13.464215 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f91fd41-c0c3-4c63-a47f-5a29df9f0873 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896540cc14f40b08d05ade32cfd0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:41:13.465378 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f91fd41-c0c3-4c63-a47f-5a29df9f0873 service swift] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:41:13.465650 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f91fd41-c0c3-4c63-a47f-5a29df9f0873 service swift] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:41:13.465918 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f91fd41-c0c3-4c63-a47f-5a29df9f0873 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:41:13.474000 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f91fd41-c0c3-4c63-a47f-5a29df9f0873 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:41:13.475612 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f91fd41-c0c3-4c63-a47f-5a29df9f0873 service swift] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:41:13.484433 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1467/2909] 10.222.0.79 () {60 vars in 1384 bytes} [Wed Aug 31 12:41:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 12:41:22.076257 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f62447b-c1c3-41f8-8089-025af81475e7 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:41:22.076784 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f62447b-c1c3-41f8-8089-025af81475e7 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:41:22.076784 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f62447b-c1c3-41f8-8089-025af81475e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:41:22.095941 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-3f62447b-c1c3-41f8-8089-025af81475e7 None None] MFA Rules not processed for user `463ffd63f6d54b629e160c3476eae261`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:41:22.097160 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-3f62447b-c1c3-41f8-8089-025af81475e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:41:22.104146 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1443/2910] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 12:41:22 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:41:22.669945 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f91fd41-c0c3-4c63-a47f-5a29df9f0873 service swift] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:41:22.671482 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-6f91fd41-c0c3-4c63-a47f-5a29df9f0873 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:41:22.746569 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f91fd41-c0c3-4c63-a47f-5a29df9f0873 service swift] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:41:22.751695 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f12a220-017f-489a-a8b6-e45dce8c9727 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6deab40ae6244d4b9affa47b274aea3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:41:22.752311 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f12a220-017f-489a-a8b6-e45dce8c9727 service placement] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:41:22.752601 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f12a220-017f-489a-a8b6-e45dce8c9727 service placement] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:41:22.752871 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f12a220-017f-489a-a8b6-e45dce8c9727 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:41:22.754625 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-9f12a220-017f-489a-a8b6-e45dce8c9727 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:41:22.767464 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f12a220-017f-489a-a8b6-e45dce8c9727 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:41:22.769142 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f12a220-017f-489a-a8b6-e45dce8c9727 service placement] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:41:22.781316 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1468/2911] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:41:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:41:24.028972 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b886e029-927b-455e-87a2-bbd32fc57f33 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:41:24.029775 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b886e029-927b-455e-87a2-bbd32fc57f33 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:41:24.029775 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b886e029-927b-455e-87a2-bbd32fc57f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:41:24.051173 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-b886e029-927b-455e-87a2-bbd32fc57f33 None None] MFA Rules not processed for user `149aa48acd504354a1d021885ca51334`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:41:24.052394 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-b886e029-927b-455e-87a2-bbd32fc57f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:41:24.059885 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1444/2912] 10.222.0.79 () {58 vars in 1009 bytes} [Wed Aug 31 12:41:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:41:24.072341 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f12a220-017f-489a-a8b6-e45dce8c9727 service placement] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:41:24.083939 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f12a220-017f-489a-a8b6-e45dce8c9727 service placement] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:41:24.091575 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dac8c6-5e2a-4955-b5f1-792d0432b1cf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896540cc14f40b08d05ade32cfd0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:41:24.091990 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dac8c6-5e2a-4955-b5f1-792d0432b1cf service swift] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:41:24.092339 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dac8c6-5e2a-4955-b5f1-792d0432b1cf service swift] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:41:24.092547 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dac8c6-5e2a-4955-b5f1-792d0432b1cf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:41:24.102004 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dac8c6-5e2a-4955-b5f1-792d0432b1cf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:41:24.103655 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dac8c6-5e2a-4955-b5f1-792d0432b1cf service swift] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:41:24.112836 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1469/2913] 10.222.0.79 () {60 vars in 1384 bytes} [Wed Aug 31 12:41:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 12:41:34.045149 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=82 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:41:34.109507 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=86 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:41:36.447115 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b886e029-927b-455e-87a2-bbd32fc57f33 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:41:36.448608 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-b886e029-927b-455e-87a2-bbd32fc57f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:41:36.542475 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b886e029-927b-455e-87a2-bbd32fc57f33 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:41:36.551589 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1f036b-d29a-4dab-ae74-4c72a5d3660f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62401c8e1457450590f4147e0665265a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:41:36.552222 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f036b-d29a-4dab-ae74-4c72a5d3660f service nova] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:41:36.552505 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f036b-d29a-4dab-ae74-4c72a5d3660f service nova] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:41:36.552769 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f036b-d29a-4dab-ae74-4c72a5d3660f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:41:36.554683 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-da1f036b-d29a-4dab-ae74-4c72a5d3660f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:41:36.569263 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1f036b-d29a-4dab-ae74-4c72a5d3660f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:41:36.570941 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1f036b-d29a-4dab-ae74-4c72a5d3660f service nova] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:41:36.583051 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1445/2914] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:41:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:41:46.577964 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=34 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:41:48.787643 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dac8c6-5e2a-4955-b5f1-792d0432b1cf service swift] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:41:48.847498 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dac8c6-5e2a-4955-b5f1-792d0432b1cf service swift] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:41:48.851214 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7068bf-a435-434e-8b35-b19a68bb18b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:41:48.851820 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7068bf-a435-434e-8b35-b19a68bb18b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:41:48.852103 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7068bf-a435-434e-8b35-b19a68bb18b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:41:48.852373 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7068bf-a435-434e-8b35-b19a68bb18b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:41:48.863812 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7068bf-a435-434e-8b35-b19a68bb18b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:41:48.865475 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7068bf-a435-434e-8b35-b19a68bb18b7 service neutron] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:41:48.876648 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1470/2915] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:41:48 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:41:58.871876 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=26 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:42:31.170196 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1f036b-d29a-4dab-ae74-4c72a5d3660f service nova] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:42:31.182615 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1f036b-d29a-4dab-ae74-4c72a5d3660f service nova] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:42:31.187223 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e105a5-862a-4f72-8b34-bb1c1399d186 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:42:31.187888 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e105a5-862a-4f72-8b34-bb1c1399d186 service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:42:31.188163 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e105a5-862a-4f72-8b34-bb1c1399d186 service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:42:31.188434 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e105a5-862a-4f72-8b34-bb1c1399d186 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:42:31.190219 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-a1e105a5-862a-4f72-8b34-bb1c1399d186 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:42:31.200531 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e105a5-862a-4f72-8b34-bb1c1399d186 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:42:31.202688 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e105a5-862a-4f72-8b34-bb1c1399d186 service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:42:31.211862 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1446/2916] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:42:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:42:31.309895 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7068bf-a435-434e-8b35-b19a68bb18b7 service neutron] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:42:31.320104 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7068bf-a435-434e-8b35-b19a68bb18b7 service neutron] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:42:31.323808 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38803e1-0a2e-47ce-9077-94d2c1f4c4df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1569b43c774c45ff80577d879ba9d819', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:42:31.324417 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38803e1-0a2e-47ce-9077-94d2c1f4c4df service neutron] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:42:31.324794 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38803e1-0a2e-47ce-9077-94d2c1f4c4df service neutron] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:42:31.325100 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38803e1-0a2e-47ce-9077-94d2c1f4c4df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:42:31.327624 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-a38803e1-0a2e-47ce-9077-94d2c1f4c4df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:42:31.342131 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38803e1-0a2e-47ce-9077-94d2c1f4c4df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:42:31.344453 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38803e1-0a2e-47ce-9077-94d2c1f4c4df service neutron] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:42:31.355752 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1471/2917] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:42:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:42:41.208492 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=6 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:42:41.350802 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=6 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:42:50.986248 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e105a5-862a-4f72-8b34-bb1c1399d186 service neutron] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:42:50.987706 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-a1e105a5-862a-4f72-8b34-bb1c1399d186 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:42:51.003776 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e105a5-862a-4f72-8b34-bb1c1399d186 service neutron] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:42:51.009600 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83447275-c24b-490e-9f7d-613b953e2a73 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6deab40ae6244d4b9affa47b274aea3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:42:51.010243 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83447275-c24b-490e-9f7d-613b953e2a73 service placement] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:42:51.010569 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83447275-c24b-490e-9f7d-613b953e2a73 service placement] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:42:51.010804 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83447275-c24b-490e-9f7d-613b953e2a73 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:42:51.012852 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-83447275-c24b-490e-9f7d-613b953e2a73 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:42:51.025262 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83447275-c24b-490e-9f7d-613b953e2a73 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:42:51.026873 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83447275-c24b-490e-9f7d-613b953e2a73 service placement] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:42:51.038290 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1447/2918] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:42:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:43:01.033116 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=6 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:43:02.933220 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38803e1-0a2e-47ce-9077-94d2c1f4c4df service neutron] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:43:02.947513 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38803e1-0a2e-47ce-9077-94d2c1f4c4df service neutron] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:43:02.952957 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4741284-6669-4df2-bf31-3c40cc1346bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62401c8e1457450590f4147e0665265a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:43:02.953673 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4741284-6669-4df2-bf31-3c40cc1346bc service nova] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:43:02.954050 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4741284-6669-4df2-bf31-3c40cc1346bc service nova] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:43:02.954877 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4741284-6669-4df2-bf31-3c40cc1346bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:43:02.956434 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-c4741284-6669-4df2-bf31-3c40cc1346bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:43:02.971994 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4741284-6669-4df2-bf31-3c40cc1346bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:43:02.975182 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4741284-6669-4df2-bf31-3c40cc1346bc service nova] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:43:02.989366 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1472/2919] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:43:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:43:10.839366 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5441a5d0-ad9a-4d2f-a2f7-60375451961d None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:43:10.839848 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5441a5d0-ad9a-4d2f-a2f7-60375451961d None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:43:10.839978 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5441a5d0-ad9a-4d2f-a2f7-60375451961d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:43:10.860756 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-5441a5d0-ad9a-4d2f-a2f7-60375451961d None None] MFA Rules not processed for user `149aa48acd504354a1d021885ca51334`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:43:10.861973 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-5441a5d0-ad9a-4d2f-a2f7-60375451961d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:43:10.869207 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1448/2920] 10.222.0.79 () {58 vars in 967 bytes} [Wed Aug 31 12:43:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:43:10.912421 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4741284-6669-4df2-bf31-3c40cc1346bc service nova] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:43:10.924415 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4741284-6669-4df2-bf31-3c40cc1346bc service nova] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:43:10.929407 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464fb470-f1b2-4b35-95b7-c61b4f68df2a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896540cc14f40b08d05ade32cfd0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:43:10.929995 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464fb470-f1b2-4b35-95b7-c61b4f68df2a service swift] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:43:10.930271 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464fb470-f1b2-4b35-95b7-c61b4f68df2a service swift] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:43:10.930538 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464fb470-f1b2-4b35-95b7-c61b4f68df2a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:43:10.938682 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464fb470-f1b2-4b35-95b7-c61b4f68df2a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:43:10.940320 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464fb470-f1b2-4b35-95b7-c61b4f68df2a service swift] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:43:10.948251 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1473/2921] 10.222.0.79 () {60 vars in 1384 bytes} [Wed Aug 31 12:43:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 12:43:17.338477 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5441a5d0-ad9a-4d2f-a2f7-60375451961d None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:43:17.357330 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5441a5d0-ad9a-4d2f-a2f7-60375451961d None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:43:17.366976 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4123b01a-3d57-4675-90a1-6239cfe378f2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6deab40ae6244d4b9affa47b274aea3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:43:17.367871 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4123b01a-3d57-4675-90a1-6239cfe378f2 service placement] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:43:17.368155 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4123b01a-3d57-4675-90a1-6239cfe378f2 service placement] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:43:17.368425 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4123b01a-3d57-4675-90a1-6239cfe378f2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:43:17.370182 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-4123b01a-3d57-4675-90a1-6239cfe378f2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:43:17.385479 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4123b01a-3d57-4675-90a1-6239cfe378f2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:43:17.387255 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4123b01a-3d57-4675-90a1-6239cfe378f2 service placement] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:43:17.396555 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464fb470-f1b2-4b35-95b7-c61b4f68df2a service swift] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:43:17.401999 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1449/2922] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:43:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:43:17.461847 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464fb470-f1b2-4b35-95b7-c61b4f68df2a service swift] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:43:17.466401 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446f781e-7ef7-4947-a189-e2a475045ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:43:17.467071 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f781e-7ef7-4947-a189-e2a475045ac3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:43:17.467352 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f781e-7ef7-4947-a189-e2a475045ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:43:17.467624 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f781e-7ef7-4947-a189-e2a475045ac3 admin admin] PATH_INFO: `/v3/users/463ffd63f6d54b629e160c3476eae261` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:43:17.469325 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446f781e-7ef7-4947-a189-e2a475045ac3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=463ffd63f6d54b629e160c3476eae261)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:43:17.471277 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446f781e-7ef7-4947-a189-e2a475045ac3 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:43:17.517386 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-446f781e-7ef7-4947-a189-e2a475045ac3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '463ffd63f6d54b629e160c3476eae261'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:43:17.529291 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-446f781e-7ef7-4947-a189-e2a475045ac3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '463ffd63f6d54b629e160c3476eae261'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:43:17.536410 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-446f781e-7ef7-4947-a189-e2a475045ac3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '463ffd63f6d54b629e160c3476eae261'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:43:17.537107 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-446f781e-7ef7-4947-a189-e2a475045ac3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '463ffd63f6d54b629e160c3476eae261'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:43:17.544523 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-446f781e-7ef7-4947-a189-e2a475045ac3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '463ffd63f6d54b629e160c3476eae261'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:43:17.551086 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1474/2923] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:43:17 2022] DELETE /identity/v3/users/463ffd63f6d54b629e160c3476eae261 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:43:17.734288 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4123b01a-3d57-4675-90a1-6239cfe378f2 service placement] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:43:17.746125 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4123b01a-3d57-4675-90a1-6239cfe378f2 service placement] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:43:17.808517 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3f66f5-860a-431d-90e5-1f7488042fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:43:17.809066 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f66f5-860a-431d-90e5-1f7488042fd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:43:17.809354 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f66f5-860a-431d-90e5-1f7488042fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:43:17.809616 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f66f5-860a-431d-90e5-1f7488042fd1 admin admin] PATH_INFO: `/v3/projects/e8ba32b297b84802941b32e82f3a67e5` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:43:17.810732 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3f66f5-860a-431d-90e5-1f7488042fd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8ba32b297b84802941b32e82f3a67e5)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:43:17.813483 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3f66f5-860a-431d-90e5-1f7488042fd1 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:43:17.858120 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-fa3f66f5-860a-431d-90e5-1f7488042fd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8ba32b297b84802941b32e82f3a67e5', 'request_id': 'req-fa3f66f5-860a-431d-90e5-1f7488042fd1'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:43:17.866229 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-fa3f66f5-860a-431d-90e5-1f7488042fd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8ba32b297b84802941b32e82f3a67e5', 'request_id': 'req-fa3f66f5-860a-431d-90e5-1f7488042fd1'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:43:17.872684 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-fa3f66f5-860a-431d-90e5-1f7488042fd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8ba32b297b84802941b32e82f3a67e5', 'request_id': 'req-fa3f66f5-860a-431d-90e5-1f7488042fd1'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:43:17.884455 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-fa3f66f5-860a-431d-90e5-1f7488042fd1 admin admin] The token cache is being invalidate because project e8ba32b297b84802941b32e82f3a67e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:43:17.884736 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-fa3f66f5-860a-431d-90e5-1f7488042fd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:43:17.885403 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-fa3f66f5-860a-431d-90e5-1f7488042fd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:43:17.886924 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1450/2924] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:43:17 2022] DELETE /identity/v3/projects/e8ba32b297b84802941b32e82f3a67e5 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:43:17.891035 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446f781e-7ef7-4947-a189-e2a475045ac3 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:43:17.892445 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-446f781e-7ef7-4947-a189-e2a475045ac3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:43:17.905113 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446f781e-7ef7-4947-a189-e2a475045ac3 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:43:17.953373 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:43:17.963810 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6603996d-1f9b-49f7-9661-6d651e0ef651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:43:17.964449 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6603996d-1f9b-49f7-9661-6d651e0ef651 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:43:17.964774 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6603996d-1f9b-49f7-9661-6d651e0ef651 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:43:17.965225 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6603996d-1f9b-49f7-9661-6d651e0ef651 admin admin] PATH_INFO: `/v3/users/36603b3e65c442b09f0c90e634e69ba5` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:43:17.966445 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6603996d-1f9b-49f7-9661-6d651e0ef651 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36603b3e65c442b09f0c90e634e69ba5)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:43:17.968458 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6603996d-1f9b-49f7-9661-6d651e0ef651 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:43:18.016613 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-6603996d-1f9b-49f7-9661-6d651e0ef651 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36603b3e65c442b09f0c90e634e69ba5'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:43:18.028139 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-6603996d-1f9b-49f7-9661-6d651e0ef651 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36603b3e65c442b09f0c90e634e69ba5'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:43:18.034843 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-6603996d-1f9b-49f7-9661-6d651e0ef651 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36603b3e65c442b09f0c90e634e69ba5'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:43:18.035549 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-6603996d-1f9b-49f7-9661-6d651e0ef651 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36603b3e65c442b09f0c90e634e69ba5'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:43:18.047209 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-6603996d-1f9b-49f7-9661-6d651e0ef651 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36603b3e65c442b09f0c90e634e69ba5'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:43:18.054846 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1475/2925] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:43:17 2022] DELETE /identity/v3/users/36603b3e65c442b09f0c90e634e69ba5 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:43:18.223296 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3f66f5-860a-431d-90e5-1f7488042fd1 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:43:18.225270 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-fa3f66f5-860a-431d-90e5-1f7488042fd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:43:18.241373 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3f66f5-860a-431d-90e5-1f7488042fd1 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:43:18.308169 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc74f07-1f9f-4216-a60b-40e2231db495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:43:18.308825 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc74f07-1f9f-4216-a60b-40e2231db495 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:43:18.309105 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc74f07-1f9f-4216-a60b-40e2231db495 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:43:18.309376 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc74f07-1f9f-4216-a60b-40e2231db495 admin admin] PATH_INFO: `/v3/projects/c1e19c6c11b5458d8fd4cd4fd29d4973` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:43:18.310490 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc74f07-1f9f-4216-a60b-40e2231db495 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1e19c6c11b5458d8fd4cd4fd29d4973)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:43:18.312504 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc74f07-1f9f-4216-a60b-40e2231db495 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:43:18.323699 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:43:18.361045 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-fcc74f07-1f9f-4216-a60b-40e2231db495 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1e19c6c11b5458d8fd4cd4fd29d4973', 'request_id': 'req-fcc74f07-1f9f-4216-a60b-40e2231db495'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:43:18.369382 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-fcc74f07-1f9f-4216-a60b-40e2231db495 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1e19c6c11b5458d8fd4cd4fd29d4973', 'request_id': 'req-fcc74f07-1f9f-4216-a60b-40e2231db495'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:43:18.377199 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-fcc74f07-1f9f-4216-a60b-40e2231db495 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1e19c6c11b5458d8fd4cd4fd29d4973', 'request_id': 'req-fcc74f07-1f9f-4216-a60b-40e2231db495'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:43:18.387407 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-fcc74f07-1f9f-4216-a60b-40e2231db495 admin admin] The token cache is being invalidate because project c1e19c6c11b5458d8fd4cd4fd29d4973 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:43:18.387694 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-fcc74f07-1f9f-4216-a60b-40e2231db495 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:43:18.388497 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-fcc74f07-1f9f-4216-a60b-40e2231db495 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:43:18.390267 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1451/2926] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:43:18 2022] DELETE /identity/v3/projects/c1e19c6c11b5458d8fd4cd4fd29d4973 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:43:28.050644 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:43:28.384418 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=19,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:44:08.772926 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6603996d-1f9b-49f7-9661-6d651e0ef651 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:44:08.774562 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-6603996d-1f9b-49f7-9661-6d651e0ef651 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:44:08.876601 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6603996d-1f9b-49f7-9661-6d651e0ef651 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:44:08.946244 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9031646e-72c1-4744-9fc1-3686f0bc58c8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6deab40ae6244d4b9affa47b274aea3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:44:08.946872 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9031646e-72c1-4744-9fc1-3686f0bc58c8 service placement] REQUEST_METHOD: `GET` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:44:08.947164 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9031646e-72c1-4744-9fc1-3686f0bc58c8 service placement] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:44:08.947435 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9031646e-72c1-4744-9fc1-3686f0bc58c8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:44:08.949220 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-9031646e-72c1-4744-9fc1-3686f0bc58c8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:44:08.961211 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9031646e-72c1-4744-9fc1-3686f0bc58c8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:44:08.962809 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9031646e-72c1-4744-9fc1-3686f0bc58c8 service placement] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:44:08.973275 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1476/2927] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:44:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:44:11.752301 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc74f07-1f9f-4216-a60b-40e2231db495 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:44:11.753839 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-fcc74f07-1f9f-4216-a60b-40e2231db495 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:44:11.820720 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc74f07-1f9f-4216-a60b-40e2231db495 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:44:11.825788 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c61916a-0929-4032-9e3d-d85b2375d8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:44:11.826440 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c61916a-0929-4032-9e3d-d85b2375d8bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:44:11.826820 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c61916a-0929-4032-9e3d-d85b2375d8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:44:11.827035 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c61916a-0929-4032-9e3d-d85b2375d8bb admin admin] PATH_INFO: `/v3/users/4bc9e1e27ad3412e856dfda13a4f7e51` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:44:11.828165 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c61916a-0929-4032-9e3d-d85b2375d8bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bc9e1e27ad3412e856dfda13a4f7e51)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:44:11.830096 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c61916a-0929-4032-9e3d-d85b2375d8bb admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:44:11.881548 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-3c61916a-0929-4032-9e3d-d85b2375d8bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bc9e1e27ad3412e856dfda13a4f7e51'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:44:11.893842 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-3c61916a-0929-4032-9e3d-d85b2375d8bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bc9e1e27ad3412e856dfda13a4f7e51'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:44:11.895127 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-3c61916a-0929-4032-9e3d-d85b2375d8bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bc9e1e27ad3412e856dfda13a4f7e51'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:44:11.904293 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-3c61916a-0929-4032-9e3d-d85b2375d8bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bc9e1e27ad3412e856dfda13a4f7e51'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:44:11.905036 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-3c61916a-0929-4032-9e3d-d85b2375d8bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bc9e1e27ad3412e856dfda13a4f7e51'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:44:11.920750 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1452/2928] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:44:11 2022] DELETE /identity/v3/users/4bc9e1e27ad3412e856dfda13a4f7e51 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:44:12.103810 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9031646e-72c1-4744-9fc1-3686f0bc58c8 service placement] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:44:12.116090 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9031646e-72c1-4744-9fc1-3686f0bc58c8 service placement] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:44:12.184118 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcb3fc6-7170-4945-9dce-134618c0f1a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:44:12.184763 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb3fc6-7170-4945-9dce-134618c0f1a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:44:12.185128 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb3fc6-7170-4945-9dce-134618c0f1a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:44:12.185296 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb3fc6-7170-4945-9dce-134618c0f1a2 admin admin] PATH_INFO: `/v3/projects/92cfd0189e5d478ca95f1b5a38809030` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:44:12.186417 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcb3fc6-7170-4945-9dce-134618c0f1a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92cfd0189e5d478ca95f1b5a38809030)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:44:12.188366 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcb3fc6-7170-4945-9dce-134618c0f1a2 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:44:12.229642 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:44:12.240389 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-6bcb3fc6-7170-4945-9dce-134618c0f1a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92cfd0189e5d478ca95f1b5a38809030', 'request_id': 'req-6bcb3fc6-7170-4945-9dce-134618c0f1a2'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:44:12.248261 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-6bcb3fc6-7170-4945-9dce-134618c0f1a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92cfd0189e5d478ca95f1b5a38809030', 'request_id': 'req-6bcb3fc6-7170-4945-9dce-134618c0f1a2'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:44:12.255501 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-6bcb3fc6-7170-4945-9dce-134618c0f1a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92cfd0189e5d478ca95f1b5a38809030', 'request_id': 'req-6bcb3fc6-7170-4945-9dce-134618c0f1a2'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:44:12.266199 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-6bcb3fc6-7170-4945-9dce-134618c0f1a2 admin admin] The token cache is being invalidate because project 92cfd0189e5d478ca95f1b5a38809030 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:44:12.266484 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-6bcb3fc6-7170-4945-9dce-134618c0f1a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:44:12.267184 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-6bcb3fc6-7170-4945-9dce-134618c0f1a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:44:12.268700 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1477/2929] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:44:12 2022] DELETE /identity/v3/projects/92cfd0189e5d478ca95f1b5a38809030 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:44:12.273264 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c61916a-0929-4032-9e3d-d85b2375d8bb admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:44:12.274669 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-3c61916a-0929-4032-9e3d-d85b2375d8bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:44:12.288907 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c61916a-0929-4032-9e3d-d85b2375d8bb admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:44:12.345378 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd914eb-e0b7-446c-9736-f3e814bd82a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:44:12.346018 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd914eb-e0b7-446c-9736-f3e814bd82a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:44:12.346297 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd914eb-e0b7-446c-9736-f3e814bd82a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:44:12.346566 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd914eb-e0b7-446c-9736-f3e814bd82a9 admin admin] PATH_INFO: `/v3/users/07704d2604da4c89b3a7035456bc182a` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:44:12.348224 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd914eb-e0b7-446c-9736-f3e814bd82a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07704d2604da4c89b3a7035456bc182a)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:44:12.350331 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd914eb-e0b7-446c-9736-f3e814bd82a9 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:44:12.373237 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:44:12.401245 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-4fd914eb-e0b7-446c-9736-f3e814bd82a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07704d2604da4c89b3a7035456bc182a'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:44:12.414263 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-4fd914eb-e0b7-446c-9736-f3e814bd82a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07704d2604da4c89b3a7035456bc182a'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:44:12.414985 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-4fd914eb-e0b7-446c-9736-f3e814bd82a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07704d2604da4c89b3a7035456bc182a'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:44:12.421678 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-4fd914eb-e0b7-446c-9736-f3e814bd82a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07704d2604da4c89b3a7035456bc182a'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:44:12.422298 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-4fd914eb-e0b7-446c-9736-f3e814bd82a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07704d2604da4c89b3a7035456bc182a'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:44:12.435465 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1453/2930] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 12:44:12 2022] DELETE /identity/v3/users/07704d2604da4c89b3a7035456bc182a => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:44:12.605501 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcb3fc6-7170-4945-9dce-134618c0f1a2 admin admin] Authenticating user token {{(pid=81495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:44:12.607049 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.fernet_utils [None req-6bcb3fc6-7170-4945-9dce-134618c0f1a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:44:12.620628 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcb3fc6-7170-4945-9dce-134618c0f1a2 admin admin] Validating token access rules against request {{(pid=81495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:44:12.681774 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15b99a4-6fac-4aec-b595-eccd484cc763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba867dda5cc7471abb8f3da6ca94b58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '088123e0cad144f3a713fb6c4c75d880', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:44:12.682415 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b99a4-6fac-4aec-b595-eccd484cc763 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:44:12.682711 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b99a4-6fac-4aec-b595-eccd484cc763 admin admin] SCRIPT_NAME: `/identity` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:44:12.683076 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b99a4-6fac-4aec-b595-eccd484cc763 admin admin] PATH_INFO: `/v3/projects/f47322ae6e78410d957597e234ee9994` {{(pid=81495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:44:12.684179 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15b99a4-6fac-4aec-b595-eccd484cc763 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f47322ae6e78410d957597e234ee9994)` {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:44:12.686078 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15b99a4-6fac-4aec-b595-eccd484cc763 admin admin] RBAC: Authorization granted {{(pid=81495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:44:12.738426 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-d15b99a4-6fac-4aec-b595-eccd484cc763 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f47322ae6e78410d957597e234ee9994', 'request_id': 'req-d15b99a4-6fac-4aec-b595-eccd484cc763'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:44:12.746192 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-d15b99a4-6fac-4aec-b595-eccd484cc763 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f47322ae6e78410d957597e234ee9994', 'request_id': 'req-d15b99a4-6fac-4aec-b595-eccd484cc763'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:44:12.752878 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-d15b99a4-6fac-4aec-b595-eccd484cc763 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f47322ae6e78410d957597e234ee9994', 'request_id': 'req-d15b99a4-6fac-4aec-b595-eccd484cc763'} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:44:12.763085 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-d15b99a4-6fac-4aec-b595-eccd484cc763 admin admin] The token cache is being invalidate because project f47322ae6e78410d957597e234ee9994 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:44:12.763371 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-d15b99a4-6fac-4aec-b595-eccd484cc763 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:44:12.764016 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG keystone.notifications [None req-d15b99a4-6fac-4aec-b595-eccd484cc763 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:44:12.765513 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: [pid: 81495|app: 0|req: 1478/2931] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 12:44:12 2022] DELETE /identity/v3/projects/f47322ae6e78410d957597e234ee9994 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:44:22.432063 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:44:22.760227 dv-cinder-855288-4-iscsi devstack@keystone.service[81495]: DEBUG dbcounter [-] [81495] Writing DB stats keystone:DELETE=12,keystone:SELECT=62,keystone:INSERT=2 {{(pid=81495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:54.413987 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd914eb-e0b7-446c-9736-f3e814bd82a9 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:54.415389 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-4fd914eb-e0b7-446c-9736-f3e814bd82a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:47:54.561519 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd914eb-e0b7-446c-9736-f3e814bd82a9 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:54.631387 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b69ffd6-a9f7-491a-ad46-d0d865e61565 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6deab40ae6244d4b9affa47b274aea3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a94f4957f2a047cc844342e1c7c74ca5', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:54.632003 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b69ffd6-a9f7-491a-ad46-d0d865e61565 service placement] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:54.632286 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b69ffd6-a9f7-491a-ad46-d0d865e61565 service placement] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:54.632588 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b69ffd6-a9f7-491a-ad46-d0d865e61565 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:54.634430 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-9b69ffd6-a9f7-491a-ad46-d0d865e61565 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:47:54.646193 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b69ffd6-a9f7-491a-ad46-d0d865e61565 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:54.647856 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b69ffd6-a9f7-491a-ad46-d0d865e61565 service placement] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:54.658424 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1454/2932] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 12:47:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:48:04.654158 dv-cinder-855288-4-iscsi devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=89 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}